Connect with us

News

Tesla’s camera-based driver monitoring system exists; pretending it doesn’t makes roads less safe

Credit: Whole Mars Catalog/Twitter

Published

on

Tesla’s FSD Beta program has begun its expansion to more users. And while the system is only being distributed today to drivers with a perfect Safety Score, the advanced driver-assist system is expected to be released to users with a rating of 99 and below in the near future. True to form, with the expansion of FSD Beta also came the predictable wave of complaints and pearl-clutching from critics, some of whom still refuse to acknowledge that Tesla is now utilizing its vehicles’ in-cabin camera to bolster its driver-monitoring systems. 

Just recently, the NHTSA sent a letter to Tesla asking for an explanation why the company rolled out some improvements to Autopilot without issuing a safety recall. According to the NHTSA, Tesla should have filed for a recall notice if the company found a “safety defect” on its vehicles. What was missed by the NHTSA was that the Autopilot update, which enabled the company’s vehicles to slow down and alert their drivers when an emergency vehicle is detected, was done as a proactive measure, not as a response to a defect.

Consumer Reports Weighs In

Weighing in on the issue, Consumer Reports argued that ultimately, over-the-air software updates do not really address the main weakness of Teslas, which is driver-monitoring. The magazine admitted that Tesla’s driver-assist system’s object detection and response is better than comparable systems, but Kelly Funkhouser, head of connected and automated vehicle testing for Consumer Reports, argued that it is this very reason why the magazine has safety concerns with Tesla’s cars. 

“In our tests, Tesla continues to perform well at object detection and response compared to other vehicles. It’s actually because the driver assistance system performs so well that we are concerned about overreliance on it. The most important change Tesla needs to make is to add safeguards—such as an effective direct driver monitoring system—to ensure the driver is aware of their surroundings and able to take over in these types of scenarios,” Funkhouser said. 

Jake Fisher, senior director of Consumer Reports‘ Auto Test Center, also shared his own take on the issue, particularly around some Autopilot crashes involving stationary emergency vehicles on the side of the road. “CR’s position is that crashes like these can be avoided if there is an effective driver monitoring system, and that’s the underlying problem here,” Fisher said, adding that over-the-air software updates are typically not sent to address defects.   

Tesla’s camera-based DMS

Funkhouser and Fisher’s reference to direct driver monitoring systems is interesting because the exact feature has been steadily rolling out to Tesla’s vehicles over the past months. It is quite strange that Consumer Reports seems unaware about this, considering that the magazine has Teslas in its fleet. Tesla, after all, has been rolling out its camera-based driver monitoring system to its fleet since late May 2021. A rollout of the camera-based system to radar-equipped vehicles was done in the previous quarter. 

Advertisement
-

Tesla’s Release Notes for its camera-based driver monitoring function describes how the function works. “The cabin camera above your rearview mirror can now detect and alert driver inattentiveness while Autopilot is engaged. Camera data does not leave the car itself, which means the system cannot save or transmit information unless data sharing is enabled,” Tesla noted in its Release Notes. 

What is interesting is that Consumer Reports‘ Jake Fisher was made aware of the function when it launched last May. In a tweet, Fisher even noted that the camera-based system was not “just about preventing abuse;” it also “has the potential to save lives by preventing distraction.” This shows that Consumer Reports, or at least the head of its Auto Test Center, has been fully aware that Tesla’s in-cabin cameras are now steadily being used for driver monitoring purposes. This makes his recent comments about Tesla’s lack of driver monitoring quite strange. 

Legacy or Bust? 

That being said, Consumer Reports appears to have a prepared narrative once it acknowledges the existence of Tesla’s camera-based driver-monitoring system. Back in March, the magazine posted an article criticizing Tesla for its in-cabin cameras, titled “Tesla’s In-Car Cameras Raise Privacy Concerns.” In the article, the magazine noted that the EV maker could simply be using its in-cabin cameras for its own benefit. “

“We have already seen Tesla blaming the driver for not paying attention immediately after news reports of a crash while a driver is using Autopilot. Now, Tesla can use video footage to prove that a driver is distracted rather than addressing the reasons why the driver wasn’t paying attention in the first place,” Funkhouser said. 

Considering that Consumer Reports seems to be critical of Tesla’s use (or non-use for that matter) of its vehicles’ in-cabin cameras, it appears that the magazine is arguing that the only effective and safe driver monitoring systems are those utilized by veteran automakers like General Motors for its Super Cruise system. However, even the advanced eye-tracking technology used by GM for Super Cruise, which Consumer Reports overtly praises, has been proven to be susceptible to driver abuse. 

This was proven by Car and Driver, when the motoring publication fooled Super Cruise into operating without a driver using a pair of gag glasses with eyes painted on them. One could easily criticize Car and Driver for publicly showcasing a vulnerability in Super Cruise’s driver monitoring systems, but one has to remember that Consumer Reports also published an extensive guide on how to fool Tesla’s Autopilot into operating without a driver using a series of tricks and a defeat device. 

Advertisement
-

Salivating for the first FSD Beta accident

What is quite unfortunate amidst the criticism surrounding the expansion of FSD Beta is the fact that skeptics seem to be salivating for the first accident involving the advanced driver-assist system. Fortunately, Tesla seems to be aware of this, which may be the reason why the Beta is only being released to the safest drivers in the fleet. Tesla does plan on releasing the system to drivers with lower safety scores, but it would not be a surprise if the company ends up adopting an even more cautious approach when it does so. 

That being said, incidents on the road are inevitable, and one can only hope that when something does happen, it would not be too easy for an organization such as Consumer Reports to run away with a narrative that echoes falsehoods that its own executives have recognized publicly — such as the potential benefits of Tesla’s camera-based driver monitoring system. Tesla’s FSD suite and Autopilot are designed as safety features, after all, and so far, they are already making the company’s fleet of vehicles less susceptible to accidents on the road. Over time, and as more people participate in the FSD Beta program, Autopilot and Full Self-Driving would only get safer. 

Tesla is not above criticism, of course. There are several aspects of the company that deserves to be called out. Service and quality control, as well as the treatment of longtime Tesla customers who purchased FSD cars with MCU1 units, are but a few of them. However, it’s difficult to defend the notion that FSD and Autopilot are making the roads less safe. Autopilot and FSD have already saved numerous lives, and they have the potential to save countless more once they are fully developed. So why block their development and rollout?

Don’t hesitate to contact us with news tips. Just send a message to tips@teslarati.com to give us a heads up. 

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

Elon Musk

Tesla shows what Roadster drivers will see on screen before thruster activation

Tesla’s Roadster video reveals a fighter jet inspired cockpit with a 5,500 PSI thruster gauge.

Published

on

By

The next generation Tesla Roadster’s touchscreen, shown in Tesla’s first official look at the car’s interface. (Credit: Tesla/X)

Tesla has given future owners their clearest look yet at the cockpit of its next generation Roadster. In a 34 second video posted to X on Friday afternoon, the company walked through the car’s touchscreen with a caption: “Inspired by fighter jet cockpits, Roadster’s interface was designed around the pilot.”

The clip opens on a black screen with red graphics and a 3D wireframe of the car, which sits beside the Roadster’s squared off yoke. Tapping parts of the model brings up controls for the rear wing, including low drag and high downforce positions, along with a charging page with a charge limit bar and a small music player. A row of tabs along the bottom reads Home, Vehicle, Listen, Climate and Navigate.

Most of the video is spent in Track Mode. The dashboard shows a live circuit map, a list of session lap times, brake and motor temperatures, and pressure and temperature readouts for each tire. A setup page lets the driver pick Auto, Low Drag, High Downforce or Custom aero modes, adjust aero balance and brake balance, and switch stability and traction control off. Along the bottom, a status bar reads “Thruster · 5,500 PSI” next to a “Boost Ready” indicator.

That gauge ties the software to the hardware Tesla showed off near Waco, Texas on October 15. The Thrust and Rocket versions use cold gas thrusters fed by carbon overwrapped pressure vessels, and Tesla lists 0 to 60 mph times of under 0.9 seconds and under 0.59 seconds for them, as Teslarati detailed in its breakdown of the three Roadster configurations. The base Performance car relies on a fan and ground sealing system for grip, and the aero settings on screen match the active wings and suction setup covered in our look at how the Roadster generates downforce.

The Roadster layout is a departure from the rest of Tesla’s lineup. Instead of a map centered screen, the Roadster puts the car itself at the center of the home page, and Tesla’s Roadster page lists two smaller forward displays alongside the main touchscreen. Tesla has not said whether any of the Track Mode telemetry will make its way to the Model 3 Performance or other vehicles.

Advertisement
-

The interface could still change before deliveries. Elon Musk said at the event that Roadster production will begin in 2028, and Tesla says the flagship Rocket version is not approved for public road use. Reservations are open with a $50,000 payment, while Thrust is listed as a limited release and Rocket is invite only.

Those who want to see the car in person will get their first chance this weekend. The Roadster goes on display in the lobby of the Petersen Automotive Museum in Los Angeles from October 24 to 27, according to Sawyer Merritt, the first time the public will be able to view it up close.

Continue Reading

Elon Musk

Tesla reveals Optimus Academy, where robots teach themselves

Tesla has begun building production quality Optimus robots in Fremont and revealed its training plan.

Published

on

By

Concept rendering of Tesla Optimus in mass production

Tesla has started building Optimus on the high volume line it set up inside its Fremont factory, and the company says the robots coming off it are the first that meet the bar for a real product. “The bots coming off this line are the first production-quality bots that we have manufactured,” Tesla wrote in its third quarter shareholder letter, adding that it has “proven that the current manufacturing process for Optimus is suitable for a commercial product.”

The line sits in space that built the Model S and Model X until this spring. Tesla cleared the old vehicle line in 46 days, as Teslarati reported in July, to make room for robot production sized for one million units a year. On Wednesday’s earnings call, Elon Musk said most of the equipment for that capacity is already in Fremont, with output set to climb toward roughly 20,000 robots a week as the line ramps.

Musk described the ramp as a classic S curve. “The growth of Optimus is an S curve, but the initial curve is a shallow slope,” he said. The team is now refining the robot’s AI, electromechanical design, reliability and service life, and Musk expects that work to be finished by the end of next year, when Tesla plans to start delivering Optimus to outside companies for dangerous, repetitive and around the clock jobs.

The most interesting part of the call was how Tesla plans to teach the robots. Its cars send real driving data back to the AI team from millions of vehicles, but Optimus has no fleet like that yet. “A big difference with Optimus versus the cars is we don’t have this vast fleet of cars from which we can gather training data,” Musk said. Tesla’s answer is an Optimus Academy, where 10,000 to 20,000 robots will practice a wide range of tasks and feed what they learn into the next version of the model. Every unit off the Fremont line becomes a source of that training data.

Smarter hardware is on the way too. Tesla plans to put its AI5 chip into Optimus next year, and Musk said a new Optimus video should arrive within one or two months showing the robot completing tasks driven by AI rather than preprogrammed motions. He took aim at rival humanoid demos that only run scripted routines, saying those would not hold up in the real world.

Advertisement
-

The supply chain is lining up behind the program. In September, Tesla certified Tuopu, Joyson and Sanhua as mass production partners for Optimus components. A far larger Optimus factory is also rising at Giga Texas, where drone footage from Joe Tegtmeyer showed the steel frame nearing completion, and Musk has pegged that plant’s long term target at 10 million robots a year.

Tesla executives also said Optimus production costs are trending toward the expected manufacturing cost of Cybercab, a sign the robot is being engineered for volume from the start. The hands remain the toughest piece of the design, a point Musk also made at the X Takeover event earlier this month, as Teslarati covered at the time, and that is where much of the current engineering effort is focused.

Continue Reading

Elon Musk

The Starship moon landing number NASA and Elon Musk can’t agree on

Musk disputes NASA estimate of 22 Starship launches for Moon landing, predicting 6 to 8.

Published

on

By

Concept rendering of SpaceX Starship landing on the moon via Grok

Elon Musk is disputing a new NASA safety panel estimate of how many Starship launches it will take to put astronauts on the Moon, saying the real number will be less than half the panel’s figure.

On Thursday, NASA’s Aerospace Safety Advisory Panel held its quarterly public meeting. Panel member Charlie Precourt, a former NASA astronaut, flagged the fueling process for SpaceX’s lunar lander as a major risk for Artemis IV, the mission planned to land a crew on the Moon in 2028. “We need to keep our eyes on numerous required fuelings for the lander,” Precourt said, according to Ars Technica. “I think the last estimate is around 22 flights.”

Ars Technica’s Eric Berger posted the comment on X, and Musk replied. “That’s way too high,” Musk wrote. “Actual number will be more like 6 to 8.”

The disagreement comes down to a basic problem with sending a ship as large as Starship to the Moon. Starship burns nearly all of its propellant just reaching Earth orbit, so it cannot continue on to the Moon without stopping for a refill. SpaceX’s answer is a gas station in space. First, a Starship that works as a storage tank, called a depot, is launched into orbit. Then a series of tanker Starships launch one at a time, dock with the depot and pump their leftover propellant into it. Once the depot is full, the lunar lander version of Starship launches, docks, fills up and heads for the Moon.

Every tanker trip is its own full rocket launch, which is why the count matters. More launches mean more time, more cost and more chances for something to go wrong before astronauts ever leave Earth. Berger estimated that even if SpaceX reaches twice weekly Starship launches by the end of 2027, filling a depot at the panel’s number would still take roughly three months.

Advertisement
-

How many tankers are needed depends mostly on how much propellant each one can carry to orbit and how much is lost along the way. Starship’s fuel and oxygen are stored at extremely cold temperatures, and some of it slowly boils off while waiting in orbit. More is lost in each transfer. NASA appears to be working from what Starship can lift today, while Musk’s range assumes a more capable rocket.

Musk has pushed back on higher counts before. In 2021, after a government document suggested 16 launches, he called that “extremely unlikely” and said eight tankers would be the most required.

Much of the answer depends on hardware SpaceX has not finished flying. As Teslarati noted earlier this year, the company plans to carry out the refueling process with its upgraded V3 Starship, and Precourt described Artemis IV as carrying “a large number of firsts.” He also praised NASA Administrator Jared Isaacman’s team for working to clear obstacles for both SpaceX and Blue Origin, whose Blue Moon lander does not rely on orbital refueling for its first mission.

Continue Reading