Connect with us

News

Tesla’s camera-based driver monitoring system exists; pretending it doesn’t makes roads less safe

Credit: Whole Mars Catalog/Twitter

Published

on

Tesla’s FSD Beta program has begun its expansion to more users. And while the system is only being distributed today to drivers with a perfect Safety Score, the advanced driver-assist system is expected to be released to users with a rating of 99 and below in the near future. True to form, with the expansion of FSD Beta also came the predictable wave of complaints and pearl-clutching from critics, some of whom still refuse to acknowledge that Tesla is now utilizing its vehicles’ in-cabin camera to bolster its driver-monitoring systems. 

Just recently, the NHTSA sent a letter to Tesla asking for an explanation why the company rolled out some improvements to Autopilot without issuing a safety recall. According to the NHTSA, Tesla should have filed for a recall notice if the company found a “safety defect” on its vehicles. What was missed by the NHTSA was that the Autopilot update, which enabled the company’s vehicles to slow down and alert their drivers when an emergency vehicle is detected, was done as a proactive measure, not as a response to a defect.

Consumer Reports Weighs In

Weighing in on the issue, Consumer Reports argued that ultimately, over-the-air software updates do not really address the main weakness of Teslas, which is driver-monitoring. The magazine admitted that Tesla’s driver-assist system’s object detection and response is better than comparable systems, but Kelly Funkhouser, head of connected and automated vehicle testing for Consumer Reports, argued that it is this very reason why the magazine has safety concerns with Tesla’s cars. 

“In our tests, Tesla continues to perform well at object detection and response compared to other vehicles. It’s actually because the driver assistance system performs so well that we are concerned about overreliance on it. The most important change Tesla needs to make is to add safeguards—such as an effective direct driver monitoring system—to ensure the driver is aware of their surroundings and able to take over in these types of scenarios,” Funkhouser said. 

Jake Fisher, senior director of Consumer Reports‘ Auto Test Center, also shared his own take on the issue, particularly around some Autopilot crashes involving stationary emergency vehicles on the side of the road. “CR’s position is that crashes like these can be avoided if there is an effective driver monitoring system, and that’s the underlying problem here,” Fisher said, adding that over-the-air software updates are typically not sent to address defects.   

Advertisement
-

Tesla’s camera-based DMS

Funkhouser and Fisher’s reference to direct driver monitoring systems is interesting because the exact feature has been steadily rolling out to Tesla’s vehicles over the past months. It is quite strange that Consumer Reports seems unaware about this, considering that the magazine has Teslas in its fleet. Tesla, after all, has been rolling out its camera-based driver monitoring system to its fleet since late May 2021. A rollout of the camera-based system to radar-equipped vehicles was done in the previous quarter. 

Tesla’s Release Notes for its camera-based driver monitoring function describes how the function works. “The cabin camera above your rearview mirror can now detect and alert driver inattentiveness while Autopilot is engaged. Camera data does not leave the car itself, which means the system cannot save or transmit information unless data sharing is enabled,” Tesla noted in its Release Notes. 

What is interesting is that Consumer Reports‘ Jake Fisher was made aware of the function when it launched last May. In a tweet, Fisher even noted that the camera-based system was not “just about preventing abuse;” it also “has the potential to save lives by preventing distraction.” This shows that Consumer Reports, or at least the head of its Auto Test Center, has been fully aware that Tesla’s in-cabin cameras are now steadily being used for driver monitoring purposes. This makes his recent comments about Tesla’s lack of driver monitoring quite strange. 

Legacy or Bust? 

That being said, Consumer Reports appears to have a prepared narrative once it acknowledges the existence of Tesla’s camera-based driver-monitoring system. Back in March, the magazine posted an article criticizing Tesla for its in-cabin cameras, titled “Tesla’s In-Car Cameras Raise Privacy Concerns.” In the article, the magazine noted that the EV maker could simply be using its in-cabin cameras for its own benefit. “

“We have already seen Tesla blaming the driver for not paying attention immediately after news reports of a crash while a driver is using Autopilot. Now, Tesla can use video footage to prove that a driver is distracted rather than addressing the reasons why the driver wasn’t paying attention in the first place,” Funkhouser said. 

Advertisement
-

Considering that Consumer Reports seems to be critical of Tesla’s use (or non-use for that matter) of its vehicles’ in-cabin cameras, it appears that the magazine is arguing that the only effective and safe driver monitoring systems are those utilized by veteran automakers like General Motors for its Super Cruise system. However, even the advanced eye-tracking technology used by GM for Super Cruise, which Consumer Reports overtly praises, has been proven to be susceptible to driver abuse. 

This was proven by Car and Driver, when the motoring publication fooled Super Cruise into operating without a driver using a pair of gag glasses with eyes painted on them. One could easily criticize Car and Driver for publicly showcasing a vulnerability in Super Cruise’s driver monitoring systems, but one has to remember that Consumer Reports also published an extensive guide on how to fool Tesla’s Autopilot into operating without a driver using a series of tricks and a defeat device. 

Salivating for the first FSD Beta accident

What is quite unfortunate amidst the criticism surrounding the expansion of FSD Beta is the fact that skeptics seem to be salivating for the first accident involving the advanced driver-assist system. Fortunately, Tesla seems to be aware of this, which may be the reason why the Beta is only being released to the safest drivers in the fleet. Tesla does plan on releasing the system to drivers with lower safety scores, but it would not be a surprise if the company ends up adopting an even more cautious approach when it does so. 

That being said, incidents on the road are inevitable, and one can only hope that when something does happen, it would not be too easy for an organization such as Consumer Reports to run away with a narrative that echoes falsehoods that its own executives have recognized publicly — such as the potential benefits of Tesla’s camera-based driver monitoring system. Tesla’s FSD suite and Autopilot are designed as safety features, after all, and so far, they are already making the company’s fleet of vehicles less susceptible to accidents on the road. Over time, and as more people participate in the FSD Beta program, Autopilot and Full Self-Driving would only get safer. 

Tesla is not above criticism, of course. There are several aspects of the company that deserves to be called out. Service and quality control, as well as the treatment of longtime Tesla customers who purchased FSD cars with MCU1 units, are but a few of them. However, it’s difficult to defend the notion that FSD and Autopilot are making the roads less safe. Autopilot and FSD have already saved numerous lives, and they have the potential to save countless more once they are fully developed. So why block their development and rollout?

Advertisement
-

Don’t hesitate to contact us with news tips. Just send a message to tips@teslarati.com to give us a heads up. 

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
TESLARATI MARKETPLACE LIMITED-TIME OFFER

Give the gift of Tesla upgrades.

Shop for someone else or treat yourself. Get more shopping power with a Teslarati gift card.

YOU PAY $250
+
FREE BONUS $75
$325 TOTAL VALUE
Digital gift card delivered by email. Promotional terms apply.
View gift card details →
Comments

News

Tesla Full Self-Driving v15: Reality View review, new features explained

Published

on

Tesla has officially started rolling out the Full Self-Driving version 15 update, and we were lucky enough to get it in the first wave on Saturday night. It comes with a lot of new features, but the biggest is Tesla Reality View, a real-time AI video generation of the outside world that uses less compute than even the earliest versions of FSD driving visualization.

The release notes, which we covered on Saturday, revealed Reality View, Speed Camera Recognition and Slowdown, and a new Bike Rack Mode.

After spending plenty of time with the suite over the last 18 hours, I have a pretty good grasp of the new features and what you should expect from them when you get them on your Tesla. CEO Elon Musk said that it will wide release in December with the 2026 Holiday Update.

NOTE: If you’re looking for a review on FSD v15.0.1’s driving performance, I will have a small section breaking down what I noticed over the first drives I took, but I would rather hold off on making any real declarations about it until I have a few hundred miles under my belt. It just feels like I can’t make any real distinctions on anything other than a handful of things Tesla claims in its release notes.

Tesla Reality Vision

Let’s start what I know we are all here for: Tesla Reality Vision is here and it’s absolutely insane. Elon and Co. have also shed a lot of really cool tidbits about the development of it and some of its more intimate details. It’s pretty remarkable what they’re saying about it.

My first impression of Reality View was that it was incredibly detailed. It is honestly hard to believe, at first glance, that there is not a drone following your car. However, once you reach any sort of signage, it’s pretty obvious that it is not a puzzling of camera angles but exactly what Musk says it is:

My first rides with it revealed quite a few things.

  • It’s very impressive how realistic the texturing of the environment is. The grass, trees, buildings, and all of nature is really well rendered. You can see the shifting as you are moving; I’ve seen a lot of people compare it to the early versions of the Will Smith Spaghetti AI Videos, and that feels like a good comparison. It’s very, very good for a first attempt, and if it looks like this now, it isn’t unrealistic to say that it will look very close to realistic in the future. I would think within the next 8 months is probably somewhat realistic.
  • There is some input lag, and Musk has already addressed that by stating: “Currently, the latency is a bit high due to compute constraints, but we have ways to interleave newer UVE features along the diffusion transformer layers to cut roughly 35% of the latency.”
    • The lag is not something that is a dealbreaker or even that bad, but it is definitely noticeable. It’s still much better than many OEMs UI, which is as simplistic as menus and has tremendously more lag. It sounds like Musk already has a plan that should alleviate this, so that could come soon.

One of the coolest features of the Reality View is that it will orient itself based on whether you’re moving forward or backward. When backing out of a space, the drone view switches to the front of the car:

Another really nice touch is the quieter turn signal chimes, which start at a normal volume and then subtly get quieter until they are barely noticeable. It’s a very peaceful touch that Tesla added with the v15 update:

First Thoughts on Driving Performance

Overall, I have only noticed a handful of things. Driving performance feels very similar to recent FSD versions, but these are two things I caught:

  • When taking a left-hand turn from the middle of an intersection with a lot of room, the car didn’t just turn left, it actually turned right a little bit and then turned left. This is something you see a lot of very inexperienced drivers do; they’ll be in a Honda Civic and they act like they need to swing it wide to make a very straightforward turn. I have never seen FSD do this. This turn is one I take each day, as it is on my way to the gym. It was absolutely crazy and I was really thrown off by it. I hope this isn’t a new thing.
  • I didn’t get to see many potholes but I did see a lot of manhole covers, and FSD didn’t do anything to avoid them. In our YouTube video down below, you’ll notice it runs over many manhole covers. I was hoping it was try to avoid these, but I didn’t seem to get that impression.

In the coming days, I’ll do a longer review on the driving performance and whether or not v15.0.1 includes the things that Tesla explicitly mentioned in the Release Notes.

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 rollout begins: full release notes and improvements

Published

on

Tesla Reality View with FSD v15 (Credit: Tesla)

Tesla has announced that Full Self-Driving version 15 is now rolling out, after CEO Elon Musk said earlier today that the wide rollout would occur in December.

Now, Tesla is rolling out to Early Access Program (EAP) members v15’s first builds, and there are a lot of new improvements.

Tesla explicitly stated that safety improvements come in the form of “25x better handling of safety critical cases.” It is also rolling out “Tesla Reality View,” a new version of the Driver Visualization that appears to be much more realistic and could potential use Unreal Engine, according to the teaser video Tesla posted on social media. This “adds a live visualization of the drive that lets you see & control what FSD is planning to do.”

Perhaps the biggest improvements that Tesla mentioned, however, are that of Navigation fixes and better detection and aversion from potholes, debris, and animals, as well as “more natural speed handling in school zones and inclement weather.”

Tesla also added a new “Bike Rack Mode,” which will enable FSD’s use when bike racks or other hitch accessories are attached.

Tesla also revealed the full Release Notes for v15:

  • Upgraded vision encoder shared between FSD, Robotaxi, and Optimus, which is trained on millions of internet videos for improved generalization and data efficiency, improving the critical intervention rate by 25x.
  • Introduced Tesla Augmented Reality, replacing all of the explicit model signals into a single end-to-end visualization using less total compute.
  • Improved navigation by using an end-to-end learned model based on route preference data from the fleet.
  • Improved parking location selection by using personalized parking history, and the map will now display multiple parking options at your destination.
  • Improved driver monitoring by increasing vision-based attention monitoring availability with hats and sunglasses and decreasing strictness in higher speed driver profiles.
  • Improved detection of road signs, small animals, road debris, and chains.
  • Improved detection of potholes, road details, and avoidance of deep standing water.
  • Improved speed handling for each driver profile, school zones and speed limits, and inclement weather.
  • Improved Autoshift functionality by unifying with FSD-based gear predictions.
  • Tesla Reality View New: real-time generative driving visualization that continuously streams a view from an arbitrary virtual camera situated above your vehicle, enabling you to see and control what FSD is planning to do. Select between fullscreen visualizations, maps or a split view – or choose quiet mode for a calming cabin experience. Upcoming navigation turns display directly in the driving visualization. Turn signals are quieter and fade out after a few clicks.
  • Speed Camera Slowdown: FSD (Supervised) can now slow down when it detects a speed camera. Press the accelerator or increase your speed profile to cancel the slowdown. If you cancel twice at the same camera, your Tesla saves that location and will not slow down there again. To remove saved cameras, go to Controls > Service > Manage Saved Locations.
  • Bike Rack Mode With Bike Rack Mode, you can now engage FSD (Supervised) when a bike rack or similar hitch accessory is installed. When Bike Rack Mode is enabled, FSD (Supervised) pulls over near your destination and does not reverse. Autopark, Summon, and Backup chimes and warnings will be disabled.

It sounds like there are some really great improvements, and this is probably just a handful of what other improvements will come from these upgrades. For example, the UI changes will likely come with some other features that will be discovered upon the public having hands-on experience with it.

Musk said this morning that a wide release would occur sometime in December.

We’re looking forward to testing it when it arrives to us!

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 gets release date from Elon Musk

Published

on

Tesla Full Self-Driving v15 has received an official release date from CEO Elon Musk, who says the newest and most capable version of the suite will go wide in December with the 2026 Holiday Update.

That means the first iterations of the suite could actually come sooner, as the Early Access Program is the initial batch of owners to receive a new FSD release. Musk’s comments released a few tidbits of information, but nothing overwhelmingly revealing about its capabilities.

Musk was talking about supervised fine-tuning, stating that it is like “getting a haircut with a chainsaw,” before stating that FSD v15 will roll out wide for owners next month:

Musk’s Confirmed Changes and Fixes

Musk simply confirmed the new Full Self-Driving version would roll out with the 2026 Holiday Update, and the only two explicit changes he confirmed were updates to the User Interface (UI) and two small changes.

Musk’s comments on the UI confirm there are big changes coming to it, as he stated:

The UI changes will likely upgrade AMD Ryzen-equipped Tesla vehicles running AI4 to visualize vehicles using the Unreal Engine, something that was found in coding last year:

Tesla plans to use Unreal Engine for driver visualization with crazy upgrade

Additionally, one user stated that their biggest complaints with v14’s most recent releases is that they have to “stop refusing to use the HOV lane” and last-second lane changes to merge or turn happen too frequently. Musk said these should be fixed in v15.

In the past, we’ve also gotten small bits of detail about the v15 release, including from Tesla’s Head of AI, Ashok Elluswamy, who stated back in September that there are improved safety and collision avoidance systems coming with the v15 release.

Tesla plans big safety improvements for Full Self-Driving v15

The big prediction for v15 is whether this will enable at least some unsupervised driving in personal Teslas. There are likely to be some massive jumps in capability, although FSD has already proven itself to be a great way to travel. Nevertheless, there are a lot of things it could do better.

FSD still struggles with parking, it has routine bugs from update to update, it does not recognize potholes or large bumps on the road, speed control is a common complaint, and Navigation has been one of the biggest pain points.

However, v15 will likely bring massive improvements to capability and give people more options, like potentially parking orientation and more refined spot selection. We can only wait and see what Tesla will include.

Continue Reading