Connect with us

News

Rivian’s self-driving patent application hints at driver monitoring functionality

Image: Rivian

Published

on

Rivian’s Associate Director of Self-Driving, Oliver Jeromin, discussed a driver monitoring system that’s part of the company’s full self-driving suite in a recent interview. Thanks to a recently published patent application by the all-electric carmaker, more details about how such a system would work are now available.

The patent application, titled “Occupant Awareness Monitoring for Autonomous Vehicles,” was published on July 25, 2019, under serial number US 2019/0225228. It describes a multi-part system wherein driver activity is interpreted through synced wireless devices either on a smartphone or directly with the vehicle itself. If a driver’s awareness is needed and determined not to be available, the vehicle will take remedial action to ensure a high level of safety.

The five levels of vehicle autonomy defined by the Society for Automotive Engineers (SAE) (and adopted by the U.S. National Highway Traffic Safety Administration) range from level 0 with no automation to level 5 with full automation. Levels 3-5 specifically require that their human driver (or passenger if Level 5) be ready to retake control of the vehicle or respond in some way under specific circumstances. That said, Rivian’s invention described in this application seeks to detect whether the necessary level of readiness is present in the driver.

“The present inventors have recognized the technological problem of a potential need for human intervention in connection with the operation of autonomous automotive vehicles featuring autonomy levels 3, 4, or 5, and have observed a need for a technological solution to monitor the awareness of vehicle occupants,” the application states in the background portion of the description.

The monitoring process is described to work as follows:

Advertisement
-
  1. Connect, by vehicle, to wireless device of vehicle occupant.
  2. Receive, by vehicle, signal from wireless device indicative of activity of the vehicle occupant and processing the signal to determine level of awareness of vehicle occupant.
  3. Determine whether level of awareness of vehicle occupant satisfies a threshold.
  4. Generate, by vehicle, alert based upon whether level of awareness of vehicle occupant satisfies threshold.

To accomplish these steps, Rivian proposes in the application to pair electronic devices that can track and provide driver data to the automated driving program, e.g., general smartphones or tablets, finesses trackers, and electronically connected medical devices. If a driver is watching a movie or has vital signs indicating sleep (breathing rate, pulse, etc.), the vehicle would know the driver is not ready to resume control if needed and respond appropriately.

Also described in the patent application are enforcement ideas such as a series of touch screen prompts requiring a response, and in the event of no response, the vehicle would pull over and stop. If an emergency situation were detected via the connected medical devices, the car would pull over and call 911. Along with a fitness tracker, other medical devices suggested for use in the application are glucose monitors, blood oxygen monitors, and breathalyzers.

Driver attentiveness while using self-driving features is already a problem under Level 2 programs where warning prompts are fairly strict about keeping eyes on the road. Tesla, for instance, regularly reminds its customers that Autopilot isn’t a full self-driving system yet and needs complete driver attention. However, as headlines and Tesla crash investigations have indicated, the warning isn’t always heeded.

Rivian’s driver monitoring system certainly sounds like a good step towards increasing safety measures as the carmaker continues to develop its product lines. The proposed syncing of medical devices might run into some resistance on privacy grounds, but the overall payoff that a safe self-driving experience will provide may find cause for compromise. Overall, it’s clear Rivian has safety as a priority as it prepares to enter the automotive arena with the R1T pickup truck and R1S SUV later next year.

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
TESLARATI MARKETPLACE LIMITED-TIME OFFER

Give the gift of Tesla upgrades.

Shop for someone else or treat yourself. Get more shopping power with a Teslarati gift card.

YOU PAY $250
+
FREE BONUS $75
$325 TOTAL VALUE
Digital gift card delivered by email. Promotional terms apply.
View gift card details →
Comments

Elon Musk

Tesla Full Self-Driving v15 rollout begins: full release notes and improvements

Published

on

Tesla Reality View with FSD v15 (Credit: Tesla)

Tesla has announced that Full Self-Driving version 15 is now rolling out, after CEO Elon Musk said earlier today that the wide rollout would occur in December.

Now, Tesla is rolling out to Early Access Program (EAP) members v15’s first builds, and there are a lot of new improvements.

Tesla explicitly stated that safety improvements come in the form of “25x better handling of safety critical cases.” It is also rolling out “Tesla Reality View,” a new version of the Driver Visualization that appears to be much more realistic and could potential use Unreal Engine, according to the teaser video Tesla posted on social media. This “adds a live visualization of the drive that lets you see & control what FSD is planning to do.”

Advertisement
-

Perhaps the biggest improvements that Tesla mentioned, however, are that of Navigation fixes and better detection and aversion from potholes, debris, and animals, as well as “more natural speed handling in school zones and inclement weather.”

Tesla also added a new “Bike Rack Mode,” which will enable FSD’s use when bike racks or other hitch accessories are attached.

Tesla also revealed the full Release Notes for v15:

  • Upgraded vision encoder shared between FSD, Robotaxi, and Optimus, which is trained on millions of internet videos for improved generalization and data efficiency, improving the critical intervention rate by 25x.
  • Introduced Tesla Augmented Reality, replacing all of the explicit model signals into a single end-to-end visualization using less total compute.
  • Improved navigation by using an end-to-end learned model based on route preference data from the fleet.
  • Improved parking location selection by using personalized parking history, and the map will now display multiple parking options at your destination.
  • Improved driver monitoring by increasing vision-based attention monitoring availability with hats and sunglasses and decreasing strictness in higher speed driver profiles.
  • Improved detection of road signs, small animals, road debris, and chains.
  • Improved detection of potholes, road details, and avoidance of deep standing water.
  • Improved speed handling for each driver profile, school zones and speed limits, and inclement weather.
  • Improved Autoshift functionality by unifying with FSD-based gear predictions.
  • Tesla Reality View New: real-time generative driving visualization that continuously streams a view from an arbitrary virtual camera situated above your vehicle, enabling you to see and control what FSD is planning to do. Select between fullscreen visualizations, maps or a split view – or choose quiet mode for a calming cabin experience. Upcoming navigation turns display directly in the driving visualization. Turn signals are quieter and fade out after a few clicks.
  • Speed Camera Slowdown: FSD (Supervised) can now slow down when it detects a speed camera. Press the accelerator or increase your speed profile to cancel the slowdown. If you cancel twice at the same camera, your Tesla saves that location and will not slow down there again. To remove saved cameras, go to Controls > Service > Manage Saved Locations.
  • Bike Rack Mode With Bike Rack Mode, you can now engage FSD (Supervised) when a bike rack or similar hitch accessory is installed. When Bike Rack Mode is enabled, FSD (Supervised) pulls over near your destination and does not reverse. Autopark, Summon, and Backup chimes and warnings will be disabled.

It sounds like there are some really great improvements, and this is probably just a handful of what other improvements will come from these upgrades. For example, the UI changes will likely come with some other features that will be discovered upon the public having hands-on experience with it.

Musk said this morning that a wide release would occur sometime in December.

We’re looking forward to testing it when it arrives to us!

Advertisement
-

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 gets release date from Elon Musk

Published

on

Tesla Full Self-Driving v15 has received an official release date from CEO Elon Musk, who says the newest and most capable version of the suite will go wide in December with the 2026 Holiday Update.

That means the first iterations of the suite could actually come sooner, as the Early Access Program is the initial batch of owners to receive a new FSD release. Musk’s comments released a few tidbits of information, but nothing overwhelmingly revealing about its capabilities.

Musk was talking about supervised fine-tuning, stating that it is like “getting a haircut with a chainsaw,” before stating that FSD v15 will roll out wide for owners next month:

Musk’s Confirmed Changes and Fixes

Musk simply confirmed the new Full Self-Driving version would roll out with the 2026 Holiday Update, and the only two explicit changes he confirmed were updates to the User Interface (UI) and two small changes.

Musk’s comments on the UI confirm there are big changes coming to it, as he stated:

Advertisement
-

The UI changes will likely upgrade AMD Ryzen-equipped Tesla vehicles running AI4 to visualize vehicles using the Unreal Engine, something that was found in coding last year:

Tesla plans to use Unreal Engine for driver visualization with crazy upgrade

Advertisement
-

Additionally, one user stated that their biggest complaints with v14’s most recent releases is that they have to “stop refusing to use the HOV lane” and last-second lane changes to merge or turn happen too frequently. Musk said these should be fixed in v15.

In the past, we’ve also gotten small bits of detail about the v15 release, including from Tesla’s Head of AI, Ashok Elluswamy, who stated back in September that there are improved safety and collision avoidance systems coming with the v15 release.

Tesla plans big safety improvements for Full Self-Driving v15

Advertisement
-

The big prediction for v15 is whether this will enable at least some unsupervised driving in personal Teslas. There are likely to be some massive jumps in capability, although FSD has already proven itself to be a great way to travel. Nevertheless, there are a lot of things it could do better.

FSD still struggles with parking, it has routine bugs from update to update, it does not recognize potholes or large bumps on the road, speed control is a common complaint, and Navigation has been one of the biggest pain points.

However, v15 will likely bring massive improvements to capability and give people more options, like potentially parking orientation and more refined spot selection. We can only wait and see what Tesla will include.

Advertisement
-
Continue Reading

News

Tesla Assisted Driving (TAD) lands approval in Italy, its 12th EU country

Published

on

Credit: Tesla

Tesla Assisted Driving (TAD), the European equivalent of the Full Self-Driving suite in the U.S., has officially landed approval to operate in Italy, the 12th European Union country to allow the suite.

Italy marks a huge accomplishment for Tesla’s approval processes in Europe, as it marks the first truly major European country to give an approval.

On November 20, Italy’s Ministry of Transport granted provisional type-approval for Tesla Assisted Driving (TAD), the company’s advanced driver-assistance system. Transport Minister Matteo Salvini announced the decision on X, describing it as “another step forward toward innovation, technology and the mobility of the future, whilst always prioritising public safety.”

The approval followed a thorough technical feasibility assessment and positions Italy as the twelfth European country to authorize the technology, but the first among the European Union’s largest markets.

TAD, previously marketed as FSD (Supervised), will roll out in Italy shortly through an Over-the-Air update and will be available on a subscription basis at €99 per month.

This Italian green light carries substantially greater weight than the preceding approvals. The system first received provisional type-approval from the Netherlands’ RDW in April. Subsequent recognitions came primarily from smaller countries, like Lithuania, Denmark, Belgium, Croatia, Finland, and others.

Advertisement
-

Italy, by contrast, is the Union’s third-most populous member state and one of the traditional “big four” alongside Germany, France, and Spain. Its urban environments are particularly dense and present a more demanding real-world test for the system than many earlier markets.

The approval also follows a late-October conversation between Elon Musk and Salvini, after which the minister publicly supported a swift EU-level decision. Full bloc-wide authorization requires a qualified majority of at least 15 member states representing 65 percent of the EU population. Italy’s move adds meaningful population weight and political momentum ahead of potential discussions in the Technical Committee on Motor Vehicles.

Tesla marked the occasion with a video of a vehicle navigating Roman streets near the Colosseum, underscoring the system’s ability to handle the city’s distinctive traffic patterns.

For Tesla, the Italian authorization represents a strategic foothold in a major European car market, potentially accelerating both customer adoption and the case for broader regulatory acceptance across the continent.

Advertisement
-
Continue Reading