Connect with us

News

Mercedes-Benz DRIVE PILOT captures world’s first approval for hands-free driving

Während der hochautomatisierten Fahrt, ermöglicht DRIVE PILOT dem Fahrer sich vom Verkehrsgeschehen ab- und bestimmten Nebentätigkeiten zu zuwenden. Zum Beispiel mit den Kollegen via In-Car-Office zu kommunizieren, Mails zu schreiben, im Internet zu surfen oder entspannt einen Film anzuschauen. // During the conditionally automated journey, DRIVE PILOT enables the driver to move away from the traffic situation and to turn to certain secondary activities. For example, communicating with colleagues via in-car office, writing e-mails, surfing the Internet or watching a movie in a relaxed way.

Published

on

Mercedes-Benz DRIVE PILOT has captured the world’s first approval for ‘conditionally automated’ driving on German highways with its Level 3 system. The German automaker’s DRIVE PILOT is the first internationally valid system, as it met the requirements of Global Automotive Regulation No. 157, which concerns the approval of vehicles with regards to Automated Lane-Keeping Systems.

Mercedes-Benz announced the accomplishment, calling it proof of the company’s “pioneering work in automated driving.” The German Federal Motor Transport Authority granted the approval.

“For many years, we have been working to realize our vision of automated driving. With this LiDAR-based system, we have developed an innovative technology for our vehicles that offers customers a unique, luxurious driving experience and gives them what matters most: time. With the approval of the authorities, we have now achieved a breakthrough: We are the first manufacturer to put conditionally automated driving into series production in Germany,” Member of the Board of Management of Daimler AG and Mercedes-Benz AG, Chief Technology Officer responsible for Development and Purchasing Markus Schäfer said.

Die Bedienelemente für den DRIVE PILOT sitzen im Lenkradkranz oberhalb der Daumenmulden rechts und links. Aktiviert der Fahrer den DRIVE PILOT, regelt das System Geschwindigkeit und Abstand und führt das Fahrzeug souverän innerhalb der Spur. // The controls for DRIVE PILOT are located in the steering wheel rim above the thumb recesses on the right and left. If the driver activates DRIVE PILOT, the system regulates speed and distance and guides the vehicle confidently within the lane.

DRIVE PILOT will first be available in Mercedes-Benz S-Class models in the first half of 2022. There will be initial limitations with the functionality’s ability, and drivers will only be able to drive at speeds of up to 60 km/h or 37 MPH on German highways. This will effectively limit the Level 3 system to operating in “heavy traffic or congested situations on suitable stretches of highway in Germany.” Regularly flowing traffic patterns at speeds that exceed the approved limits will require a normal driving operation.

Levels of autonomous driving have been outlined by the Society of Automotive Engineers (SAE). Level 3 Autonomy does not require humans to perform the act of driving. However, of the three levels that allow hands-free driving, which are Levels 3, 4, and 5, Level 3 is the only category in which the driver must take over if the vehicle requests human intervention. Level 3 is effectively described as a “traffic jam chauffeur,” which would align with the capabilities of the DRIVE PILOT system.

“During the conditionally automated journey, DRIVE PILOT allows the driver to take their mind off the traffic and focus on certain secondary activities, be it communicating with colleagues via In-Car Office, surfing the internet, or relaxing while watching a film. In DRIVE PILOT mode, applications can be enabled on the vehicle’s integrated central display that are otherwise blocked while driving,” the automaker wrote.

Advertisement
-

The system will initially be available on 8,197 miles or 13,191 kilometers of German highway. Mercedes-Benz said that it is working on completing extensive test drives in other markets, including the U.S. and China, so that it can launch DRIVE PILOT in countries outside of Germany.

DRIVE PILOT in der S-Klasse: Hochautomatisiertes Fahren auf Deutschlands Autobahnen // DRIVE PILOT in the S-Class: Conditionally automated driving on German freeways

DRIVE PILOT uses a LiDAR-based system for operation, but it also has a camera in the rear window and a microphone, which will both be used to detect approaching emergency vehicles by recognizing flashing blue lights and sirens. There is also a moisture sensor in the wheel well, used for detecting slippery or wet driving conditions. A digital HD map will transmit information regarding road geometry, route profile, traffic signs, and unusual traffic events, including accidents or road work, to DRIVE PILOT, helping it make informed and logical decisions throughout the vehicle’s operation.

Mercedes-Benz also said that it has implemented a safety system that will inform the driver of when the vehicle needs to be back in the control of a human. If the driver fails to take back control of the car for any reason, including medical emergencies, the vehicle’s braking system will bring the car to a stop in a controlled manner while also activating hazard lights. Mercedes-Benz has an emergency call system, which will automatically contact first responders, and the vehicle’s doors and windows will unlock for easier access for first responders.

Mercedes-Benz has been working to get DRIVE PILOT approved by regulators since mid-2021.

I’d love to hear from you! If you have any comments, concerns, or questions, please email me at joey@teslarati.com. You can also reach me on Twitter @KlenderJoey, or if you have news tips, you can email us at tips@teslarati.com.

Advertisement
-

Joey has been a journalist covering electric mobility at TESLARATI since August 2019. In his spare time, Joey is playing golf, watching MMA, or cheering on any of his favorite sports teams, including the Baltimore Ravens and Orioles, Miami Heat, Washington Capitals, and Penn State Nittany Lions. You can get in touch with joey at joey@teslarati.com. He is also on X @KlenderJoey. If you're looking for great Tesla accessories, check out shop.teslarati.com

Advertisement
TESLARATI MARKETPLACE LIMITED-TIME OFFER

Give the gift of Tesla upgrades.

Shop for someone else or treat yourself. Get more shopping power with a Teslarati gift card.

YOU PAY $250
+
FREE BONUS $75
$325 TOTAL VALUE
Digital gift card delivered by email. Promotional terms apply.
View gift card details →
Comments

News

Tesla Full Self-Driving v15: a first-hand look at Reality View, new features

Published

on

Tesla has officially started rolling out the Full Self-Driving version 15 update, and we were lucky enough to get it in the first wave on Saturday night. It comes with a lot of new features, but the biggest is Tesla Reality View, a real-time AI video generation of the outside world that uses less compute than even the earliest versions of FSD driving visualization.

The release notes, which we covered on Saturday, revealed Reality View, Speed Camera Recognition and Slowdown, and a new Bike Rack Mode.

After spending plenty of time with the suite over the last 18 hours, I have a pretty good grasp of the new features and what you should expect from them when you get them on your Tesla. CEO Elon Musk said that it will wide release in December with the 2026 Holiday Update.

Advertisement
-

NOTE: If you’re looking for a review on FSD v15.0.1’s driving performance, I will have a small section breaking down what I noticed over the first drives I took, but I would rather hold off on making any real declarations about it until I have a few hundred miles under my belt. It just feels like I can’t make any real distinctions on anything other than a handful of things Tesla claims in its release notes.

Tesla Reality Vision

Let’s start what I know we are all here for: Tesla Reality Vision is here and it’s absolutely insane. Elon and Co. have also shed a lot of really cool tidbits about the development of it and some of its more intimate details. It’s pretty remarkable what they’re saying about it.

My first impression of Reality View was that it was incredibly detailed. It is honestly hard to believe, at first glance, that there is not a drone following your car. However, once you reach any sort of signage, it’s pretty obvious that it is not a puzzling of camera angles but exactly what Musk says it is:

Advertisement
-

My first rides with it revealed quite a few things.

  • It’s very impressive how realistic the texturing of the environment is. The grass, trees, buildings, and all of nature is really well rendered. You can see the shifting as you are moving; I’ve seen a lot of people compare it to the early versions of the Will Smith Spaghetti AI Videos, and that feels like a good comparison. It’s very, very good for a first attempt, and if it looks like this now, it isn’t unrealistic to say that it will look very close to realistic in the future. I would think within the next 8 months is probably somewhat realistic.
  • There is some input lag, and Musk has already addressed that by stating: “Currently, the latency is a bit high due to compute constraints, but we have ways to interleave newer UVE features along the diffusion transformer layers to cut roughly 35% of the latency.”
    • The lag is not something that is a dealbreaker or even that bad, but it is definitely noticeable. It’s still much better than many OEMs UI, which is as simplistic as menus and has tremendously more lag. It sounds like Musk already has a plan that should alleviate this, so that could come soon.

Advertisement
-

One of the coolest features of the Reality View is that it will orient itself based on whether you’re moving forward or backward. When backing out of a space, the drone view switches to the front of the car:

Another really nice touch is the quieter turn signal chimes, which start at a normal volume and then subtly get quieter until they are barely noticeable. It’s a very peaceful touch that Tesla added with the v15 update:

First Thoughts on Driving Performance

Overall, I have only noticed a handful of things. Driving performance feels very similar to recent FSD versions, but these are two things I caught:

  • When taking a left-hand turn from the middle of an intersection with a lot of room, the car didn’t just turn left, it actually turned right a little bit and then turned left. This is something you see a lot of very inexperienced drivers do; they’ll be in a Honda Civic and they act like they need to swing it wide to make a very straightforward turn. I have never seen FSD do this. This turn is one I take each day, as it is on my way to the gym. It was absolutely crazy and I was really thrown off by it. I hope this isn’t a new thing.
  • I didn’t get to see many potholes but I did see a lot of manhole covers, and FSD didn’t do anything to avoid them. In our YouTube video down below, you’ll notice it runs over many manhole covers. I was hoping it was try to avoid these, but I didn’t seem to get that impression.

In the coming days, I’ll do a longer review on the driving performance and whether or not v15.0.1 includes the things that Tesla explicitly mentioned in the Release Notes.

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 rollout begins: full release notes and improvements

Published

on

Tesla Reality View with FSD v15 (Credit: Tesla)

Tesla has announced that Full Self-Driving version 15 is now rolling out, after CEO Elon Musk said earlier today that the wide rollout would occur in December.

Now, Tesla is rolling out to Early Access Program (EAP) members v15’s first builds, and there are a lot of new improvements.

Tesla explicitly stated that safety improvements come in the form of “25x better handling of safety critical cases.” It is also rolling out “Tesla Reality View,” a new version of the Driver Visualization that appears to be much more realistic and could potential use Unreal Engine, according to the teaser video Tesla posted on social media. This “adds a live visualization of the drive that lets you see & control what FSD is planning to do.”

Advertisement
-

Perhaps the biggest improvements that Tesla mentioned, however, are that of Navigation fixes and better detection and aversion from potholes, debris, and animals, as well as “more natural speed handling in school zones and inclement weather.”

Tesla also added a new “Bike Rack Mode,” which will enable FSD’s use when bike racks or other hitch accessories are attached.

Tesla also revealed the full Release Notes for v15:

  • Upgraded vision encoder shared between FSD, Robotaxi, and Optimus, which is trained on millions of internet videos for improved generalization and data efficiency, improving the critical intervention rate by 25x.
  • Introduced Tesla Augmented Reality, replacing all of the explicit model signals into a single end-to-end visualization using less total compute.
  • Improved navigation by using an end-to-end learned model based on route preference data from the fleet.
  • Improved parking location selection by using personalized parking history, and the map will now display multiple parking options at your destination.
  • Improved driver monitoring by increasing vision-based attention monitoring availability with hats and sunglasses and decreasing strictness in higher speed driver profiles.
  • Improved detection of road signs, small animals, road debris, and chains.
  • Improved detection of potholes, road details, and avoidance of deep standing water.
  • Improved speed handling for each driver profile, school zones and speed limits, and inclement weather.
  • Improved Autoshift functionality by unifying with FSD-based gear predictions.
  • Tesla Reality View New: real-time generative driving visualization that continuously streams a view from an arbitrary virtual camera situated above your vehicle, enabling you to see and control what FSD is planning to do. Select between fullscreen visualizations, maps or a split view – or choose quiet mode for a calming cabin experience. Upcoming navigation turns display directly in the driving visualization. Turn signals are quieter and fade out after a few clicks.
  • Speed Camera Slowdown: FSD (Supervised) can now slow down when it detects a speed camera. Press the accelerator or increase your speed profile to cancel the slowdown. If you cancel twice at the same camera, your Tesla saves that location and will not slow down there again. To remove saved cameras, go to Controls > Service > Manage Saved Locations.
  • Bike Rack Mode With Bike Rack Mode, you can now engage FSD (Supervised) when a bike rack or similar hitch accessory is installed. When Bike Rack Mode is enabled, FSD (Supervised) pulls over near your destination and does not reverse. Autopark, Summon, and Backup chimes and warnings will be disabled.

It sounds like there are some really great improvements, and this is probably just a handful of what other improvements will come from these upgrades. For example, the UI changes will likely come with some other features that will be discovered upon the public having hands-on experience with it.

Musk said this morning that a wide release would occur sometime in December.

We’re looking forward to testing it when it arrives to us!

Advertisement
-

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 gets release date from Elon Musk

Published

on

Tesla Full Self-Driving v15 has received an official release date from CEO Elon Musk, who says the newest and most capable version of the suite will go wide in December with the 2026 Holiday Update.

That means the first iterations of the suite could actually come sooner, as the Early Access Program is the initial batch of owners to receive a new FSD release. Musk’s comments released a few tidbits of information, but nothing overwhelmingly revealing about its capabilities.

Musk was talking about supervised fine-tuning, stating that it is like “getting a haircut with a chainsaw,” before stating that FSD v15 will roll out wide for owners next month:

Musk’s Confirmed Changes and Fixes

Musk simply confirmed the new Full Self-Driving version would roll out with the 2026 Holiday Update, and the only two explicit changes he confirmed were updates to the User Interface (UI) and two small changes.

Musk’s comments on the UI confirm there are big changes coming to it, as he stated:

Advertisement
-

The UI changes will likely upgrade AMD Ryzen-equipped Tesla vehicles running AI4 to visualize vehicles using the Unreal Engine, something that was found in coding last year:

Tesla plans to use Unreal Engine for driver visualization with crazy upgrade

Advertisement
-

Additionally, one user stated that their biggest complaints with v14’s most recent releases is that they have to “stop refusing to use the HOV lane” and last-second lane changes to merge or turn happen too frequently. Musk said these should be fixed in v15.

In the past, we’ve also gotten small bits of detail about the v15 release, including from Tesla’s Head of AI, Ashok Elluswamy, who stated back in September that there are improved safety and collision avoidance systems coming with the v15 release.

Tesla plans big safety improvements for Full Self-Driving v15

Advertisement
-

The big prediction for v15 is whether this will enable at least some unsupervised driving in personal Teslas. There are likely to be some massive jumps in capability, although FSD has already proven itself to be a great way to travel. Nevertheless, there are a lot of things it could do better.

FSD still struggles with parking, it has routine bugs from update to update, it does not recognize potholes or large bumps on the road, speed control is a common complaint, and Navigation has been one of the biggest pain points.

However, v15 will likely bring massive improvements to capability and give people more options, like potentially parking orientation and more refined spot selection. We can only wait and see what Tesla will include.

Advertisement
-
Continue Reading