Connect with us

News

Tesla FSD v12 shifts away from ‘rules-based’ approach

Credit: @sabber_dev/Twitter

Published

on

Walter Isaacson’s Elon Musk biography is set to be published on Tuesday, and a new preview of the book illustrates details about Tesla’s development of the upcoming Full Self-Driving (FSD) version 12.

In an additional preview of his Musk biography for CNBC, Isaacson discusses the use of AI in the development of Tesla’s FSD v12, in a shift that took place within the last several months. Isaacson talks about Tesla’s recent development of the upcoming FSD v12, which he and Tesla demonstrate has moved away from a “rules-based” approach.

Notably, FSD v12 is expected to use billions of video frames from real-world driving incidents to train its neural network rather than using thousands of lines of code like previous versions. In a conversation with Musk last December, Tesla Autopilot employee Dhaval Shroff had likened the concept to the popular chatbot ChatGPT, instead for use with driving.

“It’s like ChatGPT, but for cars,” Shroff said. “We process an enormous amount of data on how real human drivers acted in a complex driving situation, and then we train a computer’s neural network to mimic that.”

Advertisement

Surprisingly enough, Tesla only shifted toward this “neural network planner” approach recently. By the beginning of this year, however, the neural network had already analyzed 10 million video clips based on the best-case-scenario drivers the system had access to. Musk instructed employees at the company’s Buffalo, New York facility who were in charge of analyzing the footage to train the AI on things “a five-star Uber driver would do.”

Moving from a rules-based to a network-path-based AI approach allowed FSD to use human driving data to avoid obstacles, even if breaking some rules was necessary. Shroff helped demonstrate the idea to Musk with a demo featuring trash bins, debris, and upturned traffic cones, which the car handled surprisingly well.

“Here’s what happens when we move from rules-based to network-path-based,” Shroff explained. “The car will never get into a collision if you turn this thing on, even in unstructured environments.”

Tesla FSD’s “autosteer on city streets” now available

Advertisement

Musk quickly took to the idea, as can be seen in a recent livestream of Tesla’s FSD v12 software in Palo Alto with Autopilot software director Ashok Elluswamy. He has repeatedly spoken about the upcoming software version’s impressive driving results, despite one small moment in the drive where the car almost ran a red light.

In any case, Musk could argue that the red-light moment is a good case for the need for self-driving software to continually learn. Given that it will constantly be trained from the video data generated by camera footage from real-world drivers, it should theoretically make it safer over time, according to Musk.

During development, Musk also reportedly latched onto the fact that it took over a million video clips for the neural network to begin performing well, though he looks forward to what significantly more data will do for FSD.

Still, critics and regulators have expressed concerns about the faults of human drivers training AI-based driving systems, and Tesla has repeatedly been questioned by the National Highway Traffic Safety Administration (NHTSA) about its Autopilot and FSD beta systems.

Advertisement

According to Isaacson, Tesla plans to release FSD v12 as soon as regulators approve it. Meanwhile, an ongoing study by the National Highway Safety Board is looking to determine if self-driving cars should be permitted to imitate human driving actions that blur traffic rules, such as creeping up at stop signs.

Musk said in April that he expects Tesla to reach full autonomy within a year, though he has also been known to share ambitious targets for the software in the past.

You can read Walter Isaacson’s full account of the development of Tesla FSD v12 here, in a CNBC preview of the upcoming Elon Musk biography.

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send your tips to us at tips@teslarati.com.

Advertisement

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Advertisement
Comments

Elon Musk

Tesla Phone? Not quite, but close: analyst

Published

on

elon musk phone
Photo: Boss Hunting.com.au

For years, there have been images and videos across social media platforms that have reminded me of when I was a 15-year-old kid teased by “Xbox 720” videos on YouTube. These videos are of the supposed “Tesla Phone” that Elon Musk was secretly developing in between leading Tesla with its electric cars and SpaceX with its reusable rockets.

Although Musk has put those rumors to bed several times, it was never completely out of the realm that he could get involved in cell phones in some capacity. Think outside the box and more macro-level, though. Instead of reinventing the computer, Musk reinvented connectivity by developing Starlink with SpaceX.

Advertisement

It could be something similar, TD Cowen analyst Gregory Williams said in a note last week, where he hinted SpaceX could be gathering some steam to acquire T-Mobile.

Williams said it would be the “clear choice” for SpaceX if it decided to go through with a network acquisition. He also suggested AT&T.

The move would be possible through selling more of its own stock, which would help SpaceX raise the money to purchase T-Mobile, which would cost roughly $300 billion. It could be one of the moves SpaceX makes post-IPO in terms of an acquisition: it already acquired Cursor AI for $60 billion.

Other analysts, like Dan Ives of Wedbush, believe SpaceX and Tesla will eventually merge into one anyway, and that conglomeration could come as soon as this year, some have said.

Advertisement

The implications of SpaceX purchasing T-Mobile are massive. A combined entity would create a truly ubiquitous network: T-Mobile’s terrestrial 5G towers and Starlink’s growing constellation of Direct-to-Cell satellites. This would essentially eliminate dead zones across the U.S. and potentially globally.

SpaceX would instantly become a full-scale facilities-based carrier with satellite differentiation; a huge advantage. This would pressure AT&T and Verizon heavily.

There are also concerns like a potential reduction in long-term competition, and of course, a deal of that size would face intense scrutiny from government agencies.

The strategic fit is compelling due to the existing Starlink–T-Mobile partnership and complementary technologies (space + terrestrial). It could create a dominant integrated communications player. However, the regulatory, financial, and execution hurdles are enormous — this remains highly speculative with no indication SpaceX is actively pursuing it right now.

Advertisement
Continue Reading

News

Tesla reveals huge Cybercab detail in new guide for First Responders

Published

on

Credit: Tesla

Tesla revealed a major new Cybercab detail in a guide it released for First Responders, showing new territory in its beliefs and intentions for the ride-hailing-focused vehicle that entered production in April.

The First Responders Guide is released to give fire departments, paramedics, and other emergency personnel the proper guidance on what to do in the event of an accident, entrapment, or other situation that would require immediate attention.

On one of the pages of the First Responders Guide, Tesla revealed a stark detail about the Cybercab, which could help personnel enter the vehicle more easily in case of an emergency.

Tesla Cybercab has one important piece that AI4 cars might need for FSD

Advertisement

It shows Tesla has no intention of releasing any Cybercab units that were initially proposed for ride-hailing services for the general public with any manual controls, meaning a steering wheel or pedals:

“A Cybercab equipped with steering wheel, brake pedal, and an acceleration pedal is typically an engineering or test vehicle, and operates at SAE Level 2 autonomy. Cybercab is not typically equipped with a steering wheel or acceleration and brake pedals.”

This is a major development for those who continue to believe Tesla planned to release the Cybercab with any sort of manual controls so that passengers could take over if needed. However, when Tesla started manufacturing production versions of the Cybercab in Giga Texas earlier this year, they were spotted without a steering wheel or pedals.

It essentially confirms the company has no intentions of bringing manual controls to the car’s production versions. Some have argued that the likelihood of Tesla having something

There still are some Cybercab units out there with a steering wheel and pedals, and as Tesla said, these cars are engineering or test vehicles, which have Safety Monitors on board to help the car out of a precarious situation or emergency.

Advertisement
Continue Reading

News

Tesla Full Self-Driving v14 ‘Lite’ Release Notes: new capabilities and features

Published

on

(Credit: Megan Gale/Twitter)

Tesla released the Full Self-Driving v14 ‘Lite’ suite to owners of Hardware 3 or AI3 vehicles today, adding several new features to the vehicles that were once believed to be capable of unsupervised self-driving.

Now, Tesla has released this modified suite to older Tesla vehicles, adding plenty of new features and capabilities.

Here are the full release notes for the suite:

  • Distilled the intelligence from HW4 V14 into HW3. This allows HW3 to directly learn how to handle scenarios using HW4 V14 as a guide. This process unlocks the improvements that have been made to HW4 including Reinforcement Learning (RL) and offline models for HW3.
  • Improved both proactive and reactive responsiveness across a wide variety of categories including navigation handling, merges and forks, pedestrian interactions, traffic lights, and vehicle cut-in scenarios.
  • Improved general comfort in nominal scenarios through fewer false slowdowns, smoother steering and more consistent lane centering.
  • Introduced parking, unparking, and reversing capabilities.
  • Added Arrival Options for you to select where FSD should park: in a Parking Lot, on the Street, in a Driveway, or at the Curbside.
  • Speed Profiles are now available at all times, to further customize driving style preference.

These improvements, according to Tesla’s Head of AI, Ashok Elluswamy, help distill the driving behavior from AI4’s v14 series into both the camera and compute configurations of AI3.

Tesla Full Self-Driving v14 ‘Lite’ for older cars finally gets released

Advertisement

He added:

“It includes destination options and speed profiles on city roads, but more importantly significantly improved safety. We hope you’ll enjoy it, once the build ships wide.”

Tesla will continue to roll out the v14 Lite suite more widely in the coming weeks, the company said.

Continue Reading