Walter Isaacson’s Elon Musk biography is set to be published on Tuesday, and a new preview of the book illustrates details about Tesla’s development of the upcoming Full Self-Driving (FSD) version 12.
In an additional preview of his Musk biography for CNBC, Isaacson discusses the use of AI in the development of Tesla’s FSD v12, in a shift that took place within the last several months. Isaacson talks about Tesla’s recent development of the upcoming FSD v12, which he and Tesla demonstrate has moved away from a “rules-based” approach.
Notably, FSD v12 is expected to use billions of video frames from real-world driving incidents to train its neural network rather than using thousands of lines of code like previous versions. In a conversation with Musk last December, Tesla Autopilot employee Dhaval Shroff had likened the concept to the popular chatbot ChatGPT, instead for use with driving.
“It’s like ChatGPT, but for cars,” Shroff said. “We process an enormous amount of data on how real human drivers acted in a complex driving situation, and then we train a computer’s neural network to mimic that.”
Surprisingly enough, Tesla only shifted toward this “neural network planner” approach recently. By the beginning of this year, however, the neural network had already analyzed 10 million video clips based on the best-case-scenario drivers the system had access to. Musk instructed employees at the company’s Buffalo, New York facility who were in charge of analyzing the footage to train the AI on things “a five-star Uber driver would do.”
Moving from a rules-based to a network-path-based AI approach allowed FSD to use human driving data to avoid obstacles, even if breaking some rules was necessary. Shroff helped demonstrate the idea to Musk with a demo featuring trash bins, debris, and upturned traffic cones, which the car handled surprisingly well.
“Here’s what happens when we move from rules-based to network-path-based,” Shroff explained. “The car will never get into a collision if you turn this thing on, even in unstructured environments.”
Musk quickly took to the idea, as can be seen in a recent livestream of Tesla’s FSD v12 software in Palo Alto with Autopilot software director Ashok Elluswamy. He has repeatedly spoken about the upcoming software version’s impressive driving results, despite one small moment in the drive where the car almost ran a red light.
In any case, Musk could argue that the red-light moment is a good case for the need for self-driving software to continually learn. Given that it will constantly be trained from the video data generated by camera footage from real-world drivers, it should theoretically make it safer over time, according to Musk.
During development, Musk also reportedly latched onto the fact that it took over a million video clips for the neural network to begin performing well, though he looks forward to what significantly more data will do for FSD.
Still, critics and regulators have expressed concerns about the faults of human drivers training AI-based driving systems, and Tesla has repeatedly been questioned by the National Highway Traffic Safety Administration (NHTSA) about its Autopilot and FSD beta systems.
According to Isaacson, Tesla plans to release FSD v12 as soon as regulators approve it. Meanwhile, an ongoing study by the National Highway Safety Board is looking to determine if self-driving cars should be permitted to imitate human driving actions that blur traffic rules, such as creeping up at stop signs.
Musk said in April that he expects Tesla to reach full autonomy within a year, though he has also been known to share ambitious targets for the software in the past.
You can read Walter Isaacson’s full account of the development of Tesla FSD v12 here, in a CNBC preview of the upcoming Elon Musk biography.
What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send your tips to us at tips@teslarati.com.
News
Tesla Model Y lineup expansion signals an uncomfortable reality for consumers
Tesla launched a new configuration of the Model Y this week, bringing more complexity to its lineup of the vehicle and adding a new, lower entry point for those who require an All-Wheel-Drive car.
However, the broadening of the Model Y lineup in the United States could signal a somewhat uncomfortable reality for Tesla fans and car buyers, who have been vocal about their desire for a larger, full-size SUV.
Tesla has essentially moved in the opposite direction through its closure of the Model X and its continuing expansion of a vehicle that fits the bill for many, but not all.
Tesla brings closure to Model Y moniker with launch of new trim level
While CEO Elon Musk has said that there is the potential for the Model Y L, a longer wheelbase configuration of the vehicle, to enter the U.S. market late this year, it is not a guarantee.
Instead, Tesla has prioritized the need to develop vehicles and trim levels that cater to the future rollout of the Robotaxi ride-hailing service and a fully autonomous future.
But the company could be missing out on a massive opportunity, as SUVs are a widely popular body style in the U.S., especially for families, as the tighter confines of compact SUVs do not support the needs of a large family.
Although there are other companies out there that manufacture this body style, many are interested in sticking with Tesla because of the excellent self-driving platform, expansive charging infrastructure, and software performance the vehicles offer.
Additionally, the lack of variety from an aesthetic and feature standpoint has caused a bit of monotony throughout the Model Y lineup. Although Premium options are available, those three configurations only differ in terms of range and performance, at least for the most part, and the differences are not substantial.
Minor Expansions of the Model Y Fail to Address Family Needs for Space
Offering similar trim levels with slight differences to cater to each consumer’s needs is important. However, these vehicles keep a constant: cargo space and seating capacity.
Larger families need something that would compete with vehicles like the Chevrolet Tahoe, Ford Expedition, or Cadillac Escalade, and while the Model X was its largest offering, that is going away.
Tesla could fix this issue partially with the rollout of the Model Y L in the U.S., but only if it plans to continue offering various Model Y vehicles and expanding on its offerings with that car specifically. There have been hints toward a Cyber-inspired SUV in the past, but those hints do not seem to be a drastic focus of the company, given its autonomy mission.
Model Y Expansion Doesn’t Boost Performance, Value, or Space
You can throw all the different badges, powertrains, and range ratings on the same vehicle, it does not mean it’s going to sell better. The Model Y was already the best-selling vehicle in the world on several occasions. Adding more configurations seems to be milking it.
The true need of people, especially now that the Model X is going away, is going to be space. What vehicle fits the bill of a growing family, or one that has already outgrown the Model Y?
Not Expanding the Lineup with a New Vehicle Could Be a Missed Opportunity
The U.S. is the world’s largest market for three-row SUVs, yet Tesla’s focus on tweaking the existing Model Y ignores this. This could potentially result in the Osborne Effect, as sales of current models without capturing new customers who need more seating and versatility.
Expansions of the current Model Y offerings risk adding production complexity without addressing core demands, and given that the Model Y L is already being produced in China, it seems like it would be a reasonable decision to build a similar line in Texas.
Listening to consumers means introducing either the Model Y L here, or bringing a new, modern design to the lineup in the form of a full-size SUV.
Elon Musk
Elon Musk reiterates Tesla Optimus’ most sci-fi potential yet
Musk shared his comments in a series of posts on social media platform X.
Elon Musk recently reiterated one of the most ambitious forecasts for Tesla’s humanoid robot, Optimus, stating it could become the first real-world example of a Von Neumann machine. He also noted once more that Optimus would be Tesla’s biggest product.
Musk shared his comments in a series of posts on social media platform X.
Optimus as a von Neumann machine
In response to a post on X that pondered on sci-fi timelines becoming real, Musk wrote that “Optimus will be the first Von Neumann machine, capable of building civilization by itself on any viable planet.” In a separate post, Musk wrote that Optimus will be Tesla’s “biggest product ever,” a phrase he has used in the past to describe the humanoid robot’s importance to the electric vehicle maker.
A Von Neumann machine is a class of theoretical self-replicating systems originally proposed in the mid-20th century by the mathematician John von Neumann. In his concept, von Neumann described machines that could travel to other worlds, use local materials to create copies of themselves, and carry out large-scale tasks without outside intervention.
Elon Musk’s broader plans
Considering Musk’s comments, it appears that Optimus would eventually be capable of performing complex work autonomously in environments beyond Earth. If Optimus could achieve such a feat, it could very well unlock humanity’s capability to explore locations beyond Earth. The idea of space exploration becomes more than feasible.
Elon Musk has discussed space-based AI compute, large-scale robotic production, and the role of SpaceX’s Starship in transporting hardware and materials to other planets. While Musk did not detail how Optimus would fit with SpaceX’s exploration activities, his Von Neumann machine comments suggest he is looking at Tesla’s robotics as part of a potential interplanetary ecosystem.
News
Tesla China January wholesale sales rise 9% year-on-year
Tesla reported January wholesale sales of 69,129 China-made vehicles, as per data released by the China Passenger Car Association.
Tesla China reported January wholesale sales of 69,129 Giga Shanghai-made vehicles, as per data released by the China Passenger Car Association (CPCA). The figure includes both domestic sales and exports from Gigafactory Shanghai.
The total represented a 9.32% increase from January last year but a 28.86% decline from December’s 97,171 units.
China EV market trends
The CPCA estimated that China’s passenger new energy vehicle wholesale volume reached about 900,000 units in January, up 1% year-on-year but down 42% from December. Demand has been pressured by the start-of-year slow season, a 5% additional purchase tax cost, and uncertainty around the transition of vehicle trade-in subsidies, as noted in a report from CNEV Post.
Market leader BYD sold 210,051 NEVs in January, down 30.11% year-on-year and 50.04% month-on-month, as per data released on February 1. Tesla China’s year-over-year growth then is quite interesting, as the company’s vehicles seem to be selling very well despite headwinds in the market.
Tesla China’s strategies
To counter weaker seasonal demand, Tesla China launched a low-interest financing program on January 6, offering up to seven-year terms on select produced vehicles. The move marked the first time an automaker offered financing of that length in the Chinese market.
Several rivals, including Xiaomi, Li Auto, XPeng, and NIO, later introduced similar incentives. Tesla China then further increased promotions on January 26 by reinstating insurance subsidies for the Model 3 sedan. The CPCA is expected to release Tesla’s China retail sales and export breakdown later this month.