News
Tesla 3D labeling is the next big leap for Autopilot
Tesla’s 3D labeling efforts are integral to the development of its Full Self-Driving suite. Using over 2.2 billion miles of real-world driving data from its electric vehicle fleet, the electric car maker has a treasure trove of information about how human drivers behave.
Elon Musk recently confirmed that Tesla is finishing work on Autopilot core foundation code and 3D labeling, and once these are done, users can expect the electric carmaker to roll out more functionalities in a potentially more efficient manner. More advanced features such as Reverse Summon will also be rolled out.
Tesla 3D Labeling: The Next Big Thing
The Tesla CEO has tagged 3D labeling as the next big thing for the company’s efforts to achieve full self-driving. “In terms of labeling, labeling with video in all eight cameras simultaneously. This is a really, I mean in terms of labeling efficiency, arguably like a three order of magnitude improvement in labeling efficiency where Tesla vehicles use all of its eight cameras simultaneously, and that the company has improved significantly in terms of labeling efficiency,” Musk said during the Q4 2019 earnings call.
During Autonomy Day last year, Tesla’s AI head Andrej Karpathy gave the electric vehicle community an idea of how labeling is done. He said annotating data is a very expensive process that initially involved people processing data, but Tesla has also been using information from its fleet to automate the process of labeling using different mechanisms.
For example, in predicting cut-ins, Tesla taps into its fleet for data on such incidents. This information is then automatically annotated and used to train the neural network, which in turn learns from recognizable patterns. This information is then spun until the neural network is trained enough. Improvements in the neural network can then be rolled out as an update for Autopilot.
The same is true according to Karpathy when it comes to object detection. Tesla sources data from its fleet to learn more about different objects and anomalies on the road. With automated 3D labeling, the neural network can more efficiently process the information and learn even about the rarest things one can encounter on the road.
Karpathy and Musk explained how annotations from its fleet help with path prediction. Using trajectories collected from the real-world, the neural network can improve its driving behavior, say while approaching a corner that it doesn’t actively see. This smarter neural network is perfectly demonstrated by an older Model X with early-gen Autopilot negotiating a muddy rural backroad recently, after a storm in the United Kingdom.
All of these things form part of the equation to achieve Full Self-Driving capabilities. Likely through 3D labeling improvements in the past year or so, Tesla has immensely improved driving visualizations in vehicles equipped with Hardware 3, which now identify traffic lights, garbage cans, and detailed road markings, among others. Thus, Elon Musk’s explanation about rewriting the Autopilot foundational code and 3D labeling could be a way of emphasizing that Tesla owners’ investment in the company’s Full Self-Driving suite would be proven worth it and more soon.
Tesla’s FSD computer and autonomy software will transform how humans travel. The company’s vehicles will be smart enough to drive like humans and eventually make the roads a few times safer for everyone. This may also pave the way for Robotaxis and help achieve Musk’s vision of Teslas earning for their owners while they are busy with work or even while relaxing at home. Tesla Robotaxis would be an attractive form of transportation as they will be more cost-efficient compared to driving personal cars, as predicted by ARK Invest.
Autonomy As Key To Profitability
Autonomy will spell profits for Tesla, as Elon Musk explained during the company’s Q4 2019 earnings call. In order to achieve sustained profitability, Tesla needs to produce high volume units with high margins. Musk appears to consider autonomy as key to Tesla’s high margins as well.
“As we’re close to Full Self-Driving, that is just going to become more and more compelling. So that’s for our financial standpoint, that’s the real mind-blowing situation is high-volume, high-margin because of autonomy,” Musk said.
With FSD capabilities, Tesla adds more value proposition that can help sway even more customers to purchase its electric vehicles from the Model 3, Model Y, Model S, Model X, or the Cybertruck. Depending on regulations in specific regions, Tesla can tap into most of its earnings potential, which bodes well since the company has current plans to expand its presence worldwide with Gigafactories in multiple regions.
Tesla’s path to autonomy is only one of the aspects that make it the leader in the electric vehicle industry. Add to that its advancements on car connectivity and battery technology and one will complete the equation why legacy carmakers with the deepest of pockets can only watch in amazement as a relatively young electric car maker dominates the emerging EV industry.
Elon Musk
The Starship moon landing number NASA and Elon Musk can’t agree on
Musk disputes NASA estimate of 22 Starship launches for Moon landing, predicting 6 to 8.
Elon Musk is disputing a new NASA safety panel estimate of how many Starship launches it will take to put astronauts on the Moon, saying the real number will be less than half the panel’s figure.
On Thursday, NASA’s Aerospace Safety Advisory Panel held its quarterly public meeting. Panel member Charlie Precourt, a former NASA astronaut, flagged the fueling process for SpaceX’s lunar lander as a major risk for Artemis IV, the mission planned to land a crew on the Moon in 2028. “We need to keep our eyes on numerous required fuelings for the lander,” Precourt said, according to Ars Technica. “I think the last estimate is around 22 flights.”
Ars Technica’s Eric Berger posted the comment on X, and Musk replied. “That’s way too high,” Musk wrote. “Actual number will be more like 6 to 8.”
The disagreement comes down to a basic problem with sending a ship as large as Starship to the Moon. Starship burns nearly all of its propellant just reaching Earth orbit, so it cannot continue on to the Moon without stopping for a refill. SpaceX’s answer is a gas station in space. First, a Starship that works as a storage tank, called a depot, is launched into orbit. Then a series of tanker Starships launch one at a time, dock with the depot and pump their leftover propellant into it. Once the depot is full, the lunar lander version of Starship launches, docks, fills up and heads for the Moon.
Every tanker trip is its own full rocket launch, which is why the count matters. More launches mean more time, more cost and more chances for something to go wrong before astronauts ever leave Earth. Berger estimated that even if SpaceX reaches twice weekly Starship launches by the end of 2027, filling a depot at the panel’s number would still take roughly three months.
How many tankers are needed depends mostly on how much propellant each one can carry to orbit and how much is lost along the way. Starship’s fuel and oxygen are stored at extremely cold temperatures, and some of it slowly boils off while waiting in orbit. More is lost in each transfer. NASA appears to be working from what Starship can lift today, while Musk’s range assumes a more capable rocket.
Musk has pushed back on higher counts before. In 2021, after a government document suggested 16 launches, he called that “extremely unlikely” and said eight tankers would be the most required.
Much of the answer depends on hardware SpaceX has not finished flying. As Teslarati noted earlier this year, the company plans to carry out the refueling process with its upgraded V3 Starship, and Precourt described Artemis IV as carrying “a large number of firsts.” He also praised NASA Administrator Jared Isaacman’s team for working to clear obstacles for both SpaceX and Blue Origin, whose Blue Moon lander does not rely on orbital refueling for its first mission.
Elon Musk
Tesla’s secretive “Project Crystal Sun” gets a big green light in Texas
Fort Bend County approved four incentive agreements Thursday for Tesla’s proposed $10.1 billion solar factory.
Fort Bend County commissioners on Thursday approved a package of tax incentives for Tesla’s proposed $10.1 billion solar cell factory near Needville, Texas, giving the company one of the last local approvals it needs before it decides where to build. All four Tesla agreements passed 4 to 0.
The votes covered a property tax abatement inside Reinvestment Zone No. 34, a Chapter 381 economic development agreement, a foreign trade zone non-objection paired with payments in lieu of certain taxes, and a separate payment in lieu of taxes “true up” agreement, according to agenda notes from the Fort Bend Commissioners Court meeting.
The project, known internally as “Project Crystal Sun,” would make solar cells and finished modules on roughly 3,000 acres near FM 762 and FM 1994, south of the Brazos River. As Teslarati reported when the filing first surfaced in August, Tesla’s application under the state’s JETI Act splits the investment into $1.5 billion in real property and $8.6 billion in equipment, with 9,712 permanent jobs projected by 2033 and commercial operations targeted for the first quarter of 2029. The plant would handle the full chain from ingot and wafer production through cell testing.
Inside Tesla’s secretive $10 Billion “Project Crystal Sun” filing
Thursday’s approval does not lock in the site. Tesla has told the Texas Comptroller it is still weighing other locations, and site selection adviser David Dennison told Lamar Consolidated ISD trustees in September that the race had narrowed to Fort Bend and one out of state rival with a “very compelling package,” according to the Houston Chronicle. Tesla hopes to decide before the end of 2026, and the incentives still need sign off from the Comptroller and the Governor’s office.
Local officials have now done nearly everything within their control. Commissioners created the reinvestment zone in an August 24 special meeting, with Interim County Judge Daniel Wong formally withdrawing himself over his engineering firm’s past work with Tesla. Lamar CISD trustees voted 7 to 0 on September 15 to advance a JETI agreement that would tax Tesla’s qualifying property at 50 percent of its value for maintenance and operations from 2029 through 2038.
The plant lines up with a target Elon Musk set on Tesla’s Q4 2025 earnings call in January, when he said the company would “work toward getting 100 GW a year of solar cell production, integrating across the entire supply chain from raw materials all the way to finished solar panels.” In March, Tesla was reported to be negotiating a $2.9 billion purchase of Chinese solar manufacturing equipment bound for Texas. The Houston area already hosts Tesla’s Megafactory in Brookshire, where Megapack 3 production has started. Tesla said on its Q3 call that Megapack supply for 2027 is nearly sold out, and Musk wrote on X Thursday that the company is “increasing production of Megapacks as much as possible,” as demand from data centers climbs.
Tesla revealed plans to develop its own maps internally to fix Navigation issues and give owners more control over their routing.
On the company’s Q3 2026 Earnings Call, a question was asked about FSD Navigation issues, particularly speed limit recognition, parking, and routing. These are issues that surface from version to version and seem to be seriously challenging for Tesla’s AI team to resolve.
Tesla’s Head of AI, Ashok Elluswamy, said in response to the question:
“You’re totally right that we shouldn’t be depending on external people’s maps. So we are building our own maps, but not like the same way as OneMoreMap. We are building an entirely new architecture with essentially AI-based mapping and navigation.”
He continued:
“It’s going to be super awesome. It’s going to be integrated with voice. You can talk to it, ask for different routes. It’s going to learn your personalized preferences, plus the fleet preferences. The collective intelligence of all the cars is going to flow into making the maps and navigation super cool.”
Elluswamy said this issue should be confronted, and the mapping should be available for people by the time the v15 release starts deploying to customers.
“And over the next several months,” he added, “it’s just going to take over all of the navigation functions, parking, destination handling. And it will know you better than you know yourself in some regard for the driving task, and then handle it fully.”
Tesla Summon got insanely good in FSD v14.3.2 — Navigation? Not so much
Navigation is perhaps the most notable complaint with FSD, and although it has gotten better, it is still flawed. Much of the time, FSD will take people on routes that are not preferred by the driver, but Tesla tried to combat this with a routing feature in the Summer 2026 Update.
Tesla currently relies on Google for map data, but it is sort of counterintuitive to believe the company would rely on a third party for this. These improvements will be welcome, as routing and navigation have been such a pain point for so many owners for so long.
Quotes via Motley Fool
The Starship moon landing number NASA and Elon Musk can’t agree on
Tesla’s secretive “Project Crystal Sun” gets a big green light in Texas
