News
Tesla 3D labeling is the next big leap for Autopilot
Tesla’s 3D labeling efforts are integral to the development of its Full Self-Driving suite. Using over 2.2 billion miles of real-world driving data from its electric vehicle fleet, the electric car maker has a treasure trove of information about how human drivers behave.
Elon Musk recently confirmed that Tesla is finishing work on Autopilot core foundation code and 3D labeling, and once these are done, users can expect the electric carmaker to roll out more functionalities in a potentially more efficient manner. More advanced features such as Reverse Summon will also be rolled out.
Tesla 3D Labeling: The Next Big Thing
The Tesla CEO has tagged 3D labeling as the next big thing for the company’s efforts to achieve full self-driving. “In terms of labeling, labeling with video in all eight cameras simultaneously. This is a really, I mean in terms of labeling efficiency, arguably like a three order of magnitude improvement in labeling efficiency where Tesla vehicles use all of its eight cameras simultaneously, and that the company has improved significantly in terms of labeling efficiency,” Musk said during the Q4 2019 earnings call.
During Autonomy Day last year, Tesla’s AI head Andrej Karpathy gave the electric vehicle community an idea of how labeling is done. He said annotating data is a very expensive process that initially involved people processing data, but Tesla has also been using information from its fleet to automate the process of labeling using different mechanisms.
For example, in predicting cut-ins, Tesla taps into its fleet for data on such incidents. This information is then automatically annotated and used to train the neural network, which in turn learns from recognizable patterns. This information is then spun until the neural network is trained enough. Improvements in the neural network can then be rolled out as an update for Autopilot.
The same is true according to Karpathy when it comes to object detection. Tesla sources data from its fleet to learn more about different objects and anomalies on the road. With automated 3D labeling, the neural network can more efficiently process the information and learn even about the rarest things one can encounter on the road.
Karpathy and Musk explained how annotations from its fleet help with path prediction. Using trajectories collected from the real-world, the neural network can improve its driving behavior, say while approaching a corner that it doesn’t actively see. This smarter neural network is perfectly demonstrated by an older Model X with early-gen Autopilot negotiating a muddy rural backroad recently, after a storm in the United Kingdom.
All of these things form part of the equation to achieve Full Self-Driving capabilities. Likely through 3D labeling improvements in the past year or so, Tesla has immensely improved driving visualizations in vehicles equipped with Hardware 3, which now identify traffic lights, garbage cans, and detailed road markings, among others. Thus, Elon Musk’s explanation about rewriting the Autopilot foundational code and 3D labeling could be a way of emphasizing that Tesla owners’ investment in the company’s Full Self-Driving suite would be proven worth it and more soon.
Tesla’s FSD computer and autonomy software will transform how humans travel. The company’s vehicles will be smart enough to drive like humans and eventually make the roads a few times safer for everyone. This may also pave the way for Robotaxis and help achieve Musk’s vision of Teslas earning for their owners while they are busy with work or even while relaxing at home. Tesla Robotaxis would be an attractive form of transportation as they will be more cost-efficient compared to driving personal cars, as predicted by ARK Invest.
Autonomy As Key To Profitability
Autonomy will spell profits for Tesla, as Elon Musk explained during the company’s Q4 2019 earnings call. In order to achieve sustained profitability, Tesla needs to produce high volume units with high margins. Musk appears to consider autonomy as key to Tesla’s high margins as well.
“As we’re close to Full Self-Driving, that is just going to become more and more compelling. So that’s for our financial standpoint, that’s the real mind-blowing situation is high-volume, high-margin because of autonomy,” Musk said.
With FSD capabilities, Tesla adds more value proposition that can help sway even more customers to purchase its electric vehicles from the Model 3, Model Y, Model S, Model X, or the Cybertruck. Depending on regulations in specific regions, Tesla can tap into most of its earnings potential, which bodes well since the company has current plans to expand its presence worldwide with Gigafactories in multiple regions.
Tesla’s path to autonomy is only one of the aspects that make it the leader in the electric vehicle industry. Add to that its advancements on car connectivity and battery technology and one will complete the equation why legacy carmakers with the deepest of pockets can only watch in amazement as a relatively young electric car maker dominates the emerging EV industry.
Tesla AI lead Ashok Elluswamy said this week that 24-hour Robotaxi service is close. Replying on X to a rider who wanted Cybercab trips all night, he wrote that the capability would arrive “next month or so” once “the next tech to merge on the v15 plan” is ready.
The comment landed on September 4, one day after Tesla opened public Cybercab rides in Austin. It is the clearest near-term timeline yet for overnight unsupervised operation. Tesla’s paid Robotaxi network currently runs from 6 a.m. to 10 p.m. seven days a week across Austin, Dallas, Houston, Miami, Orlando, and Tampa.
next month or so. the next tech to merge on the v15 plan will enable it.
— Ashok Elluswamy (@aelluswamy) September 4, 2026
That 16-hour window is shorter than the 6 a.m. to 2 a.m. schedule the company used for much of the prior year.
Elluswamy did not name the specific feature or say whether the change would apply first to purpose-built Cybercabs, the existing Model Y fleet, or both. He also offered no city-by-city rollout list. The link to Full Self-Driving v15 is nevertheless significant.
Tesla has described v15 as a step-change architecture with seven parallel improvement tracks and roughly ten times more parameters than earlier builds. Early versions of that software already operate on the Robotaxi fleet and contain about 40 percent of the planned gains.
By July 2026, the unsupervised fleet had logged more than 380,000 miles across six cities in two states with what the company called an impeccable safety record and no notable incidents caused by the vehicles themselves. Tesla has repeatedly argued that camera-based end-to-end neural networks, rather than extra sensors, are the core of the solution.
Overnight service would test that claim in lower-light conditions and would also raise vehicle utilization, a key variable for Robotaxi unit economics. The company has already begun using public Superchargers at night and is building dedicated Robotaxi charging sites.
Riders have asked why software must change if the cars already drive in the dark. The practical answer appears to be reliability and scale: Tesla has held back mass expansion until more of the v15 stack is merged, citing the need for higher confidence before putting thousands of unoccupied vehicles on streets around the clock.
If the next module arrives on the timetable Elluswamy sketched, 24-hour service could begin in October 2026 in at least some markets.
That would mark a shift from a daytime-bounded pilot to a service that can run whenever demand exists, including the late-night hours that have so far remained out of reach.
Tesla is beginning to roll out Full Self-Driving Supervised v14.3.9 with a new active safety layer that can take control even when the driver is operating the car manually.
Tesla AI said the software can activate FSD on the driver’s behalf when an imminent collision is detected and Automatic Emergency Braking may not be enough. It may also engage if the system detects heavy distraction or an accidental FSD disengagement.
FSD Supervised v14.3.9 starting to roll out shortly
This release includes a new active safety feature set: FSD Supervised can now activate on your behalf when an imminent collision is detected and Automatic Emergency Braking (AEB) may not be enough.
It may also engage if we…
— Tesla AI (@Tesla_AI) September 4, 2026
The capability is essentially Automatic Collision Evasion. However, unlike conventional AEB, which mainly applies the brakes in a straight line, this feature can use steering, braking, and acceleration together if the car calculates that stopping alone will not prevent impact and a safer path exists. The system may change lanes or move toward a shoulder when conditions allow, then continue driving after the immediate threat is handled rather than simply coming to a stop.
The intervention is meant as a last-resort safety net, not a replacement for attentive driving.
Tesla Full Self-Driving v14.3.7 early review: FSD saved me from an accident
Tesla’s own description still frames FSD as supervised assistance. Secondary reports on internal release notes say the feature can fire while the car is being driven manually if cabin-camera monitoring suggests the driver is not sufficiently attentive, such as reaching toward the back seat, or if FSD appears to have been turned off unintentionally.
After the emergency maneuver, the car is expected to alert the driver and request a return to manual control.
The safety case is straightforward. Many collisions happen in the last second because a driver is looking away, fumbles a control, or faces an obstacle that braking cannot fully solve. A system that can both recognize that AEB is insufficient and execute a coordinated evasive path can reduce those remaining high-severity events.
Re-engaging after accidental disengagement also addresses a practical failure mode: a small steering nudge that drops FSD at the worst moment. The advantage is a background safety net that uses the same vision stack already running in v14, instead of leaving the car solely to emergency braking once the driver is no longer in command.
The feature still depends on FSD being enabled and, according to reports, an active FSD purchase or subscription. It does not make the vehicle unsupervised. Drivers remain responsible, and Tesla has not published how often the system is expected to intervene or how it will handle false positives.
If the rollout is conservative and the false-alarm rate stays low, the update is a meaningful step: FSD is no longer only a feature the driver turns on. In the rare moments when disaster is already forming, it can step in.
Tesla launched the all-electric, steering wheel-less, and pedal-less Cybercab last night at a quiet and small event in downtown Austin, Texas.
The launch, which marked the beginning of unsupervised ride-hailing for Tesla’s Robotaxi platform with Cybercab, has already caught the attention of the National Highway Traffic Safety Administration (NHTSA) who has more questions.
NHTSA opened an Audit Query (AQ) into the Cybercab’s Federal Motor Vehicle Safety Standards (FMVSS) certification that Tesla gave the vehicle. Manufacturers self-certify vehicles much of the time to avoid excessive regulatory delays.
Tesla Cybercab interior, note the lack of steering wheel and pedals. (Credit: @niccruzpatane/X< /a>)
However, the agency needs more information; it said in a summary:
“On September 3, 2026, Tesla began commercial deployment with a small number of its Cybercab vehicles in Austin, Texas. Tesla notified the Agency that it certified those Cybercab vehicles as compliant with all applicable Federal Motor Vehicle Safety Standards (FMVSS). Tesla also notified the Agency that it plans to gradually expand commercial deployment of the Cybercab to include additional vehicles and locations.”
It also went on to state that the Cybercab lacks traditional automotive controls, which is a groundbreaking move. The process is entirely new to the NHTSA, which gives the agency some leverage to put Tesla’s launch under a microscope:
“The vehicles lack permanently attached, conventional manual controls, such as a brake pedal, gas pedal, steering wheel, and mirrors. NHTSA is opening this AQ to examine the process and technical data on which Tesla relied when certifying the Cybercab and related issues. Among other things, NHTSA will consider the extent to which Tesla’s certification depended on determinations that certain FMVSS are inapplicable to the Cybercab.”
Tesla has added 45 Cybercab units to its fleet of Robotaxi-enabled cars in Austin, according to public documents the company submitted to the State of Texas over the past week. Enabling this level of self-driving is something Tesla has worked toward for many years, and now that it is finally here, it seems more than reasonable that regulatory agencies will have some questions.
Many outlets might try to frame this as a negative, but it is truly an agency looking to gain more information about groundbreaking tech that Tesla has been developing for years.
In an effort to keep riders, pedestrians, and property safe, any and all data accumulated from these first days, weeks, and months of rides will likely be shared with the NHTSA to enable broader rollout strategies across the United States and more in the future.
Tesla Robotaxi will be a 24/7 service: here’s when
Tesla Full Self-Driving will now overtake manual driving to avoid disaster
