News
Tesla 3D labeling is the next big leap for Autopilot
Tesla’s 3D labeling efforts are integral to the development of its Full Self-Driving suite. Using over 2.2 billion miles of real-world driving data from its electric vehicle fleet, the electric car maker has a treasure trove of information about how human drivers behave.
Elon Musk recently confirmed that Tesla is finishing work on Autopilot core foundation code and 3D labeling, and once these are done, users can expect the electric carmaker to roll out more functionalities in a potentially more efficient manner. More advanced features such as Reverse Summon will also be rolled out.
Tesla 3D Labeling: The Next Big Thing
The Tesla CEO has tagged 3D labeling as the next big thing for the company’s efforts to achieve full self-driving. “In terms of labeling, labeling with video in all eight cameras simultaneously. This is a really, I mean in terms of labeling efficiency, arguably like a three order of magnitude improvement in labeling efficiency where Tesla vehicles use all of its eight cameras simultaneously, and that the company has improved significantly in terms of labeling efficiency,” Musk said during the Q4 2019 earnings call.
During Autonomy Day last year, Tesla’s AI head Andrej Karpathy gave the electric vehicle community an idea of how labeling is done. He said annotating data is a very expensive process that initially involved people processing data, but Tesla has also been using information from its fleet to automate the process of labeling using different mechanisms.
For example, in predicting cut-ins, Tesla taps into its fleet for data on such incidents. This information is then automatically annotated and used to train the neural network, which in turn learns from recognizable patterns. This information is then spun until the neural network is trained enough. Improvements in the neural network can then be rolled out as an update for Autopilot.
The same is true according to Karpathy when it comes to object detection. Tesla sources data from its fleet to learn more about different objects and anomalies on the road. With automated 3D labeling, the neural network can more efficiently process the information and learn even about the rarest things one can encounter on the road.
Karpathy and Musk explained how annotations from its fleet help with path prediction. Using trajectories collected from the real-world, the neural network can improve its driving behavior, say while approaching a corner that it doesn’t actively see. This smarter neural network is perfectly demonstrated by an older Model X with early-gen Autopilot negotiating a muddy rural backroad recently, after a storm in the United Kingdom.
All of these things form part of the equation to achieve Full Self-Driving capabilities. Likely through 3D labeling improvements in the past year or so, Tesla has immensely improved driving visualizations in vehicles equipped with Hardware 3, which now identify traffic lights, garbage cans, and detailed road markings, among others. Thus, Elon Musk’s explanation about rewriting the Autopilot foundational code and 3D labeling could be a way of emphasizing that Tesla owners’ investment in the company’s Full Self-Driving suite would be proven worth it and more soon.
Tesla’s FSD computer and autonomy software will transform how humans travel. The company’s vehicles will be smart enough to drive like humans and eventually make the roads a few times safer for everyone. This may also pave the way for Robotaxis and help achieve Musk’s vision of Teslas earning for their owners while they are busy with work or even while relaxing at home. Tesla Robotaxis would be an attractive form of transportation as they will be more cost-efficient compared to driving personal cars, as predicted by ARK Invest.
Autonomy As Key To Profitability
Autonomy will spell profits for Tesla, as Elon Musk explained during the company’s Q4 2019 earnings call. In order to achieve sustained profitability, Tesla needs to produce high volume units with high margins. Musk appears to consider autonomy as key to Tesla’s high margins as well.
“As we’re close to Full Self-Driving, that is just going to become more and more compelling. So that’s for our financial standpoint, that’s the real mind-blowing situation is high-volume, high-margin because of autonomy,” Musk said.
With FSD capabilities, Tesla adds more value proposition that can help sway even more customers to purchase its electric vehicles from the Model 3, Model Y, Model S, Model X, or the Cybertruck. Depending on regulations in specific regions, Tesla can tap into most of its earnings potential, which bodes well since the company has current plans to expand its presence worldwide with Gigafactories in multiple regions.
Tesla’s path to autonomy is only one of the aspects that make it the leader in the electric vehicle industry. Add to that its advancements on car connectivity and battery technology and one will complete the equation why legacy carmakers with the deepest of pockets can only watch in amazement as a relatively young electric car maker dominates the emerging EV industry.
Investor's Corner
Elon Musk drops a Thanksgiving hint about Starship’s biggest test yet
Elon Musk says Starship Flight 15 will try to catch the ship itself, a first.
Elon Musk says SpaceX’s next Starship flight will try something nobody has done before, by catching the ship itself. Speaking to roughly 2,000 people at the X Takeover event at Giga Texas on Saturday, Musk said Flight 15 is about four to six weeks away and “probably launches a little bit before Thanksgiving, is my guess.”
That is a slip from earlier reporting, which had pointed to a launch as early as October 19. Musk explained why the date keeps moving. “We’re making a bunch of improvements to the rocket between every flight,” he said, adding that there are often hundreds, sometimes thousands, of small changes. This time the list is short, “but some of them take a fair bit of work and we’ve got to go inside the tank to make some of these changes.”
“We’re going to try to catch the ship, which is a super big deal,” Musk said. “If we do so, that’ll be the first time that there’s been full recovery of an orbital class rocket.” SpaceX has already caught the Super Heavy booster with the tower’s mechanical arms, and has talked about catching the ship since late 2025, but the upper stage has never been caught.
Musk also laid out what comes after. “The next big milestone would be to refly both the booster and the ship,” he said, describing a Flight 16 where “all parts of an orbital rocket are reflown.”
The reason SpaceX wants this comes down to cost and cadence. Every Starship ship so far has ended its flight in the ocean, and SpaceX expects most of those water landings to end in fireballs. A ship that returns to Starbase intact can be inspected and flown again. SpaceX’s IPO filing, says Starship V3 is designed to deliver 100 metric tons to orbit in a fully reusable configuration, that SpaceX aims to cut the cost to reach orbit by 99% or more versus the historical average, and that tower catches should allow “multiple launches per day.”
The payoff goes beyond cheaper launches. The next generation Starlink V3 satellites are too large for Falcon 9 and can only fly on Starship, which can carry up to 60 per flight. Flight 14 on September 28 deployed the first 26 of them after Starship reached orbit despite an early engine shutdown, as Teslarati reported. Musk blamed engine computer software, and said the heat shield “was extremely robust,” which he claimed in August had solved Starship’s biggest challenge.
NASA’s Moon plans depend on the same capability. NASA’s inspector general has described a lander mission that needs a propellant depot in low Earth orbit and more than 10 tanker flights, with SpaceX targeting one tanker launch every six days. That schedule only works if ships and boosters come back fast and fly again. Also, ship to ship propellant transfer has not been attempted yet.
One interesting hurdle yet to be explored is bringing the ship back to the launch site, with reentry over land, which will undoubtedly come with a lot of aviation safety reviews.
Lifestyle
Tesla’s mirrorless Cybercab will give riders a visibility upgrade
Tesla engineer confirms Cybercab update letting riders pull up rear and repeater cameras on demand.
Tesla is working on a Cybercab update that would let passengers pull up the vehicle’s rear and side cameras on demand, and the request came straight from a rider.
The exchange played out on X late Friday. Cybercab rider Dan Burkland shared photos of the two-seater’s cabin screen after an evening ride, praised the UI team’s work, and left one request: let riders open the rear and repeater cameras whenever they want, “especially for peace of mind.” Tesla UI software engineer Evan (@CarCoder) answered with two words: “In development.”
The Tesla UI team absolutely crushed it with the infotainment software. Nicely done @CarCoder!
One feature request: Allow folks to pull up the rear & repeater cameras on demand. This would be great especially for peace of mind. https://t.co/mNAOSLx6pE
— Dan Burkland (@DBurkland) October 10, 2026
The idea fits a pattern Teslarati has tracked since public rides began. Days after paid Cybercab service opened in Austin, Tesla sent riders a survey that asked them to rate the touchscreen, the app and the cabin, and to pick the features they wanted most. We reported on that survey in September, and a camera view is the kind of small software change Tesla can push quickly if riders keep asking.
It also speaks to something unique about the vehicle. With no steering wheel, no pedals and no driver, passengers have no mirror to check and no way to see behind them. The hardware is clearly built for camera awareness, from the repeater cameras to the rear camera. Letting a passenger look through those same cameras would give a nervous first time rider a way to confirm what is around the car.
The timing matters because the fleet is growing fast. Tesla’s Robotaxi account said on Saturday that more than 300 Cybercabs are now serving Austin, an eightfold increase in 30 days, and Tesla AI chief Ashok Elluswamy named Dallas as the next city. More cars and more cities mean more people riding in a driverless vehicle for the first time, which is exactly when small trust features carry weight.
For now, the feature is confirmed only as in development. If Tesla follows its usual pattern with Cybercab software, riders could see it appear in a point release without any announcement, and Teslarati will watch for it.
News
Tesla’s Cybercab fleet jumped 8x in a month, with Dallas up next
Tesla confirms its first official Cybercab fleet number as Austin scales fast and Dallas looms.
Tesla says more than 300 Cybercabs are now serving Austin, the first time the company has put an official number on its active Cybercab fleet. The figure came from the Robotaxi account on X on Saturday, which wrote that one month after launch the service had “scaled to 300+ Cybercabs serving Austin – an 8x increase in 30 days.”
Ashok Elluswamy, Tesla’s head of AI software, quoted the post with a line that carried the bigger news. “Two years since the 10/10 Cybercab WeRobot event, the cabs are everywhere in Austin now. Dallas soon,” he wrote. It is the first time Tesla has named the next city for public Cybercab rides.
One month after launch, we’ve scaled to 300+ Cybercabs serving Austin – an 8x increase in 30 days https://t.co/EagJy2JAsm
— Robotaxi (@robotaxi) October 10, 2026
Tesla opened Cybercab rides to the public in Austin on September 4, as Teslarati reported, a day after an invite only launch event. The ramp since then has been steep. Our September 28 report had the fleet at well over 100 units after availability jumped from 58 to 125 in a single week. On Thursday, Tesla added 150 Cybercabs to the Texas automated vehicle registry, lifting its registered count to 319 from 169. The first seven appeared on the registry on August 31.
RobotaxiTracker, a community site that counts vehicles from sightings and state records, listed 275 vehicles in unsupervised service in Austin on Saturday, 105 of them Cybercabs, which is well below Tesla’s figure. Tracker counts can lag official numbers, though Sawyer Merritt noted that Cybercab wait times in Austin stayed short on Saturday evening even with more than 2,000 fans in town for X Takeover.
Regulators are watching the rollout. NHTSA opened an audit query into Tesla’s certification that the Cybercab meets federal safety standards, and sworn answers are due October 30. Tesla reports third quarter earnings on October 21, which gives the company a natural venue to define its fleet numbers and put a date on Dallas.