Connect with us

News

Tesla 3D labeling is the next big leap for Autopilot

Tesla Autopilot (Source: Elon Musk | Twitter)

Published

on

Tesla’s 3D labeling efforts are integral to the development of its Full Self-Driving suite. Using over 2.2 billion miles of real-world driving data from its electric vehicle fleet, the electric car maker has a treasure trove of information about how human drivers behave.

Elon Musk recently confirmed that Tesla is finishing work on Autopilot core foundation code and 3D labeling, and once these are done, users can expect the electric carmaker to roll out more functionalities in a potentially more efficient manner. More advanced features such as Reverse Summon will also be rolled out.

Tesla 3D Labeling: The Next Big Thing

The Tesla CEO has tagged 3D labeling as the next big thing for the company’s efforts to achieve full self-driving. “In terms of labeling, labeling with video in all eight cameras simultaneously. This is a really, I mean in terms of labeling efficiency, arguably like a three order of magnitude improvement in labeling efficiency where Tesla vehicles use all of its eight cameras simultaneously, and that the company has improved significantly in terms of labeling efficiency,” Musk said during the Q4 2019 earnings call.

During Autonomy Day last year, Tesla’s AI head Andrej Karpathy gave the electric vehicle community an idea of how labeling is done. He said annotating data is a very expensive process that initially involved people processing data, but Tesla has also been using information from its fleet to automate the process of labeling using different mechanisms.

For example, in predicting cut-ins, Tesla taps into its fleet for data on such incidents. This information is then automatically annotated and used to train the neural network, which in turn learns from recognizable patterns. This information is then spun until the neural network is trained enough. Improvements in the neural network can then be rolled out as an update for Autopilot.

Advertisement
-->

The same is true according to Karpathy when it comes to object detection. Tesla sources data from its fleet to learn more about different objects and anomalies on the road. With automated 3D labeling, the neural network can more efficiently process the information and learn even about the rarest things one can encounter on the road.

Karpathy and Musk explained how annotations from its fleet help with path prediction. Using trajectories collected from the real-world, the neural network can improve its driving behavior, say while approaching a corner that it doesn’t actively see. This smarter neural network is perfectly demonstrated by an older Model X with early-gen Autopilot negotiating a muddy rural backroad recently, after a storm in the United Kingdom.

All of these things form part of the equation to achieve Full Self-Driving capabilities. Likely through 3D labeling improvements in the past year or so, Tesla has immensely improved driving visualizations in vehicles equipped with Hardware 3, which now identify traffic lights, garbage cans, and detailed road markings, among others. Thus, Elon Musk’s explanation about rewriting the Autopilot foundational code and 3D labeling could be a way of emphasizing that Tesla owners’ investment in the company’s Full Self-Driving suite would be proven worth it and more soon.

Tesla’s FSD computer and autonomy software will transform how humans travel. The company’s vehicles will be smart enough to drive like humans and eventually make the roads a few times safer for everyone. This may also pave the way for Robotaxis and help achieve Musk’s vision of Teslas earning for their owners while they are busy with work or even while relaxing at home. Tesla Robotaxis would be an attractive form of transportation as they will be more cost-efficient compared to driving personal cars, as predicted by ARK Invest.

Autonomy As Key To Profitability

Autonomy will spell profits for Tesla, as Elon Musk explained during the company’s Q4 2019 earnings call. In order to achieve sustained profitability, Tesla needs to produce high volume units with high margins. Musk appears to consider autonomy as key to Tesla’s high margins as well.

Advertisement
-->

“As we’re close to Full Self-Driving, that is just going to become more and more compelling. So that’s for our financial standpoint, that’s the real mind-blowing situation is high-volume, high-margin because of autonomy,” Musk said.

With FSD capabilities, Tesla adds more value proposition that can help sway even more customers to purchase its electric vehicles from the Model 3, Model Y, Model S, Model X, or the Cybertruck. Depending on regulations in specific regions, Tesla can tap into most of its earnings potential, which bodes well since the company has current plans to expand its presence worldwide with Gigafactories in multiple regions.

Tesla’s path to autonomy is only one of the aspects that make it the leader in the electric vehicle industry. Add to that its advancements on car connectivity and battery technology and one will complete the equation why legacy carmakers with the deepest of pockets can only watch in amazement as a relatively young electric car maker dominates the emerging EV industry.

A curious soul who keeps wondering how Elon Musk, Tesla, electric cars, and clean energy technologies will shape the future, or do we really need to escape to Mars.

Advertisement
Comments

Elon Musk

Elon Musk and Tesla AI Director share insights after empty driver seat Robotaxi rides

The executives’ unoccupied tests hint at the rapid progress of Tesla’s unsupervised Robotaxi efforts.

Published

on

Ashok Elluswamy

Tesla CEO Elon Musk and AI Director Ashok Elluswamy celebrated Christmas Eve by sharing personal experiences with Robotaxi vehicles that had no safety monitor or occupant in the driver’s seat. Musk described the system’s “perfect driving” around Austin, while Elluswamy posted video from the back seat, calling it “an amazing experience.”

The executives’ unoccupied tests hint at the rapid progress of Tesla’s unsupervised Robotaxi efforts.

Elon and Ashok’s firsthand Robotaxi insights

Prior to Musk and the Tesla AI Director’s posts, sightings of unmanned Teslas navigating public roads were widely shared on social media. One such vehicle was spotted in Austin, Texas, which Elon Musk acknowleged by stating that “Testing is underway with no occupants in the car.” 

Based on his Christmas Eve post, Musk seemed to have tested an unmanned Tesla himself. “A Tesla with no safety monitor in the car and me sitting in the passenger seat took me all around Austin on Sunday with perfect driving,” Musk wrote in his post.

Elluswamy responded with a 2-minute video showing himself in the rear of an unmanned Tesla. The video featured the vehicle’s empty front seats, as well as its smooth handling through real-world traffic. He captioned his video with the words, “It’s an amazing experience!”

Advertisement
-->

Towards Unsupervised operations

During an xAI Hackathon earlier this month, Elon Musk mentioned that Tesla owed be removing Safety Monitors from its Robotaxis in Austin in just three weeks. “Unsupervised is pretty much solved at this point. So there will be Tesla Robotaxis operating in Austin with no one in them. Not even anyone in the passenger seat in about three weeks,” he said. Musk echoed similar estimates at the 2025 Annual Shareholder Meeting and the Q3 2025 earnings call.

Considering the insights that were posted Musk and Elluswamy, it does appear that Tesla is working hard towards operating its Robotaxis with no safety monitors. This is quite impressive considering that the service was launched just earlier this year.

Continue Reading

Elon Musk

Starlink passes 9 million active customers just weeks after hitting 8 million

The milestone highlights the accelerating growth of Starlink, which has now been adding over 20,000 new users per day.

Published

on

Credit: Starlink/X

SpaceX’s Starlink satellite internet service has continued its rapid global expansion, surpassing 9 million active customers just weeks after crossing the 8 million mark. 

The milestone highlights the accelerating growth of Starlink, which has now been adding over 20,000 new users per day.

9 million customers

In a post on X, SpaceX stated that Starlink now serves over 9 million active users across 155 countries, territories, and markets. The company reached 8 million customers in early November, meaning it added roughly 1 million subscribers in under seven weeks, or about 21,275 new users on average per day. 

“Starlink is connecting more than 9M active customers with high-speed internet across 155 countries, territories, and many other markets,” Starlink wrote in a post on its official X account. SpaceX President Gwynne Shotwell also celebrated the milestone on X. “A huge thank you to all of our customers and congrats to the Starlink team for such an incredible product,” she wrote. 

That growth rate reflects both rising demand for broadband in underserved regions and Starlink’s expanding satellite constellation, which now includes more than 9,000 low-Earth-orbit satellites designed to deliver high-speed, low-latency internet worldwide.

Advertisement
-->

Starlink’s momentum

Starlink’s momentum has been building up. SpaceX reported 4.6 million Starlink customers in December 2024, followed by 7 million by August 2025, and 8 million customers in November. Independent data also suggests Starlink usage is rising sharply, with Cloudflare reporting that global web traffic from Starlink users more than doubled in 2025, as noted in an Insider report.

Starlink’s momentum is increasingly tied to SpaceX’s broader financial outlook. Elon Musk has said the satellite network is “by far” the company’s largest revenue driver, and reports suggest SpaceX may be positioning itself for an initial public offering as soon as next year, with valuations estimated as high as $1.5 trillion. Musk has also suggested in the past that Starlink could have its own IPO in the future. 

Continue Reading

News

NVIDIA Director of Robotics: Tesla FSD v14 is the first AI to pass the “Physical Turing Test”

After testing FSD v14, Fan stated that his experience with FSD felt magical at first, but it soon started to feel like a routine.

Published

on

Credit: Grok Imagine

NVIDIA Director of Robotics Jim Fan has praised Tesla’s Full Self-Driving (Supervised) v14 as the first AI to pass what he described as a “Physical Turing Test.”

After testing FSD v14, Fan stated that his experience with FSD felt magical at first, but it soon started to feel like a routine. And just like smartphones today, removing it now would “actively hurt.”

Jim Fan’s hands-on FSD v14 impressions

Fan, a leading researcher in embodied AI who is currently solving Physical AI at NVIDIA and spearheading the company’s Project GR00T initiative, noted that he actually was late to the Tesla game. He was, however, one of the first to try out FSD v14

“I was very late to own a Tesla but among the earliest to try out FSD v14. It’s perhaps the first time I experience an AI that passes the Physical Turing Test: after a long day at work, you press a button, lay back, and couldn’t tell if a neural net or a human drove you home,” Fan wrote in a post on X. 

Fan added: “Despite knowing exactly how robot learning works, I still find it magical watching the steering wheel turn by itself. First it feels surreal, next it becomes routine. Then, like the smartphone, taking it away actively hurts. This is how humanity gets rewired and glued to god-like technologies.”

Advertisement
-->

The Physical Turing Test

The original Turing Test was conceived by Alan Turing in 1950, and it was aimed at determining if a machine could exhibit behavior that is equivalent to or indistinguishable from a human. By focusing on text-based conversations, the original Turing Test set a high bar for natural language processing and machine learning. 

This test has been passed by today’s large language models. However, the capability to converse in a humanlike manner is a completely different challenge from performing real-world problem-solving or physical interactions. Thus, Fan introduced the Physical Turing Test, which challenges AI systems to demonstrate intelligence through physical actions.

Based on Fan’s comments, Tesla has demonstrated these intelligent physical actions with FSD v14. Elon Musk agreed with the NVIDIA executive, stating in a post on X that with FSD v14, “you can sense the sentience maturing.” Musk also praised Tesla AI, calling it the best “real-world AI” today.

Continue Reading