News
Tesla 3D labeling is the next big leap for Autopilot
Tesla’s 3D labeling efforts are integral to the development of its Full Self-Driving suite. Using over 2.2 billion miles of real-world driving data from its electric vehicle fleet, the electric car maker has a treasure trove of information about how human drivers behave.
Elon Musk recently confirmed that Tesla is finishing work on Autopilot core foundation code and 3D labeling, and once these are done, users can expect the electric carmaker to roll out more functionalities in a potentially more efficient manner. More advanced features such as Reverse Summon will also be rolled out.
Tesla 3D Labeling: The Next Big Thing
The Tesla CEO has tagged 3D labeling as the next big thing for the company’s efforts to achieve full self-driving. “In terms of labeling, labeling with video in all eight cameras simultaneously. This is a really, I mean in terms of labeling efficiency, arguably like a three order of magnitude improvement in labeling efficiency where Tesla vehicles use all of its eight cameras simultaneously, and that the company has improved significantly in terms of labeling efficiency,” Musk said during the Q4 2019 earnings call.
During Autonomy Day last year, Tesla’s AI head Andrej Karpathy gave the electric vehicle community an idea of how labeling is done. He said annotating data is a very expensive process that initially involved people processing data, but Tesla has also been using information from its fleet to automate the process of labeling using different mechanisms.
For example, in predicting cut-ins, Tesla taps into its fleet for data on such incidents. This information is then automatically annotated and used to train the neural network, which in turn learns from recognizable patterns. This information is then spun until the neural network is trained enough. Improvements in the neural network can then be rolled out as an update for Autopilot.
The same is true according to Karpathy when it comes to object detection. Tesla sources data from its fleet to learn more about different objects and anomalies on the road. With automated 3D labeling, the neural network can more efficiently process the information and learn even about the rarest things one can encounter on the road.
Karpathy and Musk explained how annotations from its fleet help with path prediction. Using trajectories collected from the real-world, the neural network can improve its driving behavior, say while approaching a corner that it doesn’t actively see. This smarter neural network is perfectly demonstrated by an older Model X with early-gen Autopilot negotiating a muddy rural backroad recently, after a storm in the United Kingdom.
All of these things form part of the equation to achieve Full Self-Driving capabilities. Likely through 3D labeling improvements in the past year or so, Tesla has immensely improved driving visualizations in vehicles equipped with Hardware 3, which now identify traffic lights, garbage cans, and detailed road markings, among others. Thus, Elon Musk’s explanation about rewriting the Autopilot foundational code and 3D labeling could be a way of emphasizing that Tesla owners’ investment in the company’s Full Self-Driving suite would be proven worth it and more soon.
Tesla’s FSD computer and autonomy software will transform how humans travel. The company’s vehicles will be smart enough to drive like humans and eventually make the roads a few times safer for everyone. This may also pave the way for Robotaxis and help achieve Musk’s vision of Teslas earning for their owners while they are busy with work or even while relaxing at home. Tesla Robotaxis would be an attractive form of transportation as they will be more cost-efficient compared to driving personal cars, as predicted by ARK Invest.
Autonomy As Key To Profitability
Autonomy will spell profits for Tesla, as Elon Musk explained during the company’s Q4 2019 earnings call. In order to achieve sustained profitability, Tesla needs to produce high volume units with high margins. Musk appears to consider autonomy as key to Tesla’s high margins as well.
“As we’re close to Full Self-Driving, that is just going to become more and more compelling. So that’s for our financial standpoint, that’s the real mind-blowing situation is high-volume, high-margin because of autonomy,” Musk said.
With FSD capabilities, Tesla adds more value proposition that can help sway even more customers to purchase its electric vehicles from the Model 3, Model Y, Model S, Model X, or the Cybertruck. Depending on regulations in specific regions, Tesla can tap into most of its earnings potential, which bodes well since the company has current plans to expand its presence worldwide with Gigafactories in multiple regions.
Tesla’s path to autonomy is only one of the aspects that make it the leader in the electric vehicle industry. Add to that its advancements on car connectivity and battery technology and one will complete the equation why legacy carmakers with the deepest of pockets can only watch in amazement as a relatively young electric car maker dominates the emerging EV industry.
Elon Musk
NASA’s first human outpost on the Moon starts now – SpaceX on deck
NASA named the rovers, landers, and vendors that will build America’s first Moon Base.
NASA has laid out its most detailed Moon Base plan to date, describing a permanent outpost near the Moon’s south pole that the agency intends to build over the coming decade as a direct stepping stone to Mars. “The Moon Base will be America’s and humanity’s first outpost on another celestial world,” NASA Administrator Jared Isaacman said, adding that every mission crewed and uncrewed “will be a learning opportunity as we return to the lunar surface, build the infrastructure to stay, and master the skills required to live and operate in one of the most demanding and dangerous environments imaginable.”
The plan is structured in three phases involving both uncrewed and crewed missions to deliver equipment, vehicles, and infrastructure to the surface, with the first three moon base missions targeted to launch before the end of 2026.
Moon Base I, targeting fall 2026, will use Blue Origin’s Blue Moon Mark 1 lander to deliver scientific instruments to the Shackleton Connecting Ridge, the same region where Artemis astronauts will land. Moon Base II will send Astrobotic’s Griffin lander carrying more than 1,100 pounds of cargo including Astrolab’s FLIP rover to begin developing mobility systems on the surface. Moon Base III will carry the Lunar Vertex science mission on Intuitive Machines’ Nova-C Trinity lander to study lunar swirls near the south pole, with ESA and Korean science payloads aboard.
On the rover side, NASA awarded Astrolab $219 million and Lunar Outpost $220 million to build the first phase of Lunar Terrain Vehicles, with both rovers targeted for deployment to the lunar surface by 2028. Astrolab’s crewed rover weighs roughly 2,000 pounds and can reach over 6 mph. Lunar Outpost’s Pegasus rover can operate autonomously or via remote control at over 9 mph. Blue Origin separately received $188 million with an option worth $280.4 million to deliver cargo landers for rover transport.
NASA also confirmed that MoonFall, a mission deploying four survey drones to scout Artemis landing sites, has selected Firefly Aerospace to build the transport spacecraft, with a 2028 launch target.
SpaceX sits at the center of that commercial layer. SpaceX holds the NASA Human Landing System contract for the Starship-derived lander that will put astronauts on the surface under Artemis IV, currently targeting 2028. Before that can happen, SpaceX must demonstrate in-orbit propellant transfer at scale, a process requiring multiple Starship tanker launches to fuel a single mission. Water ice at the lunar south pole is central to the base’s long-term viability, as it can be converted into drinking water, breathable oxygen, and rocket fuel, directly reducing dependence on Earth resupply. That resource loop becomes far more practical if Starship can land and be refueled on or near the Moon itself.
Elon Musk has publicly stated that Starship V3, which recently completed its first flight, should be capable enough for initial Mars missions. The Moon Base plan announced Tuesday is the infrastructure layer that connects everything between those two ambitions, and SpaceX is the only American company currently contracted to build the rocket that gets humans to either destination.
A new Tesla patent that has been granted to the company this week has revealed a potential strategy for solving a major issue that could impact both the Full Self-Driving suite and Optimus.
The patent, which is No. 12,636,684, describes a “Lens Cleaning System,” and was submitted by Tesla in May 2025.
The language in the patent details a lens cleaning system that can dispense fluid and wipe it away with a wiper assembly.
Optimus can see you now… 🤖👁️
The patent for @Tesla_Optimus‘s eye structure just dropped. $TSLA pic.twitter.com/Jac4VhDmKH
— SETI Park (@seti_park) May 26, 2026
This would effectively clean any debris that would potentially impact the visibility of the cameras on Tesla automobiles or Optimus’s camera eyes. Perhaps the most pertinent example is through the Full Self-Driving suite, as debris that can accumulate on the vehicle’s exterior cameras can impact the suite’s ability to operate effectively.
This requires a remedy through manual cleaning, but this patent hints that Tesla could be planning to implement this new technology on its upcoming vehicles.
Interestingly, we have started to see it on some Robotaxi vehicles, and it will likely be included in the Cybercab, especially as that vehicle will enable full autonomy.
Back in January, the first Model Y Robotaxi units were spotted with camera washers on the side repeaters, as the video below shows fluid squirting and rinsing off any debris that is limiting visibility.
🚨 Tesla looks to have installed Camera Washers on the side repeater cameras on Robotaxis in Austin
pic.twitter.com/xemRtDtlRR— TESLARATI (@Teslarati) January 23, 2026
This hardware patent does bring up an interesting question for those of us who own Teslas with AI4 and have been told that our cars will one day be capable of full autonomy: Will this washer be available as a retrofit on already-built cars?
Perhaps the “Lens Cleaning System” patent is a good look at one way Tesla plans to combat one of the most obvious issues of autonomy that utilizes a camera-based system. For Optimus, it could be less needed as it could be manually cleaned by owners. For cars, it seems like a bigger necessity, especially as autonomy nears and Tesla gets close to launching a feature-complete FSD suite.
SpaceX’s Starlink product has just gotten its latest airline adoptee, and the move marks the successful partnership of three of the “Big Four” U.S. airlines.
American Airlines announced on Tuesday that it would utilize Starlink in more than 500 narrowbody aircraft beginning in the first quarter of 2027. These include the Airbus aircraft in its fleet, including the new A321XLR and A321neo.
With the new partnership with American Airlines, Starlink is now present on three of the largest airlines in the country: American, United, and Southwest.
Starlink gets its latest airline adoptee for stable and reliable internet access
Starlink’s VP of Enterprise Sales, Jason Fritch, said:
“We are proud to bring Starlink on board American Airlines, delivering fast and reliable internet to passengers and crew. Whether traveling for leisure or business, Starlink enables a fully connected experience gate to gate, making every flight smoother and more enjoyable.”
Additionally, American Airlines Chief Customer Officer, Heather Garboden, said:
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want. The addition of Starlink solidifies American as a leading airline in keeping passengers connected in flight.”
Starlink has been on a tear over the past year, as it has continued to be adopted by a wide variety of airlines as a more consistent and reliable way to provide WiFi to its passengers. It has already gained a great reputation among residential users, but its biggest commercial application appears to be how it is being used in the air.
American Airlines will adopt Starlink on more than 500 of its narrowbody aircraft beginning in Q1 2027
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want,” said American Airlines Chief… pic.twitter.com/XY2wflycc0
— TESLARATI (@Teslarati) May 26, 2026
The only airline of the Big Four not to adopt Starlink thus far is Delta, which chose to opt for the alternative, which is Amazon Leo. CEO Ed Bastian said to Bloomberg that Delta chose Amazon’s product over Starlink’s because “the opportunities, in terms of the improved bandwidth with a much lower price point than what we’ve ever seen from Starlink, will make a big difference.”
Delta will not start installing Amazon Leo until 2028.
“Of course, we expect Starlink will be warning people that we’re going to go with an inferior product,” Bastian said. “But I’m not too worried about partnering with Amazon.”
NASA’s first human outpost on the Moon starts now – SpaceX on deck
Tesla patent reveals strategy for solving major Full Self-Driving, Optimus issue
