News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
A new Tesla patent that has been granted to the company this week has revealed a potential strategy for solving a major issue that could impact both the Full Self-Driving suite and Optimus.
The patent, which is No. 12,636,684, describes a “Lens Cleaning System,” and was submitted by Tesla in May 2025.
The language in the patent details a lens cleaning system that can dispense fluid and wipe it away with a wiper assembly.
Optimus can see you now… 🤖👁️
The patent for @Tesla_Optimus‘s eye structure just dropped. $TSLA pic.twitter.com/Jac4VhDmKH
— SETI Park (@seti_park) May 26, 2026
This would effectively clean any debris that would potentially impact the visibility of the cameras on Tesla automobiles or Optimus’s camera eyes. Perhaps the most pertinent example is through the Full Self-Driving suite, as debris that can accumulate on the vehicle’s exterior cameras can impact the suite’s ability to operate effectively.
This requires a remedy through manual cleaning, but this patent hints that Tesla could be planning to implement this new technology on its upcoming vehicles.
Interestingly, we have started to see it on some Robotaxi vehicles, and it will likely be included in the Cybercab, especially as that vehicle will enable full autonomy.
Back in January, the first Model Y Robotaxi units were spotted with camera washers on the side repeaters, as the video below shows fluid squirting and rinsing off any debris that is limiting visibility.
🚨 Tesla looks to have installed Camera Washers on the side repeater cameras on Robotaxis in Austin
pic.twitter.com/xemRtDtlRR— TESLARATI (@Teslarati) January 23, 2026
This hardware patent does bring up an interesting question for those of us who own Teslas with AI4 and have been told that our cars will one day be capable of full autonomy: Will this washer be available as a retrofit on already-built cars?
Perhaps the “Lens Cleaning System” patent is a good look at one way Tesla plans to combat one of the most obvious issues of autonomy that utilizes a camera-based system. For Optimus, it could be less needed as it could be manually cleaned by owners. For cars, it seems like a bigger necessity, especially as autonomy nears and Tesla gets close to launching a feature-complete FSD suite.
SpaceX’s Starlink product has just gotten its latest airline adoptee, and the move marks the successful partnership of three of the “Big Four” U.S. airlines.
American Airlines announced on Tuesday that it would utilize Starlink in more than 500 narrowbody aircraft beginning in the first quarter of 2027. These include the Airbus aircraft in its fleet, including the new A321XLR and A321neo.
With the new partnership with American Airlines, Starlink is now present on three of the largest airlines in the country: American, United, and Southwest.
Starlink gets its latest airline adoptee for stable and reliable internet access
Starlink’s VP of Enterprise Sales, Jason Fritch, said:
“We are proud to bring Starlink on board American Airlines, delivering fast and reliable internet to passengers and crew. Whether traveling for leisure or business, Starlink enables a fully connected experience gate to gate, making every flight smoother and more enjoyable.”
Additionally, American Airlines Chief Customer Officer, Heather Garboden, said:
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want. The addition of Starlink solidifies American as a leading airline in keeping passengers connected in flight.”
Starlink has been on a tear over the past year, as it has continued to be adopted by a wide variety of airlines as a more consistent and reliable way to provide WiFi to its passengers. It has already gained a great reputation among residential users, but its biggest commercial application appears to be how it is being used in the air.
American Airlines will adopt Starlink on more than 500 of its narrowbody aircraft beginning in Q1 2027
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want,” said American Airlines Chief… pic.twitter.com/XY2wflycc0
— TESLARATI (@Teslarati) May 26, 2026
The only airline of the Big Four not to adopt Starlink thus far is Delta, which chose to opt for the alternative, which is Amazon Leo. CEO Ed Bastian said to Bloomberg that Delta chose Amazon’s product over Starlink’s because “the opportunities, in terms of the improved bandwidth with a much lower price point than what we’ve ever seen from Starlink, will make a big difference.”
Delta will not start installing Amazon Leo until 2028.
“Of course, we expect Starlink will be warning people that we’re going to go with an inferior product,” Bastian said. “But I’m not too worried about partnering with Amazon.”
Tesla Cybertruck’s newest trim level is nearing its first deliveries just a few months after being offered for an incredible deal.
Back in February, Tesla officially launched a new trim of the Cybertruck, the All-Wheel-Drive, starting at just $59,990. It was a lot of truck for the money, especially considering what it offered the Rear-Wheel-Drive variant for last year, which was a total flop.
The $59,990 price that was offered initially was a deal due to its 325-mile range rating, powered tonneau, three bed outlets, Powershare capability, coil springs with adaptive damping for a refined suspension feel, Steer-by-Wire and four-wheel steering, a 6′ x 4′ composite bed, towing capacity of 7,500 pounds, and a powered frunk.
Tesla is now nearing deliveries of this trim, according to watcher Sawyer Merritt, as Tesla has officially started assigning VINs to people who ordered the vehicle initially:
I can confirm that Tesla has officially started assigning VINs to people who initially ordered the $59,990 Cybertruck Dual-Motor AWD, which means first deliveries should start in the coming weeks!
• 325 mile range
• 7,500 lb towing capacity
• 0-60mph: 4.1s
• Bed with… pic.twitter.com/PQwVYbZf6j— Sawyer Merritt (@SawyerMerritt) May 24, 2026
Earlier this month, we reported on units of the trim being spotted outside Gigafactory Texas by Joe Tegtmeyer.
Tesla Giga Texas buzzing as new Cybertruck appears to enter production
This Cybertruck trim was interesting because it was released basically out of nowhere, priced incredibly well, and gathered many orders in a small amount of time. However, CEO Elon Musk noted just days afterward that the vehicle would only be priced at this bargain level for ten days.
Tesla fans were not happy.
Awful way to treat customers – particularly when they already sent out a marketing email announcing the $59,990 truck…with zero mention of it being a limited-time offer.
— Ryan McCaffrey (@DMC_Ryan) February 24, 2026
However, the issues with the pricing strategy have blown over since the February unveiling event, and now that deliveries are near, Tesla fans are anticipating the truck making its way to their driveways soon.
The truck is currently priced at $69,990, and deliveries for new orders are slated for between August and September 2026.
Tesla patent reveals strategy for solving major Full Self-Driving, Optimus issue
SpaceX Starlink gets its latest airline adoptee, grabbing three of the ‘Big Four’
