News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
NASA’s first human outpost on the Moon starts now – SpaceX on deck
NASA named the rovers, landers, and vendors that will build America’s first Moon Base.
NASA has laid out its most detailed Moon Base plan to date, describing a permanent outpost near the Moon’s south pole that the agency intends to build over the coming decade as a direct stepping stone to Mars. “The Moon Base will be America’s and humanity’s first outpost on another celestial world,” NASA Administrator Jared Isaacman said, adding that every mission crewed and uncrewed “will be a learning opportunity as we return to the lunar surface, build the infrastructure to stay, and master the skills required to live and operate in one of the most demanding and dangerous environments imaginable.”
The plan is structured in three phases involving both uncrewed and crewed missions to deliver equipment, vehicles, and infrastructure to the surface, with the first three moon base missions targeted to launch before the end of 2026.
Moon Base I, targeting fall 2026, will use Blue Origin’s Blue Moon Mark 1 lander to deliver scientific instruments to the Shackleton Connecting Ridge, the same region where Artemis astronauts will land. Moon Base II will send Astrobotic’s Griffin lander carrying more than 1,100 pounds of cargo including Astrolab’s FLIP rover to begin developing mobility systems on the surface. Moon Base III will carry the Lunar Vertex science mission on Intuitive Machines’ Nova-C Trinity lander to study lunar swirls near the south pole, with ESA and Korean science payloads aboard.
On the rover side, NASA awarded Astrolab $219 million and Lunar Outpost $220 million to build the first phase of Lunar Terrain Vehicles, with both rovers targeted for deployment to the lunar surface by 2028. Astrolab’s crewed rover weighs roughly 2,000 pounds and can reach over 6 mph. Lunar Outpost’s Pegasus rover can operate autonomously or via remote control at over 9 mph. Blue Origin separately received $188 million with an option worth $280.4 million to deliver cargo landers for rover transport.
NASA also confirmed that MoonFall, a mission deploying four survey drones to scout Artemis landing sites, has selected Firefly Aerospace to build the transport spacecraft, with a 2028 launch target.
SpaceX sits at the center of that commercial layer. SpaceX holds the NASA Human Landing System contract for the Starship-derived lander that will put astronauts on the surface under Artemis IV, currently targeting 2028. Before that can happen, SpaceX must demonstrate in-orbit propellant transfer at scale, a process requiring multiple Starship tanker launches to fuel a single mission. Water ice at the lunar south pole is central to the base’s long-term viability, as it can be converted into drinking water, breathable oxygen, and rocket fuel, directly reducing dependence on Earth resupply. That resource loop becomes far more practical if Starship can land and be refueled on or near the Moon itself.
Elon Musk has publicly stated that Starship V3, which recently completed its first flight, should be capable enough for initial Mars missions. The Moon Base plan announced Tuesday is the infrastructure layer that connects everything between those two ambitions, and SpaceX is the only American company currently contracted to build the rocket that gets humans to either destination.
A new Tesla patent that has been granted to the company this week has revealed a potential strategy for solving a major issue that could impact both the Full Self-Driving suite and Optimus.
The patent, which is No. 12,636,684, describes a “Lens Cleaning System,” and was submitted by Tesla in May 2025.
The language in the patent details a lens cleaning system that can dispense fluid and wipe it away with a wiper assembly.
Optimus can see you now… 🤖👁️
The patent for @Tesla_Optimus‘s eye structure just dropped. $TSLA pic.twitter.com/Jac4VhDmKH
— SETI Park (@seti_park) May 26, 2026
This would effectively clean any debris that would potentially impact the visibility of the cameras on Tesla automobiles or Optimus’s camera eyes. Perhaps the most pertinent example is through the Full Self-Driving suite, as debris that can accumulate on the vehicle’s exterior cameras can impact the suite’s ability to operate effectively.
This requires a remedy through manual cleaning, but this patent hints that Tesla could be planning to implement this new technology on its upcoming vehicles.
Interestingly, we have started to see it on some Robotaxi vehicles, and it will likely be included in the Cybercab, especially as that vehicle will enable full autonomy.
Back in January, the first Model Y Robotaxi units were spotted with camera washers on the side repeaters, as the video below shows fluid squirting and rinsing off any debris that is limiting visibility.
🚨 Tesla looks to have installed Camera Washers on the side repeater cameras on Robotaxis in Austin
pic.twitter.com/xemRtDtlRR— TESLARATI (@Teslarati) January 23, 2026
This hardware patent does bring up an interesting question for those of us who own Teslas with AI4 and have been told that our cars will one day be capable of full autonomy: Will this washer be available as a retrofit on already-built cars?
Perhaps the “Lens Cleaning System” patent is a good look at one way Tesla plans to combat one of the most obvious issues of autonomy that utilizes a camera-based system. For Optimus, it could be less needed as it could be manually cleaned by owners. For cars, it seems like a bigger necessity, especially as autonomy nears and Tesla gets close to launching a feature-complete FSD suite.
SpaceX’s Starlink product has just gotten its latest airline adoptee, and the move marks the successful partnership of three of the “Big Four” U.S. airlines.
American Airlines announced on Tuesday that it would utilize Starlink in more than 500 narrowbody aircraft beginning in the first quarter of 2027. These include the Airbus aircraft in its fleet, including the new A321XLR and A321neo.
With the new partnership with American Airlines, Starlink is now present on three of the largest airlines in the country: American, United, and Southwest.
Starlink gets its latest airline adoptee for stable and reliable internet access
Starlink’s VP of Enterprise Sales, Jason Fritch, said:
“We are proud to bring Starlink on board American Airlines, delivering fast and reliable internet to passengers and crew. Whether traveling for leisure or business, Starlink enables a fully connected experience gate to gate, making every flight smoother and more enjoyable.”
Additionally, American Airlines Chief Customer Officer, Heather Garboden, said:
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want. The addition of Starlink solidifies American as a leading airline in keeping passengers connected in flight.”
Starlink has been on a tear over the past year, as it has continued to be adopted by a wide variety of airlines as a more consistent and reliable way to provide WiFi to its passengers. It has already gained a great reputation among residential users, but its biggest commercial application appears to be how it is being used in the air.
American Airlines will adopt Starlink on more than 500 of its narrowbody aircraft beginning in Q1 2027
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want,” said American Airlines Chief… pic.twitter.com/XY2wflycc0
— TESLARATI (@Teslarati) May 26, 2026
The only airline of the Big Four not to adopt Starlink thus far is Delta, which chose to opt for the alternative, which is Amazon Leo. CEO Ed Bastian said to Bloomberg that Delta chose Amazon’s product over Starlink’s because “the opportunities, in terms of the improved bandwidth with a much lower price point than what we’ve ever seen from Starlink, will make a big difference.”
Delta will not start installing Amazon Leo until 2028.
“Of course, we expect Starlink will be warning people that we’re going to go with an inferior product,” Bastian said. “But I’m not too worried about partnering with Amazon.”
NASA’s first human outpost on the Moon starts now – SpaceX on deck
Tesla patent reveals strategy for solving major Full Self-Driving, Optimus issue
