News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla has stunned by gaining yet another approval for its Full Self-Driving suite in Europe, its second in two days and its fifth overall.
Belgium will be the latest country to allow Tesla owners to utilize FSD on public roads in Europe, joining a quickly growing list that started with the Netherlands, Lithuania, and Estonia.
On Tuesday, Denmark announced its approval of the FSD suite, which has now been followed by Belgium just one day later.
The country’s Minister of Mobility, Annick De Ridder, announced the approval on her X account, stating that she had just signed the approval of Tesla FSD. It now goes to the country’s homologation department for the last step of the approval process.
De @Tesla community houdt hier al geruime tijd de vinger aan de pols over de toelating voor de FSD-technologie op onze Vlaamse en Belgische wegen.
Uit waardering voor jullie niet-aflatende interesse (en aanmoediging 😉), krijgen jullie hierbij de primeur: ik heb net de toelating… pic.twitter.com/Yrps4OHTj8— Annick De Ridder (@AnnickDeRidder) June 10, 2026
The Belgian approval is one of mighty importance because it truly shows how quickly countries in Europe could greenlight the FSD suite consecutively. Approvals are already coming in relatively quickly, which is a great sign.
Perhaps the next big development that could come from FSD approvals in Europe is an approval from a country like England, Italy, France, Spain, or Germany. It would be something to see how FSD would perform in a major European metro, such as London, Barcelona, Madrid, Paris, Rome, or Berlin.
Getting Full Self-Driving in Spain and England will be such huge milestones for Tesla. I am so excited to see how FSD performs in Madrid, Barcelona, and London, specifically.
The ultimate test will always be Mumbai or New Delhi. Excited for India’s eventual approval! https://t.co/paw9Ch1qmL pic.twitter.com/9RdDERVSSJ
— TESLARATI (@Teslarati) June 9, 2026
Full Self-Driving does an excellent job of roaming around major U.S. cities like New York and Los Angeles, but other high-profile international cities of significance would truly mark a line in the sand for Tesla, which can simply enable any vehicle in its customer-owned fleet to run FSD with the correct approvals.
SpaceX CEO Elon Musk recently confronted worries about orbital data centers and launching satellites in mass quantities in space, as some voiced concerns about crowding.
Musk’s SpaceX plans to combat the issue of needing data centers by launching them into space instead of taking up valuable real estate on Earth. It has been a major point of SpaceX’s future, including its looming IPO, which could be the largest ever.
In a recent interview filmed at SpaceX’s Starlink terminal factory in Bastrop, Texas, Elon Musk directly addressed concerns that deploying large numbers of AI satellites for orbital data centers could crowd Earth’s orbit. His message was straightforward and reassuring: space is vast beyond human intuition.
“Space is really big,” Musk said. “It’s not like space is gonna get crowded. Space is enormous. If you actually look at it relative to the Earth, the satellites are so tiny you can’t even see them.” He emphasized that even zooming in makes a satellite appear large, but from a planetary perspective, they are minuscule specks.
Elon on concerns that AI satellites will crowd space:
“Space is really big. It’s not like space is gonna get crowded. Space is enormous. If you actually look at it relative to the earth, the satellites are so tiny you can’t even see them.” https://t.co/Mvr7NpL25Q pic.twitter.com/5Fi629Rii7
— Sawyer Merritt (@SawyerMerritt) June 8, 2026
Musk pointed to SpaceX’s real-world experience operating roughly 10,000 Starlink satellites as evidence that large constellations can be managed safely. “We’ve got a pretty good idea of how to operate just really large constellations and do it safely,” he noted. SpaceX remains the only operator with meaningful experience at this scale, giving the company unique insight into tight orbital packing without compromising safety
The discussion highlighted SpaceX’s plans for “AI1” satellites—essentially orbiting racks of AI compute powered by massive solar arrays and cooled via radiative panels in space’s vacuum.
These satellites leverage proven Starlink V3 technology, making them simpler to design than communications satellites. A first-generation unit targets around 150 kW peak power, with a 70-meter wingspan for solar panels and radiators. Laser links will connect them to each other and the Starlink network, delivering low-latency access (on the order of a few milliseconds from low-Earth orbit).
FCC accepts SpaceX filing for 1 million orbital data center plan
Musk framed orbital data centers as a practical solution to Earth’s constraints on AI growth. Ground-based facilities face power shortages, water demands for cooling, and grid limitations. In space, constant sunlight (no day-night cycle), vacuum radiative cooling, and abundant solar energy offer clear advantages.
Production will ramp up at an expanded “Gigasat” factory in Bastrop, with solar manufacturing already underway and full AI satellite output expected at reasonable volume by the end of 2027. Starship’s rapid, high-volume launch capability, aiming for multiple flights per hour, will make massive deployment feasible.
Critics sometimes raise risks like space debris or Kessler syndrome, but Musk’s response underscores scale: even a million satellites would represent an imperceptible fraction of available orbital volume when viewed against Earth’s size. SpaceX’s automated collision avoidance and deorbiting designs for Starlink further mitigate concerns.
This vision ties into broader ambitions. Musk sees orbital AI compute as a step toward harnessing more of the Sun’s energy, advancing humanity on the Kardashev scale from a Type 0 civilization toward Type 1 and eventually Type 2. By moving power-hungry data centers off-planet, SpaceX aims to unlock orders-of-magnitude more compute while preserving Earth’s resources.
Musk’s comments should ease public anxiety. With proven operational expertise, incremental engineering, and the immensity of space itself, orbital data centers represent not overcrowding, but smart expansion into the final frontier.
Tesla Full Self-Driving (Supervised) is currently listed as a Level 2 suite in terms of its passenger cars. As its Robotaxi platform continues to move quickly, it has been recognized as a Level 4 ride-sharing program by the State of Texas, as Tesla recently self-certified itself.
However, a Wall Street analyst is arguing that Tesla (NASDAQ: TSLA) has effectively achieved Level 4 autonomy in most conditions in all of its vehicles, drawing on personal experience and data released by the company.
Alex Potter of Piper Sandler said in a note to investors on Wednesday that “Tesla has solved the self-driving puzzle,” pointing to decisions to offer insurance discounts for FSD-enabled policies as a signal of confidence, which is backed up by stellar safety records compared to human driving.
Investing.com initially reported on Potter’s new note.
Additionally, Potter looks at the recent start of Cybercab production at Giga Texas as a potential indication that Tesla is ready to offer some level of unsupervised driving at least in the near future. The Cybercab has no steering wheel or pedals, completely eliminating the ability for human input.
He also sees Tesla’s allocation of “several hundred million USD (if not $1B+)” as confidence internally, seeing as it would be tough to set aside that amount of capital toward a project that the company does not see as relatively near-term.
Forward thinking, especially as Cybercab has no human controls, it would make sense that Tesla is at least close to self-driving. How close is another question.
Tesla has routinely teased that unsupervised FSD is close, but there are still a lot of things it feels as if the company has to roll out some more capability, including unsupervised parking features, known as “Banish,” better operation with regional self-driving performance, and other improvements.
That is not to say that Tesla FSD is super impressive already. It has already completed coast-to-coast drives across the United States and Canada, it routinely takes the stress out of driving for most people, and it has proven through Tesla Safety Reports that it is safer and involved in accidents less frequently than humans.
🚨 These are the first-ever FSD safety statistics out of the Netherlands, showing it was over 3.5x safer than human driving on Dutch roads.
The most recent numbers out of Tesla for North America show:
-Over 5.5 million miles between accidents for Teslas using FSD
-660k miles… https://t.co/XKlRzgSGEh pic.twitter.com/HX6kzh0ZKc— TESLARATI (@Teslarati) June 9, 2026
Even Potter believes it is capable, as he used it to go from Missoula, Montana, to Minneapolis, Minnesota, back in April.
“There’s no substitute for personal experience,” he wrote.
Tesla stuns with another FSD approval in Europe, its second in two days
SpaceX’s Elon Musk relieves worries about orbital data centers
