News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
-
Tesla CEO Elon Musk said that flying cars will be coming to the market, something that his own company has hinted at previously.
Musk said on X, in response to a post that read, “We were promised flying cars and all we got is infinite superintelligence for everyone,” “You will get flying cars.”
You will get flying cars
— Elon Musk (@elonmusk) August 12, 2026
The post rang back to when Musk teased flying and hovering capabilities for the Tesla Roadster, the company’s supercar that has been delayed more times than anyone cares to count. It was set for an unveiling earlier this year, but it was then pushed back to August. There is still no sign of it coming.
However, that does not mean it won’t. But one of the biggest features of the Roadster that was teased was a SpaceX package that featured cold gas thrusters on the rear end that would help with white-knuckle acceleration. Another set would face the ground and would help the Roadster gain small bits of altitude, potentially helpful to jump over obstacles.
Elon Musk hints at Tesla Roadster’s “hovering” abilities in SpaceX package
-
But it is not a straightforward thing for Musk. As a serial entrepreneur, he tends to spend his time on major disruptors; currently, his largest projects are artificial intelligence and compute power, as well as SpaceX’s launches that will eventually make life multiplanetary.
In the past, he has been critical of flying cars and has been in favor of tunnels, one of the big reasons he started the Boring Company. In 2017 at a TED talk, he said:
“There is a challenge with flying cars in that they’ll be quite noisy. The wind force generated will be very high. Let’s just say that if something’s flying over your head, if there are a whole bunch of flying cars all over the place, that is not an anxiety-reducing situation…You’re thinking, ‘Did they service their hubcap? Or is it going to come off and guillotine me as they’re flying past?’”
However, he’s never been against them. He has also said he’s in favor of both tunnels and flying cars.
Contrary to press reports, I’m not against flying cars. Just said it was important to consider both pros and cons.
— Elon Musk (@elonmusk) March 24, 2015
Most recently, Musk said that anyone who wants a flying car should be able to get one. This was stated last October on the Joe Rogan Experience:
-
“My friend Peter Thiel once reflected that the future was supposed to have flying cars, but we don’t have flying cars… I think if Peter wants a flying car, we should be able to buy one.”
Whether the Roadster will be Tesla’s flying car or potentially another one remains in the mind of Musk. Of course, the Roadster will have to make its way to production lines before we find out.
Elon Musk
SpaceX’s next trillion dollar bet has nothing to do with rockets, Musk tells staff
Elon Musk told SpaceX staff AI revenue will soon dwarf rockets and Starlink combined entirely.
Elon Musk told SpaceX employees this week that artificial intelligence, not rockets, will soon carry the company’s revenue. In a roughly 29 minute internal address posted on SpaceX’s X account on Tuesday, Musk said AI revenue will pass every other line of business at SpaceX “probably in September” and pull further ahead by the fourth quarter.
The numbers he gave are specific. SpaceX currently runs 1.4 gigawatts of AI compute capacity. Musk wants that at 10 gigawatts by the end of 2027, a jump he tied directly to revenue: “if we bring 10GW of AI online by the end of next year, it will be $300 billion to $500 billion a year in revenue.” He called those “big numbers,” which undersells a projection larger than what most countries produce in a year.
We made rockets reusable and are rebuilding the internet in space. The next challenge: making life multiplanetary and understanding the true nature of the universe
Watch @ElonMusk deliver a company update to @SpaceX employees pic.twitter.com/5c8rxoCQfu
— SpaceX (@SpaceX) August 11, 2026
Musk went further on where AI fits into SpaceX’s future. “Probably in four or five years, AI will be 99% of the value of SpaceX,” he told staff, adding that digital intelligence would eventually run “a trillion times” ahead of biological intelligence as computing scales. He tied that growth to the company’s founding mission, telling employees “we must win on AI, because the future is overwhelmingly AI and robots,” with the payoff meant to help fund Starship and a Mars program that increasingly runs through Terafab, the joint Tesla, SpaceX and xAI chip plant.
Elon Musk launches TERAFAB: The $25B Tesla-SpaceXAI chip factory that will rewire the AI industry
-
None of this is entirely new territory. SpaceX told investors much the same story during its first earnings call as a public company on August 4, where Musk moved the company’s $1 trillion revenue target up a year to 2030 and said Starlink could someday carry a majority of the world’s internet. What the all hands video adds is a hard deadline and a specific power figure Musk had not given publicly before, along with a franker pitch to his own workforce that AI, not launch cadence, is now the thing SpaceX is betting its future on.
The AI revenue itself is not coming from SpaceX training its own models. It is largely Starlink acting as the network layer for xAI’s workloads, plus SpaceX renting out compute capacity directly, the same approach behind the roughly $16 billion the company spent on AI infrastructure in a single quarter.
Musk closed the video with a pitch aimed at recruiting and retention rather than investors, telling employees that anyone who helps SpaceX win the AI race will eventually get the chance to go to the moon or Mars themselves. Whether SpaceX can turn 1.4 gigawatts into 10 in seventeen months is the more immediate question, and one that will show up in quarterly numbers well before anyone leaves Earth.
In a new note to investors on Tuesday, Morgan Stanley analyst Andrew Percoco said that Tesla has one big financial question to answer for investors regarding its Robotaxi rollout, Full Self-Driving software, and Optimus.
Percoco said in the note that, for the most part, investors are still very positive about the direction the company is headed. However, there are some things the firm would like to see, and they have to do with financials.
Tesla (TSLA) Q2 2026 earnings results: miss on EPS, beat on revenue
Tesla bulls are more than convinced that the company’s Full Self-Driving software is proof it can develop physical AI. Financially, however, there are still some questions, especially on elevated spending, which CEO Elon Musk said would occur as the company works to roll out Robotaxi faster and continue developing its Optimus robot.
The latter two are where Tesla will have to prove progress to investors, as Percoco writes that both projects “will require clearer evidence that Robotaxi is scaling and more tangible Optimus proof points to support the ROI on elevated capex.”
Percoco said the second quarter earnings call did not change his long-term thesis of where Tesla is positioned in the AI race, which is out in front. However, there are concerns that weaker gross margins and higher R&D spend will stress financials, and that has “sharpened our (and investors’) focus on measurable progress across Robotaxi and Optimus.”
Additionally, Robotaxi still needs to be proven with more operation in existing cities while maintaining safety but improving how many rides it gives in any given time, he said. For Optimus, Percoco wrote that he is “still looking for evidence beyond commentary around SOP.”
-
Morgan Stanley put Percoco in charge of covering Tesla after long-time analyst Adam Jonas transitioned to the automotive side.
Currently, Morgan Stanley has a $415 price target on Tesla and a ‘Hold’ rating on the stock. It is trading at around $330 at the time of publication, which was 2:30 P.M. on the East Coast.
Tesla CEO Elon Musk says flying cars are coming
SpaceX’s next trillion dollar bet has nothing to do with rockets, Musk tells staff
