News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
-
In a new note to investors on Tuesday, Morgan Stanley analyst Andrew Percoco said that Tesla has one big financial question to answer for investors regarding its Robotaxi rollout, Full Self-Driving software, and Optimus.
Percoco said in the note that, for the most part, investors are still very positive about the direction the company is headed. However, there are some things the firm would like to see, and they have to do with financials.
Tesla (TSLA) Q2 2026 earnings results: miss on EPS, beat on revenue
Tesla bulls are more than convinced that the company’s Full Self-Driving software is proof it can develop physical AI. Financially, however, there are still some questions, especially on elevated spending, which CEO Elon Musk said would occur as the company works to roll out Robotaxi faster and continue developing its Optimus robot.
The latter two are where Tesla will have to prove progress to investors, as Percoco writes that both projects “will require clearer evidence that Robotaxi is scaling and more tangible Optimus proof points to support the ROI on elevated capex.”
Percoco said the second quarter earnings call did not change his long-term thesis of where Tesla is positioned in the AI race, which is out in front. However, there are concerns that weaker gross margins and higher R&D spend will stress financials, and that has “sharpened our (and investors’) focus on measurable progress across Robotaxi and Optimus.”
Additionally, Robotaxi still needs to be proven with more operation in existing cities while maintaining safety but improving how many rides it gives in any given time, he said. For Optimus, Percoco wrote that he is “still looking for evidence beyond commentary around SOP.”
-
Morgan Stanley put Percoco in charge of covering Tesla after long-time analyst Adam Jonas transitioned to the automotive side.
Currently, Morgan Stanley has a $415 price target on Tesla and a ‘Hold’ rating on the stock. It is trading at around $330 at the time of publication, which was 2:30 P.M. on the East Coast.
SpaceX’s massive investment in AI will make it a big winner, Argus Research said after the company’s successful earnings call last week.
The firm also upgraded shares to a Buy from Hold and set a $160 price target.
SpaceX (NASDAQ: SPCX) is currently recovering from its heavy AI infrastructure investments, as it spent nearly $16 billion in Q2 alone. The company did this primarily by monetizing high-demand GPU compute capacity at a much faster pace than traditional data center economics would suggest.
Company CFO Bret Johnsen said that SpaceX would be able to pay back anything on new deployments within a year.
There are plenty of ways the company can do this:
Leasing excess compute capacity through contracts
SpaceX has already built Colossus and Colossus II, largely for its own model training. However, much of that capacity is already rented out to third parties. It already has major deals with Anthropic, Google, and Reflection AI. These partnerships are adding billions per month to SpaceX’s spreadsheet.
-
High utilization driven by industry-wide scarcity
The demand for advanced AI training and inference capacity continues to exceed what is available for use. SpaceX can fill new racks quickly after they come online, so the capital deployed converts into revenue with minimal idle time.
Additionally, management and outside observers have described the new compute capital as behaving more like a cost-of-goods-sold than traditional multi-year capex, especially because of this rapid monetization pattern.
Capacity has already scaled from ~0.4 GW a year to 1.4 GW annually by the end of Q2. There are targets of more than 2 GW by year-end.
High incremental margins on the rental business once capacity is online
GPU cloud providers often operate at strong gross margins. SpaceX can monetize capacity that was already partially built or can be added efficiently. This means that incremental EBITDA margins on the rental revenue are usually high. This accelerates cash recovery relative to the gross capital outlay.
Parallel monetization of its own AI software and applications
Beyond pure infrastructure rental, SpaceX also generates revenue from Grok through subscriptions and usage, from X through ads, data, and other related services, enterprise APIs, and the planned integration of the Cursor coding tools acquisition.
These application layers ride on the same compute infrastructure and provide additional high-margin streams that could offset build-out costs. AI-segment revenue overall rose sharply to about $2.6 billion in Q2, according to Motley Fool. This was driven primarily by the infrastructure contracts, but the software side is also partially responsible.
Efficient, large-scale deployment and vertical integration advantages
SpaceX has emphasized the rapid construction of power and cooling infrastructure and favorable cost-per-megawatt economics relative to industry benchmarks in some disclosures.
-
Combined with its ability to scale capacity aggressively and the fact that many contracts start generating revenue within months of capacity coming online, the effective payback compresses dramatically compared with more conventional multi-year data-center projects.
SpaceX’s dominant near-term recovery path will turn the AI clusters into a hyperscale-style compute rental business for other leading AI companies while still using a portion for internal models.
Tesla headlights have caused a recall of over 20,000 of the company’s two most popular vehicles, the Model 3 and Model Y, due to the low-beam bulb exceeding the maximum allowed intensity according to federal standards.
Tesla initiated the recall with the National Highway Traffic Safety Administration (NHTSA) this morning, stating that the low-beam output “exceeds the maximum allowed intensity in the outer upper-right and outer upper-left areas of the 10U and 90U zone, as prescribed in FMVSS No. 108.”
Tesla sourced the impacted headlights from Marelli Automotive Lighting, a Mexico-based company. The recall impacts 2020-2023 Model Y vehicles and 2017-2023 Model 3 vehicles. It is estimated that every VIN in this recall is impacted by the defect.
🚨 Tesla is recalling 20,349 2020-23 Model Y vehicles and 2017-23 Model 3 vehicles due to an excessively bright headlamp low beam.
Currently, there is no remedy plan in place, as it is still being developed. pic.twitter.com/y34cIO2U0B
— TESLARATI (@Teslarati) August 11, 2026
Typically, Tesla would remedy recalls of this nature through an Over-the-Air software update, which has been a major focus of criticism by the company and its supporters because the NHTSA still refers to it as a “recall,” even though it requires no action by the vehicle owner. The fix is shipped over the internet and downloaded to the car.
-
However, there appears to be a potentially different solution for this problem. Tesla has not developed a remedy for this issue, so it could potentially be on the way. The big issue appears to be the fact that these recalled lamps are out of production, and this is an old body style for both vehicles. The headlights and front-end designs are completely different.
Tesla switched to another supplier when the affected headlight design was discontinued. It plans to begin notifying owners of their remedy options by September 15.
Tesla filed a petition protesting the recall to fix the vehicles’ headlight issue, but the NHTSA denied it. Now, Tesla will come up with a solution to fix it.
Tesla has one big financial question to answer for investors: Morgan Stanley
SpaceX AI investment gamble will make it a big winner, firm says
