News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk has acknowledged that early discussions with Taiwan Semiconductor Manufacturing Company (TSMC) could bring the company into his ambitious Terafab semiconductor project, signaling a possible partnership with the world’s leading contract chipmaker.
Musk confirmed that early talks are underway, but as of right now, they are “just discussions.” There is no confirmation of a deal nor dismissal of the possibility of one, leaving open the prospect of one of the largest advanced-chip collaborations under discussion in the U.S.
@wholemars Just discussions, but something may come of it
— Elon Musk (@elonmusk) October 3, 2026
The report that speculated on potential discussions between Terafab and TSMC comes from Tim Culpan, who outlined a few ways the collaboration could operate. One is TSMC using the project as an “anchor customer” for future facilities in Texas, potentially contributing process expertise, operational know-how, or capacity while Terafab provides capital, long-term purchase commitments, or both.
Tesla and SpaceX jointly developed the Terafab project, with Intel already participating on the tech side. Elon Musk announced the project in March, and it intends to produce more than one terawatt of AI compute capacity annually once fully built.
Company statements place the first phase at approximately $16.8 billion in cost, with later filings pointing to a total that could reach well into the tens of billions across multiple stages.
Intel joined the effort in April 2026 and is expected to supply its 14A manufacturing process for the full-scale plant.
Musk has said existing suppliers, including Samsung and TSMC, remain important for near-term needs; Tesla already has production arrangements with Samsung for AI5 and AI6 chips, but that future demand from Optimus robots, Cybercab vehicles, and planned space-based data centers will eventually exceed what the global industry can currently deliver.
Terafab is positioned as the long-term answer to that projected shortfall, and Tesla did something similar during COVID to avoid a chip shortage. This is just a much larger-scale solution.
If the partnership were to materialize, it would add TSMC’s industry-leading strategies to a project that already combines Tesla’s and SpaceX’s capital and offtake with Intel’s process technology. For now, the only public confirmation is Musk’s brief acknowledgement that conversations are occurring.
Tesla’s early strategy for charging units operating within its Robotaxi fleet reveals that the company surely has not lost any of that scrappy DNA that took it from an unlikely success story to the most valuable carmaker in the world.
An observer at a Tesla Supercharger in Austin spotted ten total Robotaxi vehicles arrive: one Cybercab and nine Model Y units. A Tesla employee was waiting at the lot and allowed each unit to park itself; every car that arrived had nobody in it.
Tesla wins FCC approval for wireless Cybercab charging system
The Tesla employee would walk around and plug each car in, adjusting the parking if needed:
So look at what I found. This is how Tesla charges unsupervised robotaxis at a public supercharger. Here is a driverless Cybercab showing up with no one in it. There are 9 other Model Ys that showed up too. A Tesla employee is walking around and plugging each of them in. She also moves the cars if they are not positioned well enough to charge. I love this process. One person charges multiple robotaxis at once
— Abhimanyu Yadav (@WorldlyReviewer) October 3, 2026
It’s a very interesting strategy, but extremely understandable at this early point in the Robotaxi program. It’s only been out for about 15 months, and Cybercab just entered the fleet in early September.
On top of that, Tesla is still working tirelessly on its wireless charging apparatus, and a new patent was just published regarding that product last week.
However, this is just another example of how Tesla still has plenty of that scrappy DNA leftover from the “production hell” days, when CEO Elon Musk slept on the floor of the factory, employees were working crazy hours, Tesla was building Sprung Structures to build cars in, and the company was tiptoeing on the brink of bankruptcy.
@Teslarati Sheer magnitude of the entire production system is hard to appreciate. Almost every element of production is >75% automated. Only wire harnesses & general assembly, which are <10% of production costs, are primarily manual.
— Elon Musk (@elonmusk) October 12, 2020
For now, Tesla is utilizing a simple system for recharging its ride-hailing vehicles, and that is a Tesla employee doing it manually until another solution presents itself. Sure, it’s not the most high-tech thing, and it certainly is not what people might have expected at this point in time, but it works, and it’s keeping the entire suite running.
Tesla is expanding its Robotaxi service hours by pushing the time back by one hour, keeping the ride-hailing service operational until 11 p.m., one hour later than previously.
CEO Elon Musk confirmed the change and offered a specific reason the expansion has been gradual: the system still needs to reliably avoid small pets that are difficult to see after dark, as they commonly blend into the color of the road, especially when they’re grey.
The latest adjustment restores only a fraction of the operating window the service once held. When paid Robotaxi rides began in Austin on June 22, 2025, vehicles ran from 6 a.m. to midnight.
In September 2025, Tesla lengthened the day to a 2 a.m. close, producing a 20-hour window that stayed in place for most of the following year. By early August of this year, the cutoff had already been pulled back; an August 26 update formalized hours of 6 a.m. to 10 p.m. across Austin and several other markets.
The October move to 11 p.m. therefore leaves the Austin day one hour shorter than the original launch schedule and three hours shorter than the 2025 peak.
Musk addressed the constraint directly after the announcement. “The main thing we’re trying to solve is making sure that we don’t run over pets when they’re hard to see at night,” he wrote. “Literally trying to avoid grey kittens on grey tarmac in the dark.”
Robotaxi operating hours moved from 10pm to 11pm.
The main thing we’re trying to solve is making sure that we don’t run over pets when they’re hard to see at night. Literally trying to avoid grey kittens on grey tarmac in the dark.
— Elon Musk (@elonmusk) October 3, 2026
The example points to a low-contrast perception problem in which a small animal can blend into the road surface under limited lighting.
Tesla’s vehicles rely on cameras and neural-network processing rather than lidar; Musk has previously argued that advanced vision software can extract useful information even in low light by analyzing photon counts, but the pet-detection case remains the stated limiter in later hours.
The modest schedule change arrives alongside faster growth in the purpose-built Cybercab fleet. Texas registration data tracked by observers showed the Austin Cybercab count rising sharply in recent weeks, reaching 169 vehicles after more than 100 were added in a short span.
Tesla has indicated that a broader shift toward 24-hour operation is tied to the upcoming FSD v15 software release expected this month on Robotaxi vehicles. Until that capability is validated for the edge cases Musk described, the company continues to add service time incrementally rather than jumping straight to overnight coverage.
The one-hour extension gives Austin riders a later option for evening trips while the underlying detection work continues.
Elon Musk teases TSMC as potential Terafab partner
Tesla reveals early Robotaxi charging strategy, showing scrappy DNA
