News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla’s early strategy for charging units operating within its Robotaxi fleet reveals that the company surely has not lost any of that scrappy DNA that took it from an unlikely success story to the most valuable carmaker in the world.
An observer at a Tesla Supercharger in Austin spotted ten total Robotaxi vehicles arrive: one Cybercab and nine Model Y units. A Tesla employee was waiting at the lot and allowed each unit to park itself; every car that arrived had nobody in it.
Tesla wins FCC approval for wireless Cybercab charging system
The Tesla employee would walk around and plug each car in, adjusting the parking if needed:
So look at what I found. This is how Tesla charges unsupervised robotaxis at a public supercharger. Here is a driverless Cybercab showing up with no one in it. There are 9 other Model Ys that showed up too. A Tesla employee is walking around and plugging each of them in. She also moves the cars if they are not positioned well enough to charge. I love this process. One person charges multiple robotaxis at once
— Abhimanyu Yadav (@WorldlyReviewer) October 3, 2026
It’s a very interesting strategy, but extremely understandable at this early point in the Robotaxi program. It’s only been out for about 15 months, and Cybercab just entered the fleet in early September.
On top of that, Tesla is still working tirelessly on its wireless charging apparatus, and a new patent was just published regarding that product last week.
However, this is just another example of how Tesla still has plenty of that scrappy DNA leftover from the “production hell” days, when CEO Elon Musk slept on the floor of the factory, employees were working crazy hours, Tesla was building Sprung Structures to build cars in, and the company was tiptoeing on the brink of bankruptcy.
@Teslarati Sheer magnitude of the entire production system is hard to appreciate. Almost every element of production is >75% automated. Only wire harnesses & general assembly, which are <10% of production costs, are primarily manual.
— Elon Musk (@elonmusk) October 12, 2020
For now, Tesla is utilizing a simple system for recharging its ride-hailing vehicles, and that is a Tesla employee doing it manually until another solution presents itself. Sure, it’s not the most high-tech thing, and it certainly is not what people might have expected at this point in time, but it works, and it’s keeping the entire suite running.
Tesla is expanding its Robotaxi service hours by pushing the time back by one hour, keeping the ride-hailing service operational until 11 p.m., one hour later than previously.
CEO Elon Musk confirmed the change and offered a specific reason the expansion has been gradual: the system still needs to reliably avoid small pets that are difficult to see after dark, as they commonly blend into the color of the road, especially when they’re grey.
The latest adjustment restores only a fraction of the operating window the service once held. When paid Robotaxi rides began in Austin on June 22, 2025, vehicles ran from 6 a.m. to midnight.
In September 2025, Tesla lengthened the day to a 2 a.m. close, producing a 20-hour window that stayed in place for most of the following year. By early August of this year, the cutoff had already been pulled back; an August 26 update formalized hours of 6 a.m. to 10 p.m. across Austin and several other markets.
The October move to 11 p.m. therefore leaves the Austin day one hour shorter than the original launch schedule and three hours shorter than the 2025 peak.
Musk addressed the constraint directly after the announcement. “The main thing we’re trying to solve is making sure that we don’t run over pets when they’re hard to see at night,” he wrote. “Literally trying to avoid grey kittens on grey tarmac in the dark.”
Robotaxi operating hours moved from 10pm to 11pm.
The main thing we’re trying to solve is making sure that we don’t run over pets when they’re hard to see at night. Literally trying to avoid grey kittens on grey tarmac in the dark.
— Elon Musk (@elonmusk) October 3, 2026
The example points to a low-contrast perception problem in which a small animal can blend into the road surface under limited lighting.
Tesla’s vehicles rely on cameras and neural-network processing rather than lidar; Musk has previously argued that advanced vision software can extract useful information even in low light by analyzing photon counts, but the pet-detection case remains the stated limiter in later hours.
The modest schedule change arrives alongside faster growth in the purpose-built Cybercab fleet. Texas registration data tracked by observers showed the Austin Cybercab count rising sharply in recent weeks, reaching 169 vehicles after more than 100 were added in a short span.
Tesla has indicated that a broader shift toward 24-hour operation is tied to the upcoming FSD v15 software release expected this month on Robotaxi vehicles. Until that capability is validated for the edge cases Musk described, the company continues to add service time incrementally rather than jumping straight to overnight coverage.
The one-hour extension gives Austin riders a later option for evening trips while the underlying detection work continues.
Tesla has snagged a deal with IMC Logistics to supply the company with 50 Semi units for its logistics operations.
IMC handles drayage and landside logistics and has over 2,700 asset trucks in its fleet. In its over forty years of service, it has established more than 50 locations across the United States and spans operations from coast to coast.
Jim Gillis of IMC said that the addition of the Tesla Semi will help IMC move toward a “zero-emission service for long-haul lanes.”
The move is one that has become more common over the past few years, as more and more companies doing large-scale logistics have moved to sustainable powertrains, using either Tesla or others.
🚨 IMC Logistics announced that it will add 50 Tesla Semis to its fleet https://t.co/ymh1Ca2IuX
— TESLARATI (@Teslarati) October 5, 2026
Tesla’s Semi program just entered its first truly public phase, as the company handed over its first production units to companies in September, although a pilot program with companies like PepsiCo. and Frito-Lay has been ongoing for years.
IMC announced its intention to purchase 50 Semi units from Tesla in September, and according to VP of Marketing and Public Relations on September 29 to Trucking Drive, the company will take delivery either this week or took delivery late last week.
With surging prices of diesel and high logistics costs, Tesla and the Semi could truly revolutionize how companies manage their fleets. With the advent of Full Self-Driving, the Semi will potentially cut down on driver fatigue and increase productivity, while decreasing the cost of operation per mile by being cheaper to refuel.
Tesla had a dedicated Semi handover event at the Semi factory in Sparks, Nevada, a few weeks back, as it officially introduced its truck to many company fleets that have been waiting to add these sustainable powertrains.
Tesla reveals early Robotaxi charging strategy, showing scrappy DNA
Tesla Robotaxi expands hours, Musk explains why it’s been a challenge
