News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla revealed a major new Cybercab detail in a guide it released for First Responders, showing new territory in its beliefs and intentions for the ride-hailing-focused vehicle that entered production in April.
The First Responders Guide is released to give fire departments, paramedics, and other emergency personnel the proper guidance on what to do in the event of an accident, entrapment, or other situation that would require immediate attention.
On one of the pages of the First Responders Guide, Tesla revealed a stark detail about the Cybercab, which could help personnel enter the vehicle more easily in case of an emergency.
Tesla Cybercab has one important piece that AI4 cars might need for FSD
It shows Tesla has no intention of releasing any Cybercab units that were initially proposed for ride-hailing services for the general public with any manual controls, meaning a steering wheel or pedals:
“A Cybercab equipped with steering wheel, brake pedal, and an acceleration pedal is typically an engineering or test vehicle, and operates at SAE Level 2 autonomy. Cybercab is not typically equipped with a steering wheel or acceleration and brake pedals.”
New official Cybercab documentation from Tesla:
“A Cybercab equipped with steering wheel, brake pedal, and an acceleration pedal is typically an engineering or test vehicle, and operates at SAE Level 2 autonomy. Cybercab is not typically equipped with a steering wheel or… https://t.co/P6ut1mZyzr pic.twitter.com/yq6skl9s2J
— Sawyer Merritt (@SawyerMerritt) June 27, 2026
This is a major development for those who continue to believe Tesla planned to release the Cybercab with any sort of manual controls so that passengers could take over if needed. However, when Tesla started manufacturing production versions of the Cybercab in Giga Texas earlier this year, they were spotted without a steering wheel or pedals.
It essentially confirms the company has no intentions of bringing manual controls to the car’s production versions. Some have argued that the likelihood of Tesla having something
There still are some Cybercab units out there with a steering wheel and pedals, and as Tesla said, these cars are engineering or test vehicles, which have Safety Monitors on board to help the car out of a precarious situation or emergency.
Tesla released the Full Self-Driving v14 ‘Lite’ suite to owners of Hardware 3 or AI3 vehicles today, adding several new features to the vehicles that were once believed to be capable of unsupervised self-driving.
Now, Tesla has released this modified suite to older Tesla vehicles, adding plenty of new features and capabilities.
Here are the full release notes for the suite:
- Distilled the intelligence from HW4 V14 into HW3. This allows HW3 to directly learn how to handle scenarios using HW4 V14 as a guide. This process unlocks the improvements that have been made to HW4 including Reinforcement Learning (RL) and offline models for HW3.
- Improved both proactive and reactive responsiveness across a wide variety of categories including navigation handling, merges and forks, pedestrian interactions, traffic lights, and vehicle cut-in scenarios.
- Improved general comfort in nominal scenarios through fewer false slowdowns, smoother steering and more consistent lane centering.
- Introduced parking, unparking, and reversing capabilities.
- Added Arrival Options for you to select where FSD should park: in a Parking Lot, on the Street, in a Driveway, or at the Curbside.
- Speed Profiles are now available at all times, to further customize driving style preference.
These improvements, according to Tesla’s Head of AI, Ashok Elluswamy, help distill the driving behavior from AI4’s v14 series into both the camera and compute configurations of AI3.
Tesla Full Self-Driving v14 ‘Lite’ for older cars finally gets released
He added:
“It includes destination options and speed profiles on city roads, but more importantly significantly improved safety. We hope you’ll enjoy it, once the build ships wide.”
FSD v14 Lite is now rolling out to AI3 early-access customers. Based on the feedback, will rollout to more customers over the next few weeks.
This build distills the driving behavior from AI4’s v14 series into both the camera and compute config of AI3. It includes destination…
— Ashok Elluswamy (@aelluswamy) June 29, 2026
Tesla will continue to roll out the v14 Lite suite more widely in the coming weeks, the company said.
Tesla has finally released its Full Self-Driving v14 ‘Lite’ suite for older cars that equip the Hardware 3 or AI 3 chip, which have not been able to handle the newest versions of the company’s driver assistance software.
Tesla officially started releasing the v14 Lite suite to owners in the Early Access Program last night. The company’s Head of AI, Ashok Elluswamy, said that the rollout will continue over the next few weeks. The build distills the driving behavior from AI4’s v14 series into both the camera and compute configurations of an AI3 car.
🚨 Tesla is releasing v14 Lite for AI3 owners who are in early-access
This will give AI3 cars the ability to experience new FSD features like parking preferences. https://t.co/pp6Q5FOKoz pic.twitter.com/tqexMB8SVy
— TESLARATI (@Teslarati) June 29, 2026
It also includes a variety of new features that were available to AI4 cars running v14, including:
- Start Self-Driving from Park
- Arrival and Parking Options
- Speed Profiles
The release is highly anticipated because those owners with AI3 vehicles were early adopters into the FSD platform and were promised that their cars would be capable of achieving Full Self-Driving.
However, Tesla CEO Elon Musk admitted during the company’s recent Q1 Earnings Call that these vehicles would not be capable of achieving unsupervised Full Self-Driving, which is what Tesla had originally said.
Owners were not pleased with this answer, or the idea that their commitment to buying the suite outright for thousands of dollars would not yield the ability to drive without operating the car. Tesla gave some solutions for this, including a discount on a new car, or an upgrade to an AI4 or AI5 self-driving computer and new, upgraded cameras.
Tesla owners do not seem pleased with these options, as they require giving the company more money.
Nevertheless, it is important to note that Tesla came through for owners here by releasing v14 Lite before the end of Q2, something it had promised owners during the previous Earnings Call. Tesla has had trouble keeping up with timelines, but this is a big achievement for the team.
Tesla reveals huge Cybercab detail in new guide for First Responders
Tesla Full Self-Driving v14 ‘Lite’ Release Notes: new capabilities and features
