News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla made a dramatic change to the Online Design Studio to show its plans for Full Self-Driving, a major part of the company’s plans moving forward, as CEO Elon Musk has been extremely clear on the direction moving forward.
With Tesla taking a stand and removing the ability to purchase Full Self-Driving outright next month, it is already taking steps to initiate that with owners and potential buyers.
On Thursday night, the company updated its Online Design Studio to reflect that in a new move that now lists the three purchase options that are currently available: Monthly Subscription, One-Time Purchase, or Add Later:
🚨 Check out the change Tesla made to its Online Design Studio:
It now lists the Monthly Subscription as an option for Full Self-Driving
It also shows the outright purchase option as expiring on February 14 pic.twitter.com/pM6Svmyy8d
— TESLARATI (@Teslarati) January 23, 2026
This change replaces the former option for purchasing Full Self-Driving at the time of purchase, which was a simple and single box to purchase the suite outright. Subscriptions were activated through the vehicle exclusively.
However, with Musk announcing that Tesla would soon remove the outright purchase option, it is clearer than ever that the Subscription plan is where the company is headed.
The removal of the outright purchase option has been a polarizing topic among the Tesla community, especially considering that there are many people who are concerned about potential price increases or have been saving to purchase it for $8,000.
This would bring an end to the ability to pay for it once and never have to pay for it again. With the Subscription strategy, things are definitely going to change, and if people are paying for their cars monthly, it will essentially add $100 per month to their payment, pricing some people out. The price will increase as well, as Musk said on Thursday, as it improves in functionality.
I should also mention that the $99/month for supervised FSD will rise as FSD’s capabilities improve.
The massive value jump is when you can be on your phone or sleeping for the entire ride (unsupervised FSD). https://t.co/YDKhXN3aaG
— Elon Musk (@elonmusk) January 23, 2026
Those skeptics have grown concerned that this will actually lower the take rate of Full Self-Driving. While it is understandable that FSD would increase in price as the capabilities improve, there are arguments for a tiered system that would allow owners to pay for features that they appreciate and can afford, which would help with data accumulation for the company.
Musk’s new compensation package also would require Tesla to have 10 million active FSD subscriptions, but people are not sure if this will move the needle in the correct direction. If Tesla can potentially offer a cheaper alternative that is not quite unsupervised, things could improve in terms of the number of owners who pay for it.
News
Tesla Model S completes first ever FSD Cannonball Run with zero interventions
The coast-to-coast drive marked the first time Tesla’s FSD system completed the iconic, 3,000-mile route end to end with no interventions.
A Tesla Model S has completed the first-ever full Cannonball Run using Full Self-Driving (FSD), traveling from Los Angeles to New York with zero interventions. The coast-to-coast drive marked the first time Tesla’s FSD system completed the iconic, 3,000-mile route end to end, fulfilling a long-discussed benchmark for autonomy.
A full FSD Cannonball Run
As per a report from The Drive, a 2024 Tesla Model S with AI4 and FSD v14.2.2.3 completed the 3,081-mile trip from Redondo Beach in Los Angeles to midtown Manhattan in New York City. The drive was completed by Alex Roy, a former automotive journalist and investor, along with a small team of autonomy experts.
Roy said FSD handled all driving tasks for the entirety of the route, including highway cruising, lane changes, navigation, and adverse weather conditions. The trip took a total of 58 hours and 22 minutes at an average speed of 64 mph, and about 10 hours were spent charging the vehicle. In later comments, Roy noted that he and his team cleaned out the Model S’ cameras during their stops to keep FSD’s performance optimal.Â
History made
The historic trip was quite impressive, considering that the journey was in the middle of winter. This meant that FSD didn’t just deal with other cars on the road. The vehicle also had to handle extreme cold, snow, ice, slush, and rain.
As per Roy in a post on X, FSD performed so well during the trip that the journey would have been completed faster if the Model S did not have people onboard. “Elon Musk was right. Once an autonomous vehicle is mature, most human input is error. A comedy of human errors added hours and hundreds of miles, but FSD stunned us with its consistent and comfortable behavior,” Roy wrote in a post on X.
Roy’s comments are quite notable as he has previously attempted Cannonball Runs using FSD on December 2024 and February 2025. Neither were zero intervention drives.
Elon Musk
Tesla removes Autopilot as standard, receives criticism online
The move leaves only Traffic Aware Cruise Control as standard equipment on new Tesla orders.
Tesla removed its basic Autopilot package as a standard feature in the United States. The move leaves only Traffic Aware Cruise Control as standard equipment on new Tesla orders, and shifts the company’s strategy towards paid Full Self-Driving subscriptions.
Tesla removes Autopilot
As per observations from the electric vehicle community on social media, Tesla no longer lists Autopilot as standard in its vehicles in the U.S. This suggests that features such as lane-centering and Autosteer have been removed as standard equipment. Previously, most Tesla vehicles came with Autopilot by default, which offers Traffic-Aware Cruise Control and Autosteer.
The change resulted in backlash from some Tesla owners and EV observers, particularly as competing automakers, including mainstream players like Toyota, offer features like lane-centering as standard on many models, including budget vehicles.
That being said, the removal of Autopilot suggests that Tesla is concentrating its autonomy roadmap around FSD subscriptions rather than bundled driver-assistance features. It would be interesting to see how Tesla manages its vehicles’ standard safety features, as it seems out of character for Tesla to make its cars less safe over time.
Musk announces FSD price increases
Following the Autopilot changes, Elon Musk stated on X that Tesla is planning to raise subscription prices for FSD as its capabilities improve. In a post on X, Musk stated that the current $99-per-month price for supervised FSD would increase over time, especially as the system itself becomes more robust.
“I should also mention that the $99/month for supervised FSD will rise as FSD’s capabilities improve. The massive value jump is when you can be on your phone or sleeping for the entire ride (Unsupervised FSD),” Musk wrote.
At the time of his recent post, Tesla still offers FSD as a one-time purchase for $8,000, but Elon Musk has confirmed that this option will be discontinued on February 14, leaving subscriptions as the only way to access the system.
Tesla makes big Full Self-Driving change to reflect future plans
Tesla Model S completes first ever FSD Cannonball Run with zero interventions
