News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
TESLARATI Premium Membership
$19.99 USD-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla Cybercab is set to launch in Austin, Texas, on September 3, as the company has officially started sending out invitations to a dedicated event it will hold in the city where its headquarters is located.
The Cybercab is Tesla’s dedicated ride-sharing vehicle: it features just two seats and has no steering wheel or pedals. It is aimed at fully autonomous passenger transport, and will operate in the Robotaxi fleet alongside the Tesla Model Y, which has been performing driverless rides for real-world passengers for more than a year.
Thank you so much @Tesla for inviting us to the Cybercab launch in Austin! 🤠 pic.twitter.com/F1rAR8zd5O
— TESLARATI (@Teslarati) August 22, 2026
The launch of the Cybercab marks the next chapter in Tesla’s autonomy story. The company has been developing autonomous transport for years with its Full Self-Driving (Supervised) platform, which is available in any vehicle the company has built with the proper hardware and software capabilities.
Its capabilities vary by hardware and software version, but Tesla says its latest hardware version, known as AI4, can deliver full autonomy. However, future vehicles will operate with even more robust hardware packages, as Tesla will develop AI4.5 and AI5 for even more capability in its vehicles.
Following a report from The Information that surfaced earlier this week, the writing was on the wall that Tesla was set to launch Cybercab in the near term. The report stated Tesla could launch Cybercab as soon as the end of August. Tesla came close and has booked it for September 3.
The big thing with this event being scheduled is not necessarily that Tesla is launching a new vehicle, but instead that it is launching a vehicle that has no steering wheel or pedals and will operate exclusively on a self-driving program that is evidently nearing full autonomy. If the event allows vehicles to take passengers on public roads and drop them off wherever they please within the City of Austin, it will be a drastic advancement in the company’s self-driving story.
People have ridden in Cybercab previously: Tesla had the “We, Robot” event in October 2024, which allowed people to experience fully autonomous rides in a closed circuit at Warner Bros. Studios in Burbank.
🚨 Ride in a Tesla Cybercab with us
— TESLARATI (@Teslarati) May 11, 2025
Additionally, Tesla launched employee rides in Cybercab in July.
It’s a drastic step forward for Tesla, whose CEO, Elon Musk, has promised for years that the company would release a fully autonomous vehicle and platform capable of allowing drivers to relinquish any responsibility behind the wheel.
Elon Musk put a number on where he thinks SpaceX’s Starship program is headed by 2030, replying on X a day after President Trump signed a memo pushing the country toward 1,000 space launches and reentries a year.
The exchange started when Aaron Burnett, co-founder of propulsion startup Mach 33, posted that “1,000 launches/reentries is the goal,” quoting White House science adviser Michael Kratsios on the newly signed National Space Transportation Policy. Burnett noted that the FAA’s own bull-case forecast reached only 385 annual launches by 2030, while his firm’s conservative model already put SpaceX alone near 940. Musk responded, “We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized. Still tiny numbers compared to airplane flights!”
We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized.
Still tiny numbers compared to airplane flights!
— Elon Musk (@elonmusk) August 21, 2026
That figure is specific to Starship, the rocket SpaceX is still developing for orbital and lunar missions, not the Falcon 9 fleet that carries most of the company’s current launch volume. Starship has flown twice this year, a slower pace than the four and five flights SpaceX managed in 2024 and 2025. Getting from two flights a year to 30 a day is the scale of jump the new federal policy is meant to clear regulatory room for.
Trump’s memo, signed Thursday, directs agencies to identify new launch and reentry sites on federal land, including a new reentry site within 90 days, and to speed up the permitting and environmental reviews that have long slowed cadence growth. It also sets a goal of returning American astronauts to the moon by 2028 and placing initial lunar base elements by 2030, tying the launch buildout directly to NASA’s Artemis program.
SpaceX has already been pushing the FAA toward higher numbers on its own. The agency approved up to 44 annual Starship launches from Kennedy Space Center in February, on top of a 2024 review that raised the cap at Starbase in Texas to 25 a year. Those approvals cover a fraction of the 10,000 annual flights Musk is now describing, which shows how far current permitting still sits from the administration’s stated target.
The near-term test of all this is more modest. SpaceX cleared a full-duration, six-engine static fire on its next Starship vehicle this week, the last major hardware checkpoint before Flight 14, which is targeting no earlier than August 28 and is expected to attempt the vehicle’s first full orbital mission. Musk said last week that a tower catch of the upper stage is still probably months away, a reminder that the immediate roadmap remains far more incremental than the daily launch numbers he just posted.
Tesla will resolve its massive recall of nearly three million vehicles in China with stickers and a software update.
On Friday, Chinese regulators filed recall plans against Tesla, Xiaomi, Leapmotor, Xpeng, Chery, Geely, Dongfeng, Arcfox, and FAW to resolve what is essentially a carbon-copy issue throughout each of the companies’ vehicle models: emergency door release latches are simply not visible enough.
Tesla door handle saga gets its latest chapter and a big change is coming
The companies will be required to add things that will make these latches, which will open the door in the event of an emergency, more visible. Of the 7 million vehicles impacted, Tesla accounts for 2,975,910 units. More than 1.9 million of those are Model Y vehicles, with the rest, just over 970,000, being Model 3s.
To resolve the issue, Tesla is going to add warning labels to the emergency latches free of charge, and then utilize an Over-the-Air update to add a post-crash window-lowering strategy, according to CNEVpost.
This massive effort to fix the all-electric Model Y and Model 3’s emergency latch system comes just months after several probes across various markets identified the trouble some had identifying this latch. Those who had gotten involved in car accidents that stripped the vehicle of its power were not aware that every Tesla has emergency door latches.
China’s State Administration for Market Regulation (SAMR) said that severe crashes that disable a vehicle’s low-voltage system could not only hinder occupants from getting out, but also make it more difficult for emergency response workers to gain entry.
SAMR is starting to tighten the regulations it has on door handles on vehicles. A new mandatory national standard will take effect for all models starting January 1, 2027, and will require all doors to be equipped with mechanical release mechanisms. This will effectively end purely electronic door handles. Models already on sale with type approval have been granted a two-year transition period, which will enable things to change until January 2029.
Tesla will launch Cybercab on September 3
SpaceX and a new Trump order that could rewrite the next decade of launches
