News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
Elon Musk just set a condition that could end Falcon 9 as we know it
Elon Musk says SpaceX will finally retire Falcon 9 once Starship flies reliably every week.
Elon Musk gave the clearest timeline yet for retiring Falcon 9, SpaceX’s workhorse rocket.
The comment came in a reply on X, where Musk wrote that “once Starship is flying reliably several times per week, it makes sense to shift super scarce SpaceX engineering and production resources to Starship to get launch rate to several times per day, which means winding down Falcon.” He was responding to physicist Casey Handmer, who noted that NASA is reportedly uneasy about SpaceX phasing out Falcon after building what Handmer called the most successful launcher ever, with the fleet nearing 1,000 total launches.
Now @SciGuySpace reports NASA is in a tizzy because after running the most successful launcher ever for more than a decade and nearing 1000 launches, @SpaceX is planning to retire Falcon in favor of Starship in a few years.
Sorry, NASA, you’ve had 15 years to burn down the… https://t.co/uCNoMwK0v9
— Casey Handmer (@CJHandmer) August 22, 2026
Falcon 9 is still SpaceX’s busiest vehicle by far. The company is on pace for roughly 140 to 145 Falcon flights this year, following 165 in 2025, president Gwynne Shotwell told Time earlier in 2026. She has already said Falcon flights would “tail off” as Starship comes online, while reports indicate that SpaceX has stopped booking new Falcon 9 launches past 2028 and halted production of some expendable Falcon hardware, according to Bloomberg.
It’s worth noting that Musk’s post is a condition, and not a countdown on when Falcon will retire. Starship has not yet flown weekly, let alone daily. Its most recent flight in July ended with a soft splashdown in the Indian Ocean, a milestone Musk pointed to earlier this month when he said the vehicle’s heat shield problem was effectively solved. SpaceX towed that ship to Christmas Island for inspection, and the next flight, Flight 14, is aimed at putting Starship into orbit for the first time. A tower catch attempt for the upper stage has been pushed back to what Musk has called “a few months” away.
SpaceX and a new Trump order that could rewrite the next decade of launches
The gap between Falcon’s role today and Starship’s promised role tomorrow matters most to NASA. Falcon and its Dragon capsule remain the only way the agency rotates astronauts to and from the International Space Station, and Starship is not certified to carry NASA crews. Musk’s post did not address how that handoff would work if Falcon winds down before a crew-rated Starship variant exists. The timing lines up with Musk’s other recent Starship comments. Two days before the Falcon post, he told a different X user that SpaceX is aiming for more than 30 Starship launches a day by 2030, or roughly 10,000 a year, a figure tied to the Trump administration’s new push for higher national launch cadence. Falcon, which took over a decade to reach its first 100 launches, was never built to approach that kind of volume.
For now, Falcon 9 keeps flying at a near-record pace while Starship works to prove it can do the job Musk has already picked out for it.
Tesla Cybercab is set to launch in Austin, Texas, on September 3, as the company has officially started sending out invitations to a dedicated event it will hold in the city where its headquarters is located.
The Cybercab is Tesla’s dedicated ride-sharing vehicle: it features just two seats and has no steering wheel or pedals. It is aimed at fully autonomous passenger transport, and will operate in the Robotaxi fleet alongside the Tesla Model Y, which has been performing driverless rides for real-world passengers for more than a year.
Thank you so much @Tesla for inviting us to the Cybercab launch in Austin! 🤠 pic.twitter.com/F1rAR8zd5O
— TESLARATI (@Teslarati) August 22, 2026
The launch of the Cybercab marks the next chapter in Tesla’s autonomy story. The company has been developing autonomous transport for years with its Full Self-Driving (Supervised) platform, which is available in any vehicle the company has built with the proper hardware and software capabilities.
Its capabilities vary by hardware and software version, but Tesla says its latest hardware version, known as AI4, can deliver full autonomy. However, future vehicles will operate with even more robust hardware packages, as Tesla will develop AI4.5 and AI5 for even more capability in its vehicles.
Following a report from The Information that surfaced earlier this week, the writing was on the wall that Tesla was set to launch Cybercab in the near term. The report stated Tesla could launch Cybercab as soon as the end of August. Tesla came close and has booked it for September 3.
The big thing with this event being scheduled is not necessarily that Tesla is launching a new vehicle, but instead that it is launching a vehicle that has no steering wheel or pedals and will operate exclusively on a self-driving program that is evidently nearing full autonomy. If the event allows vehicles to take passengers on public roads and drop them off wherever they please within the City of Austin, it will be a drastic advancement in the company’s self-driving story.
People have ridden in Cybercab previously: Tesla had the “We, Robot” event in October 2024, which allowed people to experience fully autonomous rides in a closed circuit at Warner Bros. Studios in Burbank.
🚨 Ride in a Tesla Cybercab with us
— TESLARATI (@Teslarati) May 11, 2025
Additionally, Tesla launched employee rides in Cybercab in July.
It’s a drastic step forward for Tesla, whose CEO, Elon Musk, has promised for years that the company would release a fully autonomous vehicle and platform capable of allowing drivers to relinquish any responsibility behind the wheel.
Elon Musk put a number on where he thinks SpaceX’s Starship program is headed by 2030, replying on X a day after President Trump signed a memo pushing the country toward 1,000 space launches and reentries a year.
The exchange started when Aaron Burnett, co-founder of propulsion startup Mach 33, posted that “1,000 launches/reentries is the goal,” quoting White House science adviser Michael Kratsios on the newly signed National Space Transportation Policy. Burnett noted that the FAA’s own bull-case forecast reached only 385 annual launches by 2030, while his firm’s conservative model already put SpaceX alone near 940. Musk responded, “We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized. Still tiny numbers compared to airplane flights!”
We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized.
Still tiny numbers compared to airplane flights!
— Elon Musk (@elonmusk) August 21, 2026
That figure is specific to Starship, the rocket SpaceX is still developing for orbital and lunar missions, not the Falcon 9 fleet that carries most of the company’s current launch volume. Starship has flown twice this year, a slower pace than the four and five flights SpaceX managed in 2024 and 2025. Getting from two flights a year to 30 a day is the scale of jump the new federal policy is meant to clear regulatory room for.
Trump’s memo, signed Thursday, directs agencies to identify new launch and reentry sites on federal land, including a new reentry site within 90 days, and to speed up the permitting and environmental reviews that have long slowed cadence growth. It also sets a goal of returning American astronauts to the moon by 2028 and placing initial lunar base elements by 2030, tying the launch buildout directly to NASA’s Artemis program.
SpaceX has already been pushing the FAA toward higher numbers on its own. The agency approved up to 44 annual Starship launches from Kennedy Space Center in February, on top of a 2024 review that raised the cap at Starbase in Texas to 25 a year. Those approvals cover a fraction of the 10,000 annual flights Musk is now describing, which shows how far current permitting still sits from the administration’s stated target.
The near-term test of all this is more modest. SpaceX cleared a full-duration, six-engine static fire on its next Starship vehicle this week, the last major hardware checkpoint before Flight 14, which is targeting no earlier than August 28 and is expected to attempt the vehicle’s first full orbital mission. Musk said last week that a tower catch of the upper stage is still probably months away, a reminder that the immediate roadmap remains far more incremental than the daily launch numbers he just posted.
Elon Musk just set a condition that could end Falcon 9 as we know it
Tesla will launch Cybercab on September 3
