News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
SpaceX is preparing for the 13th integrated flight test of its Starship system, with a targeted launch as early as Thursday, July 16. The 90-minute launch window opens at 5:45 p.m. CT from Starbase in South Texas.
This comes roughly seven weeks after Flight 12 on May 22, underscoring the company’s accelerating pace in its rapid development campaign. The mission will use the latest Starship and Super Heavy V3 vehicles equipped with Raptor 3 engines. Booster 20 will attempt a controlled boostback burn, followed by a splashdown in the Gulf of Mexico, while Ship 40 will follow a suborbital trajectory.
Starship’s thirteenth flight test is preparing to launch as early as Thursday, July 16 → https://t.co/Rp7VwBzpWx pic.twitter.com/jdpFlQUEpF
— SpaceX (@SpaceX) July 11, 2026
Key objectives for Flight 13 will include demonstrating reliable stage separation, engine performance under various conditions, and controlled reentry.
A major milestone for Flight 13 is the first deployment of 20 next-generation Starlink V3 satellites. These satellites feature advanced laser links for inter-satellite communication, deployable solar arrays, and onboard cameras, six of which will capture imagery of Starship’s heat shield during flight.
Several heat shield tiles on Ship 40 will be painted white to serve as imaging targets, while additional experiments test upgraded tiles on aft flaps, modified attachments on the aft skirt, and load-sensing tiles to measure stresses. The upper stage will also attempt a single Raptor engine relight in space before a targeted splashdown in the Indian Ocean.
These tests build directly on lessons from Flight 12, which introduced the V3 configuration but encountered issues including a booster flip anomaly during boostback and an engine-out event on the ship. Hardware and software modifications on Booster 20 and Ship 40 aim to improve engine relight reliability, startup sequencing, and overall robustness.
Next Starship launch aiming for Thursday https://t.co/SajPPd4pdb
— Elon Musk (@elonmusk) July 12, 2026
The short interval between Flights 12 and 13 highlights SpaceX’s iterative approach. Elon Musk has repeatedly emphasized that Starship launches will become “incredibly common” in the coming years.
The company envisions scaling to rates as high as one launch per hour within 4-5 years, potentially enabling thousands of flights annually. Such cadence is essential for Starship’s goals: establishing orbital refueling for lunar and Mars missions, deploying massive satellite constellations, and making life multiplanetary.
With each flight, Starship edges closer to full reusability and operational maturity. Success on July 16 would mark another step toward routine access to space and the ambitious vision of humanity becoming a spacefaring civilization.
Tesla shared a striking video showcasing the decommissioning of the original Model S and Model X assembly line at its Fremont Factory in Northern California. Completed in just 46 days, the teardown involved heavy machinery dismantling concrete pits, removing robotic arms and conveyors, and clearing the space for new production.
The post, captioned “End of an era,” captured both the end of a historic chapter and Tesla’s aggressive pivot toward its next major initiative, Optimus.
End of an era: Decommissioning the original Model S & X assembly line in just 46 days pic.twitter.com/kGEdfhl62h
— Tesla Manufacturing (@gigafactories) July 10, 2026
The decision to retire the Model S and Model X originated during Tesla’s Q4 2025 Earnings Call in late January 2026. CEO Elon Musk announced that production of the company’s flagship sedan and SUV would wind down by the end of Q2 2026, describing it as bringing the programs to an “honorable discharge.”
Custom orders ceased around early April 2026, with the final vehicles rolling off the line in early May. A special signature delivery ceremony on May 20 marked the emotional close for these vehicles, which had defined Tesla’s early success and luxury EV segment since the Model S launch in 2012.
The primary reason for tearing down the lines was to repurpose the valuable factory floor space for high-volume production of Tesla’s Optimus humanoid robot. Musk had indicated on Earnings Calls that the Fremont S/X line would be replaced by a dedicated Optimus manufacturing line targeting a capacity of one million units per year.
This move aligns with Tesla’s broader strategic shift from traditional vehicle manufacturing toward robotics and artificial intelligence, leveraging the company’s expertise in autonomy, AI training, and high-volume production.
Optimus, Tesla’s general-purpose humanoid robot, is designed to perform repetitive or dangerous tasks in factories, warehouses, and eventually homes. Powered by Tesla’s AI and Neural Networks, it aims to be a versatile, affordable platform. Production of Optimus Gen 3 is already underway in limited form at Fremont, with full-scale output on the converted line expected to begin in late July or August.
Tesla is targeting rapid scaling, with internal ambitions pointing toward tens or even hundreds of thousands of units annually by the end of 2026.
Longer-term, Tesla is constructing a much larger second-generation Optimus facility at Giga Texas, with potential capacity reaching millions of units per year. The company views Optimus as a transformative product that could eventually surpass its automotive business in scale and value, enabling widespread deployment of useful robots across industries. CEO Elon Musk has even predicted it would be the most popular product of all-time.
As one era closes at Fremont, another is rapidly taking shape.
Elon Musk posted a candid admission on his social media platform X on June 9, declaring that he had been “clearly wrong” about Anthropic. The statement marked a notable reversal from his earlier skepticism toward the AI company.
In September, Musk had written, “Winning was never in the set of possible outcomes for Anthropic,” reflecting his view at the time that the startup had lacked the foundation or even the trajectory to succeed in what is an incredibly intense race for advanced artificial intelligence.
Musk’s latest post came amid discussion of Anthropic’s reliance on external compute resources. He praised the company’s progress, stating that Anthropic is “obviously currently the leader in AI” and that “no company has released a model as good as Mythos/Fable,” with expectations of a strong follow-up in Mythos 2.
The tone shifted dramatically from dismissal to acknowledgement of superior performance.
I was clearly wrong about Anthropic. They are obviously currently the leader in AI. No company has released a model as good as Mythos/Fable and they will undoubtedly have Mythos 2 ready soon.
And I would never cut them off in a way that hurt them badly, even as a competitor.…
— Elon Musk (@elonmusk) July 9, 2026
The context of Musk’s comments added significance. Anthropic has been operating under a recent compute deal with SpaceXAI, Musk’s AI infrastructure-focused venture. The pair entered a short-term GPU lease agreement initiated in May, providing Anthropic access to critical computing power for training and deploying its frontier models.
SpaceXAI signs agreement with Anthropic for massive AI supercomputer access
Some observers had speculated that Musk could leverage this dependency to disadvantage a rival. Musk directly addressed the possibility, writing, “I would never cut them off in a way that hurt them badly, even as a competitor. That’s not my style.”
To support his commitment to ethical competition, Musk referenced concrete examples from his other companies. Tesla famously open-sourced its entire portfolio of electric vehicle patents in 2014. The move was designed to accelerate the global adoption of sustainable transportation technology rather than protect proprietary advantages.
Tesla also made its Supercharger network available to competing electric vehicle manufacturers, transforming what could have remained an exclusive charging ecosystem into a shared infrastructure that benefits the broader industry and reduces barriers for EV adoption.
Musk further pointed to SpaceX’s practices, noting that the company launches satellites for competing commercial systems “with no increase in price or use of unfair terms.” He extended the principle to his social platform, observing that “even my worst enemies attack me on this platform,” underscoring preference for open discourse over retaliation.
These examples have illustrated Musk’s long-standing philosophy that long-term technological progress is best served by open competition and infrastructure sharing rather than leveraging market power to stifle rivals. In the fast-evolving AI sector, where compute resources and model capabilities determine leadership, Musk’s stance suggests a willingness to compete on innovation and performance alone.
Musk’s admission arrives as SpaceXAI itself advances its own frontier models while maintaining business relationships across the ecosystem. By publicly correcting his earlier assessment and reaffirming principles of fair play, Musk highlights a model of competition that prioritizes advancement of the field over short-term tactical advantages.
SpaceX reveals Starship Flight 13 launch date
Tesla shows rapid teardown of Model S and X lines, paving the way for Optimus at Fremont
