News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla CEO Elon Musk posted a photo of himself standing with the Optimus production team inside Tesla’s Fremont factory, arms crossed amid workers in hard hats and safety vests. The image captures a pivotal industrial shift: the same facility space once dedicated to building Tesla’s flagship Model S sedan and Model X SUV is now home to the company’s humanoid robot manufacturing line.
Walking the Optimus production line in Fremont pic.twitter.com/ABS0tuRibW
— Elon Musk (@elonmusk) July 1, 2026
Tesla’s Fremont Factory, acquired in 2010 from the former NUMMI joint venture between Toyota and GM, has been the company’s original U.S. manufacturing hub since Model S production began in 2012.
The Model X followed soon thereafter. These premium vehicles offered lower annual volumes, recently around 30,000 combined, compared to the high-volume Model 3 and Model Y lines that continue around the site. Over their combined run, the S and X accounted for roughly 610,000 units.
In late January 2026, during Tesla’s Q4 2025 earnings call, Elon Musk announced the end of Model S and Model X production in Q2 2026. The final vehicles rolled off the line in early May. Rather than retooling for another vehicle, Tesla chose to convert the dedicated S/X assembly area into a dedicated Optimus Gen 3 production line.
Model 3 and Y manufacturing remains unaffected. Tesla’s official Fremont Factory page now lists Optimus alongside the 3 and Y as core products.
The conversion was executed with remarkable speed. After production stopped, crews dismantled the existing vehicle line and installed entirely new modular equipment—including lines sourced from Germany and dozens of sub-lines for actuators, batteries, and other components—in roughly four months.
Musk described the timeline as “insanely fast,” noting it would be unprecedented for any other manufacturer. Initial Optimus output is expected to ramp slowly due to the robot’s roughly 10,000 unique parts and the brand-new production processes involved. The Fremont line targets an eventual capacity of 1 million Optimus units per year.
Tesla isn’t joking about building Optimus at an industrial scale: Here we go
Optimus Development Timeline
- August 19, 2021: Optimus (then called Tesla Bot) formally announced at Tesla’s first AI Day. A concept video showed a person in a suit demonstrating the vision for a general-purpose humanoid capable of dangerous, repetitive, or boring tasks using the same AI architecture as Full Self-Driving.
- 2022: Early prototypes displayed. At the second AI Day in September, semi-functional units demonstrated walking across a stage and basic arm movements
- 2023: September videos showed improved capabilities, including sorting colored blocks, precise limb awareness, and holding a Yoda pose.
- 2024-early 2025: Factory integration videos showed Optimus navigating workspaces and handling objects like battery cells.
- January 2026: Gen 3 mass-production activities began at Fremont, with reports of over 1,000 Gen 3 units already operating inside the factory for real-world learning and AI training
- April 2026: Musk confirms Optimus production on converted Fremont line would begin in late July or August 2026. The Gen 3 reveal, originally eyed for Q1, was pushed closer to production start. A second, much larger Optimus factory at Giga Texas is under construction, with volume production targeted for Summer 2027 and long-term capacity of 10 million units annually
- July 1, 2026: Musk’s on-site visit and team photo confirm the Optimus line is operational and the transition is actively progressing
Tesla positions Optimus as potentially its largest project ever, leveraging vertical integration, AI expertise, and car-like manufacturing know-how to scale humanoid robots first for its own factories and later for broader industrial and consumer use.
The Fremont conversion serves as a critical proving ground for this ambitious new chapter in Tesla’s already-rich history.
Investor's Corner
Tesla gets its latest short from Michael Burry: ‘Happy it jumped back to this level’
Tesla short seller Michael Burry, the subject of the film “The Big Short,” where he was portrayed by Steve Carell, has revealed he has opened a new bet against the stock.
In a new update to his Substack newsletter in a post titled “Trading Post June 30, 2026,” Burry revealed a new set of bets against Tesla, Caterpillar, NVIDIA, Applied Materials Inc., and the iShares Semiconductor ETF.
In regard to Tesla, Burry wrote:
“And finally I shorted Tesla at 416.22. Happy it jumped back to this level.”
This means Burry likely opened his new short position after the company’s recent rally on Wall Street, which saw Tesla shares sink in mid-May, only to recover to well over the $400 mark. Currently, shares trade at around $427.
The company saw a big Tuesday as shares climbed considerably, over 10 percent. The size of the Tesla short was not provided, nor did Burry give any information on the position’s structure, the number of shares, dollar value, or whether options were used in the short.
The Tesla and SpaceX merger everyone is talking about is quietly building
Over the years, Burry has been one of the more vocal critics of Tesla, calling its share price “media inflated,” and saying it was “ridiculously overvalued” as recently as December.
The company has largely transitioned away from being known as an automotive company and instead is much more widely regarded as an AI play, mostly due to its Full Self-Driving efforts, Optimus robot development, and data collection related to both.
This has not pulled those skeptics away from being vocal about their distaste for how Tesla is valued, but there’s no denying that the company is a global force in many things, including sustainable energy, automotive, and AI.
Wedbush Securities is initiating stock coverage on SpaceX (NASDAQ: SPCX), marking the first comments on the company since it went public several weeks ago. Wedbush and its analyst handling coverage, Dan Ives, are widely bullish on fellow Musk company Tesla (NASDAQ: TSLA).
Ives wrote his first note initiating coverage of SpaceX shares on Wednesday with a $190 price target and an ‘Outperform’ rating. The firm believes the company is well positioned off of its IPO because of its wide array of projects, including AI compute power and infrastructure, connectivity projects, and launches.
“We view SpaceX as one of the most differentiated assets within the tech market with a strong footprint across its three core markets, with Starlink driving success with connectivity,” Ives wrote, “Starship launches leading to a demand flywheel and increasing deal flow for its Colossus clusters.”
Elon Musk called it Epic: The full story of SpaceX’s Starship Flight 12
Wedbush leans heavily on Starlink, which they say is the “profitability driver given the strength of its recurring revenue base of ~12 million subscribers as of June 5th.” Ives believes Starlink is still in the “early innings” of penetrating the global telecommunications and broadband market, as it only holds less than a 1 percent share. However, this number is sure to increase over time.
It also highlights the importance of Starship, which it says is an “essential layer” of SpaceX’s overall success. SpaceX developing and displaying the ability to reuse rockets is a major cost and reliability advantage “as it reduces the necessary hardware launch costs while generating a feedback loop for future flights to improve their launch flight rate without accelerating capex spend.”
Finally, SpaceX’s recent AI/Compute projects are also very elementary, Ives writes. It is worth mentioning Wedbush said its $190 price target is derived from a valuation forecast that sees the company yielding roughly $2.48 trillion of implied enterprise value.
There are also some factors that Wedbush did not take into account with its initial coverage. The firm wrote in the note:
“We note that there is optional value coming from Starship’s accelerating scale towards sub-$200/kg unit economics, orbital data centers, and enterprise AI monetization as these factors could drive meaningful upside but these face major hurdles, so we do not take that into account with our valuation.”
SpaceX shares are down just over 2 percent today, trading at around $167 at the time of publication.
Tesla Optimus project fires up as Musk sees production line progress
Tesla gets its latest short from Michael Burry: ‘Happy it jumped back to this level’
