News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.

When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Investor's Corner
SpaceX’s biggest earnings test yet lands Tuesday, and Tesla shareholders should be watching
SpaceX reports earnings Tuesday as Wall Street watches AI spending, Starlink growth and Tesla merger
SpaceX reports third quarter results after the market closes Tuesday, with a webcast at 4:30 p.m. ET streamed on X, and Tesla follows a day later. Bloomberg consensus, cited by Pepperstone, calls for revenue of $12.89 billion, adjusted EBITDA of $6.62 billion and adjusted EPS near $0.15. That would be about 65% growth from the second quarter and SpaceX’s first profitable quarter since its IPO. Analysts expect roughly $6.4 billion from AI and $4.9 billion from Starlink, which is projected to reach 14.3 million consumer subscribers. Capital spending is forecast at $19.6 billion, leaving free cash flow near negative $11.6 billion.
The numbers matter because SpaceX has spent months trying to win over a skeptical market. It priced its record IPO at $135, spiked to $225.64, then sank near $105 in early August. Friday’s close of $146.03 sits about 28% below the June high. The Q2 report beat on revenue at $7.8 billion and put Starlink at 12 million subscribers, but $18.4 billion of capex hurt the stock. Since then SpaceX reached orbit on Starship Flight 14 with 26 Starlink V3 satellites, agreed to buy 800 MHz spectrum for about $8 billion as part of its Starlink Mobile push, and signed a fourth compute hosting deal in four months worth roughly $13 billion a year from December. Management is targeting more than 2 gigawatts of compute by year end and a $100 billion annualized revenue run rate. Evercore ISI, which raised its target to $275, said the quarter may be judged more on those targets than the reported figures
All of this sits under the Tesla merger question. Barclays analyst Dan Levy expects an all stock deal in which SpaceX buys Tesla at a premium, using reference values of $2.1 trillion and $1.5 trillion, and said an announcement would need to come by late October or early November to be voted on at Tesla’s December 6 annual meeting. Barclays estimates Musk would hold about 37% of the combined company and 56% of the votes. Musk said in July that combining companies cannot be discussed on an earnings call, but an investor question asking when SpaceX will merge with Tesla is sitting on SpaceX’s Q&A platform, and Teslarati has tracked how the Roadster demo revived the talk.
If a deal happens, Tuesday’s result would effectively set the price Tesla holders would receive. Their shares would convert into SpaceX stock, along with exposure to a company with a heavy investment on AI, while Tesla itself expects 2026 capex above $25 billion. A strong quarter and calmer spending would make that exchange easier to sell. Another round of heavy capex and a falling stock would make it harder.
News
SpaceX’s Gwynne Shotwell just made a quiet gesture toward Tesla
SpaceX president Gwynne Shotwell quietly followed Tesla on X, and merger watchers noticed right away.
SpaceX President and COO Gwynne Shotwell has started following Tesla’s official account on X, a small change that landed in the middle of a very loud merger conversation. Whole Mars Catalog joked about it on Sunday.
A follow is not an announcement, and neither company has said anything about a deal. What gives the moment weight is the timing. Barclays analyst Dan Levy has told clients that an agreement could come before Tesla’s annual meeting, which must be held by December 6, with SpaceX as the buyer in an all stock deal, as we reported after the Roadster unveiling. Wedbush’s Dan Ives has stuck with a 2027 timeline.
“Shit, I better start following their X account if i’m gonna be helping run the company”
— Whole Mars Catalog (@wholemars) October 18, 2026
Shotwell is the executive most worth watching if the two companies do move closer. When Musk was asked at the All In Summit why Tesla and SpaceX remain separate, Shotwell sat next to him and said SpaceX personnel had already moved into xAI to fill leadership and engineering gaps. The businesses were integrating “faster than I thought,” she said, though “not fully integrated yet.” Her responsibilities have also grown since SpaceX absorbed xAI, and she now oversees operations that include Grok and the company’s AI compute buildout.
The financial links are already there. Tesla’s $2 billion xAI investment turned into a stake of less than one percent in SpaceX, the two share the Terafab chip project in Austin, and Musk exercised his 2018 Tesla options a week after SpaceX began trading, a sequence analysts flagged as giving SpaceX public shares to use in a deal. Musk holds about 20 percent of Tesla and controls 85.1 percent of SpaceX’s voting power, according to our earlier breakdown.
The next test is close at hand. SpaceX reports its second earnings as a public company on Tuesday after the close, and Tesla follows on Wednesday. Musk told analysts in July that “we can’t talk about combining companies and that kind of thing on an earnings call,” so a direct answer is unlikely from either stage. Tesla shareholders can still submit and vote on questions through the Say portal until 4 p.m. EDT on Monday, and the merger is a recurring theme in the queue.
Elon Musk
Tesla Roadster owners to get “Flying Stunt Mode” and looping track access
Musk says Roadster owners can command the unveiling stunts autonomously, with a Texas looping track.
Elon Musk says owners of the new Tesla Roadster will be able to ask the car to perform the stunts Tesla showed at its unveiling, with the car doing the driving itself. Musk made the comment Saturday in a reply on X to tech blogger Robert Scoble, and he added a promise of a looping track at Tesla’s Texas headquarters.
Scoble had argued that the person in the Roadster is not really driving it. In his description, the driver operates a computer that tells another computer what to do, with steering, braking and acceleration all handled by wire. Musk answered, “True. You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient. Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.”
@Scobleizer True.
You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient.
Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.
— Elon Musk (@elonmusk) October 17, 2026
At the October 15 event outside Waco, the car drove up a curved ramp until it was upside down, flew off on cold gas thrusters, flipped and landed. It also hovered over a Cybercab, Cybertruck, Semi, Model Y and Model 3 while moving. As we noted in our breakdown of the three Roadster configurations, Musk said at the event that the car “literally is just going to puff itself up” to perform the maneuvers whenever an owner wants. Saturday’s reply adds that the car would run them on its own.
Tesla has described some of the hardware that would make that possible. The Roadster uses steer by wire with a yoke, and its cold gas thrusters rely on electric actuators for small adjustments in flight. A fan system under the car creates suction, which Tesla says is strong enough to hold it upside down, a setup we covered in our look at the Roadster’s fan system and thrusters.
Musk did not say when an autonomous stunt feature might arrive, how it would work, or what he means by sentient. He also gave no size, location or opening date for the Texas track. Production is planned for Giga Texas in 2027 or 2028, and Tesla says the car is not approved for public road use. The Rocket version, the one built to fly, is invite only.
The comment follows a week of Musk teasing the event, including his claim that the demo would be a banger, which we covered before the stream. Tesla reports third quarter earnings on October 21, and shareholders can submit and vote on questions through the Say portal until 4 p.m. EDT on October 20, according to our earnings Q&A preview. A question about autonomous Roadster stunts and the Texas track would be a quick way to get specifics from management.

