News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
News
SpaceX’s Gwynne Shotwell just made a quiet gesture toward Tesla
SpaceX president Gwynne Shotwell quietly followed Tesla on X, and merger watchers noticed right away.
SpaceX President and COO Gwynne Shotwell has started following Tesla’s official account on X, a small change that landed in the middle of a very loud merger conversation. Whole Mars Catalog joked about it on Sunday.
A follow is not an announcement, and neither company has said anything about a deal. What gives the moment weight is the timing. Barclays analyst Dan Levy has told clients that an agreement could come before Tesla’s annual meeting, which must be held by December 6, with SpaceX as the buyer in an all stock deal, as we reported after the Roadster unveiling. Wedbush’s Dan Ives has stuck with a 2027 timeline.
“Shit, I better start following their X account if i’m gonna be helping run the company”
— Whole Mars Catalog (@wholemars) October 18, 2026
Shotwell is the executive most worth watching if the two companies do move closer. When Musk was asked at the All In Summit why Tesla and SpaceX remain separate, Shotwell sat next to him and said SpaceX personnel had already moved into xAI to fill leadership and engineering gaps. The businesses were integrating “faster than I thought,” she said, though “not fully integrated yet.” Her responsibilities have also grown since SpaceX absorbed xAI, and she now oversees operations that include Grok and the company’s AI compute buildout.
The financial links are already there. Tesla’s $2 billion xAI investment turned into a stake of less than one percent in SpaceX, the two share the Terafab chip project in Austin, and Musk exercised his 2018 Tesla options a week after SpaceX began trading, a sequence analysts flagged as giving SpaceX public shares to use in a deal. Musk holds about 20 percent of Tesla and controls 85.1 percent of SpaceX’s voting power, according to our earlier breakdown.
The next test is close at hand. SpaceX reports its second earnings as a public company on Tuesday after the close, and Tesla follows on Wednesday. Musk told analysts in July that “we can’t talk about combining companies and that kind of thing on an earnings call,” so a direct answer is unlikely from either stage. Tesla shareholders can still submit and vote on questions through the Say portal until 4 p.m. EDT on Monday, and the merger is a recurring theme in the queue.
Elon Musk
Tesla Roadster owners to get “Flying Stunt Mode” and looping track access
Musk says Roadster owners can command the unveiling stunts autonomously, with a Texas looping track.
Elon Musk says owners of the new Tesla Roadster will be able to ask the car to perform the stunts Tesla showed at its unveiling, with the car doing the driving itself. Musk made the comment Saturday in a reply on X to tech blogger Robert Scoble, and he added a promise of a looping track at Tesla’s Texas headquarters.
Scoble had argued that the person in the Roadster is not really driving it. In his description, the driver operates a computer that tells another computer what to do, with steering, braking and acceleration all handled by wire. Musk answered, “True. You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient. Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.”
@Scobleizer True.
You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient.
Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.
— Elon Musk (@elonmusk) October 17, 2026
At the October 15 event outside Waco, the car drove up a curved ramp until it was upside down, flew off on cold gas thrusters, flipped and landed. It also hovered over a Cybercab, Cybertruck, Semi, Model Y and Model 3 while moving. As we noted in our breakdown of the three Roadster configurations, Musk said at the event that the car “literally is just going to puff itself up” to perform the maneuvers whenever an owner wants. Saturday’s reply adds that the car would run them on its own.
Tesla has described some of the hardware that would make that possible. The Roadster uses steer by wire with a yoke, and its cold gas thrusters rely on electric actuators for small adjustments in flight. A fan system under the car creates suction, which Tesla says is strong enough to hold it upside down, a setup we covered in our look at the Roadster’s fan system and thrusters.
Musk did not say when an autonomous stunt feature might arrive, how it would work, or what he means by sentient. He also gave no size, location or opening date for the Texas track. Production is planned for Giga Texas in 2027 or 2028, and Tesla says the car is not approved for public road use. The Rocket version, the one built to fly, is invite only.
The comment follows a week of Musk teasing the event, including his claim that the demo would be a banger, which we covered before the stream. Tesla reports third quarter earnings on October 21, and shareholders can submit and vote on questions through the Say portal until 4 p.m. EDT on October 20, according to our earnings Q&A preview. A question about autonomous Roadster stunts and the Texas track would be a quick way to get specifics from management.
Elon Musk
How to use Grok Bot to block spam calls and texts
Musk told users to ask Grok Bot to scrub their phone numbers from spam lists.
Elon Musk has a new use case for Grok Bot, and it is the spam call. On Thursday he replied to an X user named Arash with a short instruction: “Ask your @Grok @Bot to remove your phone number from spam call & text lists!” Arash had said he got tired of the calls, had an AI bot find his number on listing sites and file removal requests, and packaged the process as a free skill for others.
The skill is called Spam-Call Scrubber, which is described to find a phone number on people search sites and data brokers, submits the opt outs, completes the confirmation emails those sites send back, and rechecks on a schedule the user picks. Using it requires the Grok Bot app. The pitch is time saved, since most broker opt outs sit behind separate forms on separate sites.
Ask your @Grok @Bot to remove your phone number from spam call & text lists!
— Elon Musk (@elonmusk) October 15, 2026
Musk said Grok Bot now gives each bot its own email address, and that it can detect scam emails. On Thursday he also said SpaceX would make users whole if the bot botches a purchase or leaks a card, then told users to shop away from Amazon after the retailer blocked the agent, as Teslarati reported. The terms of service we reviewed at the time put responsibility for what an agent does on the user.
For Tesla owners, Grok Bot is not just a phone app. Tesla brought Grok Bot into its vehicles on September 22, and we argued earlier this week that the Cybercab’s real advantage may be the errands it runs during a ride. Every Cybercab and the rest of the Model Y Robotaxi fleet has it enabled. The more routine tasks like this one become, the more a rider has reason to hand over something personal in the back seat.
The new Spam-Call Scrubber skill can be downloaded for free and works on sites that honor removal requests, while noting that listings can reappear, and illegal robocallers do not check any registry. Whether Spam-Call Scrubber cuts anyone’s call volume is something the first wave of users will find out, and Musk’s endorsement guarantees that wave is coming.
SpaceX’s Gwynne Shotwell just made a quiet gesture toward Tesla
Tesla Roadster owners to get “Flying Stunt Mode” and looping track access
How to use Grok Bot to block spam calls and texts
SpaceX reveals how its 1 Million AI satellite network will work and prevent space collisions
Tesla Roadster: Three configs, one can fly, 0-60 in 0.8 seconds
