News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
Elon Musk shuts down talk of TSMC taking over Terafab
Musk says Tesla and SpaceX will build and run Terafab, with TSMC limited to renting.
Elon Musk has drawn a firm line around who will be in charge of Terafab, the giant chip factory Tesla and SpaceX are planning in Texas.
Musk replied to a post on X arguing that Taiwan Semiconductor Manufacturing Company (TSMC) would most likely end up owning and operating the plant. “No, we will build and run the fab. Let there be ZERO doubt about that,” Musk wrote. “Maybe TSMC subleases part of the Terafab if they want, but nothing more than that.”
In plain terms, a sublease means TSMC could rent a section of the complex to make chips, similar to a tenant renting one floor of an office tower. The building, the equipment decisions and the daily operation would stay with Tesla and SpaceX.
@herbertong @thejefflutz No, we will build and run the fab. Let there be ZERO doubt about that.
Maybe TSMC subleases part of the Terafab if they want, but nothing more than that.
— Elon Musk (@elonmusk) October 7, 2026
The comment shuts down speculation that started last week. On October 2, tech journalist Tim Culpan reported that TSMC was exploring ways to help run Terafab’s factories. Musk responded the next day that it was “just discussions, but something may come of it,” as Teslarati reported at the time. That left room for a scenario where the world’s largest contract chipmaker took the wheel. Musk’s latest post closes that door.
Some background helps explain why this matters. Tesla designs its own AI chips today but pays outside companies like TSMC and Samsung to manufacture them. Musk unveiled Terafab in March as a joint project between Tesla, SpaceX and xAI, arguing that existing suppliers cannot expand fast enough to meet his companies’ future demand. The goal is to produce enough chips each year to supply one terawatt of computing power, roughly 50 times what the entire global AI chip industry produces now.
Those chips are meant for Tesla’s Optimus humanoid robots, the Cybercab and Full Self-Driving computers, along with chips for SpaceX’s planned data centers in orbit. Owning the factory means Musk’s companies would not have to compete with every other chip customer for time on someone else’s production lines.
Intel is still part of the picture. The company signed on in April to help design, build and package chips for the project, and CEO Lip-Bu Tan told Bloomberg this week that Intel will keep working on Terafab despite the TSMC chatter.
The project moved from concept to construction planning over the summer. In August, SpaceX confirmed the Grimes County site about an hour from Houston, sent the county a $10 million payment under its tax abatement deal and said civil work would begin shortly. The first phase carries a $16.8 billion price tag, and total spending across all phases could reach as much as $119 billion.
TSMC chairman C.C. Wei has said a new fab typically takes two to three years to build and another one to two years to reach full output. Tesla and SpaceX have never run one, which is why TSMC’s expertise drew so much attention. Musk’s answer suggests he would rather learn that process in house than hand control of a project this central to Tesla’s robotics and autonomy plans to an outside company.
Terafab Texas will be the largest and most valuable building on Earth by far.
And it will be stunningly beautiful. https://t.co/4NweOqTL7y
— Elon Musk (@elonmusk) August 6, 2026
Elon Musk
Trump to hand Elon Musk a top honor that traces back to JFK
Trump will award Elon Musk the National Medal of Science at Thursday’s White House summit.
Elon Musk is set to receive the highest honor the U.S. government gives to scientists and engineers.
President Donald Trump will present Musk with the National Medal of Science on Thursday at the White House’s Science: A New Golden Age Summit, Fox News Digital first reported on Wednesday. Google cofounder Sergey Brin, Nvidia CEO Jensen Huang and AMD CEO Lisa Su will receive the same medal, while Dell Technologies CEO Michael Dell and Microsoft CEO Satya Nadella will receive the National Medal of Technology and Innovation. A White House official later confirmed the list to Reuters.
“The Trump administration is grateful for the contributions of these incredible leaders in science and technology. These recipients are helping ensure America keeps leading the world in innovation,” White House spokesperson Liz Huston told Fox News.
FIRST ON FOX: Trump will award Elon Musk the National Medal of Science at the White House Thursday.
Sergey Brin, Jensen Huang and Lisa Su will also receive the science medal, while Michael Dell and Satya Nadella will receive the technology medal.
It marks Trump’s first time presenting the awards across either administration.
Full story here https://t.co/omnrLV0EwS
— Fox News Politics (@foxnewspolitics) October 7, 2026
It will be the first time Trump has presented either medal in his two terms. Congress created the National Medal of Science in 1959, and the National Science Foundation, which administers it, says 529 scientists and engineers have received it since. A presidential committee reviews nominees, but the president makes the final call.
Thursday’s group of medalists run or founded companies, and three of them sit at the center of the Super Intelligence hardware race that Musk competes in. Huang’s Nvidia supplies the GB300 chips filling SpaceX’s Colossus 2 cluster, while Su’s AMD is Nvidia’s biggest rival in data center GPUs.
Worth noting that Trump’s uncle, MIT physicist John G. Trump, received the National Medal of Science from President Ronald Reagan for his work on ionizing radiation and its uses in medicine and industry.
The Pentagon taps Elon Musk to design the battlefield of the future
For Musk, the medal is the latest sign of how far his relationship with Trump has come since their 2025 split over the “Big Beautiful Bill” and his exit from DOGE. Last week, he sat at Trump’s left during a White House lunch where AI executives signed a voluntary safety accord, and Defense Secretary Pete Hegseth named him to help lead the Pentagon’s Project Meridian study on the future of warfare. Musk has also adopted the administration’s new vocabulary, saying on Sunday that SpaceXAI will be renamed SpaceXSI after Trump ordered federal agencies to replace “artificial intelligence” with “super intelligence.”
Musk has collected science honors before, including the Stephen Hawking Medal for Science Communication in 2019.
Lifestyle
Tesla FSD changed its mind mid-intersection, and it may have saved a life
Tesla shares dashcam footage of FSD Supervised stopping mid intersection to avoid a T-bone crash.
Tesla is putting another Full Self-Driving save in front of its 24.8 million followers on X.
On Tuesday morning, Tesla’s main account shared a dashcam clip with the caption “FSD Supervised preventing T-bone crash.” The footage came from an owner posting as TheNewGrid, who described what happened at a stop sign: “I looked at the car coming to the stop sign figured they would stop, my car went, then came to a stop mid intersection as they flew by. Had I been manually driving this would have resulted in a crash.”
The sequence is the notable part. FSD had already started crossing when the other driver ran the stop sign. Instead of pressing on, the car braked hard in the middle of the intersection and let the crossing vehicle pass in front of it. By the owner’s own account, they had made the same assumption the software initially made, that the other car would stop, and would not have corrected in time.
FSD Supervised preventing T-bone crash
— Tesla (@Tesla) October 6, 2026
The clip is the latest in a run of safety posts Tesla has amplified over the past several days. On Saturday, the company shared a video from Selling Sunset star Jason Oppenheim, who sold his Bentley for a Model Y and said he was buying Teslas with FSD for 10 of his employees. Ashok Elluswamy, who leads Tesla AI, followed up by writing that Tesla self-driving “reacts to other people cutting into your path with super-human response times.” On Monday, a Cybertruck owner posted footage of FSD moving across three lanes from a red light to clear a path for an ambulance approaching from behind.
This recent clip also lands a few weeks after Tesla began shipping Automatic Collision Evasion with FSD v14.3.9, a feature that can activate FSD on the driver’s behalf when a frontal collision is imminent or the driver appears distracted. Elluswamy said in September that “even earlier prediction of hazards, even faster reaction time and overall significantly better safety and collision avoidance” are coming with v15, the release Tesla has tied to round the clock Robotaxi operation.
The safety messaging matters beyond social media. Tesla has said FSD Supervised was 4.1 times less likely to crash than manual driving across 100 million kilometers on European roads, and it has been putting those figures in front of regulators. Eight EU countries have now approved FSD Supervised, with Croatia the most recent, but the EU’s bloc-wide vote originally set for October 6 has been pushed to December at the earliest.
FSD Supervised is still a Level 2 system, and the driver remains responsible at all times. Even heavy users find reasons to step in. Teslarati’s Joey Klender, who uses FSD for about 76 percent of his driving, laid out five recurring issues on Tuesday that still prompt him to intervene. Clips like this one show the other column of that ledger: moments where the software caught a mistake a human was about to make.
Elon Musk shuts down talk of TSMC taking over Terafab
Trump to hand Elon Musk a top honor that traces back to JFK
Tesla FSD changed its mind mid-intersection, and it may have saved a life
The Pentagon taps Elon Musk to design the battlefield of the future
Tesla Roadster’s new patent preps white-knuckle speeds, keeping it grounded
