News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
The Boring Company’s latest Tesla tunnel truck mod “fits like a glove”
The Boring Company has modified a Tesla powered tunnel truck to carry freight containers underground.
The Boring Company has found a second job for the Tesla hardware it already runs underground. In a post on X, Elon Musk’s tunneling company showed its latest Prufrock Liner Truck modified to carry a standard 20 foot shipping container. “Using TBC tunnels to transport freight,” the company wrote. “The latest Prufrock Liner Truck (using Tesla Model 3 batteries and drive units) has been modified to carry a standard 20′ shipping container. Fits like a glove!”
The photo shows a red container sitting on a long, low white chassis parked outside, with drive hardware visible at one end. The Boring Company did not say where or when freight hauling would start, which customers it has in mind, or how many trucks it is converting.
Using TBC tunnels to transport freight.
The latest Prufrock Liner Truck (using Tesla Model 3 batteries and drive units) has been modified to carry a standard 20’ shipping container.
Fits like a glove! https://t.co/VV0phWK4fc
— The Boring Company (@boringcompany) October 19, 2026
Until now, the liner trucks have hauled concrete. Teslarati reported in August on Liner Truck 3, which uses Model 3 battery packs and drive units to move more than 22,000 pounds of precast tunnel segments to the boring machine. It has 28 miles of range, tops out at 12 mph, and is piloted remotely from the company’s operations center in Texas. The freight version appears to be the same platform with a different bed, and The Boring Company has not said whether it will also be remotely piloted.
Freight has been on the company’s menu for years. When TBC updated its product lineup in 2021, its freight tunnel was described as sized to fit a standard shipping container, “barely.” The company later used the idea at Tesla’s own factory, where Prufrock 3 dug a tunnel to Giga Texas that now moves finished Cybertrucks away from the production line.
The Boring Company closed a $3 billion Series D in September at a $23 billion valuation, and Teslarati has covered how that money is tied to a UAE tunneling push and a faster Nashville build. In Nashville, Prufrock MB1 and MB2 are mining at the same time, and a third machine is expected to launch in late October. Each machine needs a steady supply of liner trucks, so any design that works for segments and containers alike gives the company more use out of the same Tesla parts.
The Vegas Loop remains the only Boring Company system open to the public, and it moves passengers in Tesla vehicles. A freight service would be a separate product, and the post gave no indication that one is close to launch. For now, it is a truck, a container and a short caption saying they fit together.
Elon Musk said he is planning to give “every one of his SpaceX shares to every kid in America” in 2027, stating that “this will be the first of many.”
SpaceX went public earlier this year, and its stock price has been relatively stable since leveling off shortly after its IPO. Based on its current price, it’s a gift of just over $10 billion to children across the United States.
It appears to be closely related to President Donald Trump’s bank accounts for children, which were set up earlier this year as Trump Accounts.
Just hours earlier, Anthropic had announced the establishment of its Anthropic Public Benefit Fund, “a new wholly-owned entity dedicated entirely to public benefit.” Musk responded by stating he recommended “giving the shares directly to the public,” and that he would be doing it that way.
Just a little bit later, Musk said children across the U.S. would be getting a share from him:
Next year, I will give one of my SpaceX shares to every kid in America.
This will be the first of many.
— Elon Musk (@elonmusk) October 19, 2026
There are roughly 70 million children, meaning someone under the age of 18, in the United States, according to the Federal Interagency Forum on Child and Family Statistics. Musk’s ownership of SpaceX stock shows he has around 849 million Class A shares of SpaceX stock, according to filings with the SEC.
Elon Musk revealed in a post on X that “Permits were impossible to get,” explaining the fate of The Boring Company’s most ambitious East Coast proposal.
The comment responded to a query about what became of his July 20, 2017 announcement that he had “just received verbal govt approval” for an underground Hyperloop connecting New York City, Philadelphia, Baltimore, and Washington, D.C., capable of carrying passengers from the Big Apple to the Nation’s Capital in just 29 minutes.
The Boring Company receives verbal ‘approval’ to build NY to DC Hyperloop tunnel
The 2017 post, which envisioned city-center stations and multiple elevators in each city, sparked immediate scrutiny. Local and state officials in New York, Philadelphia, Baltimore, and D.C. said they had no knowledge of any approval. A White House spokesperson confirmed only “promising conversations” about the transformative infrastructure.
Musk clarified shortly after that there was “still a lot of work” to do for formal approvals.
@cybrtrkguy Permits were impossible to get
— Elon Musk (@elonmusk) October 19, 2026
Limited progress followed, as Maryland Governor Larry Hogan’s administration issued a conditional utility permit and supported work near Fort Meade. In 2018, Washington, D.C., granted a preliminary permit for site preparation and excavation on a vacant lot at 53 New York Ave. NE in the NoMa neighborhood, which The Boring Company said could become a station.
A draft environmental assessment for a D.C.-Baltimore segment was released in 2019. Yet, by April 2021, the company had removed the project from its website, and the Federal Highway Administration reported receiving no indication of further interest. Communication with Maryland officials had ceased.
The full corridor would have required coordination among the District of Columbia, Maryland, Pennsylvania, New York, the Federal Highway Administration, the Army Corps of Engineers, the National Park Service, and other agencies.
Environmental reviews under the National Environmental Policy Act, utility clearances, and approvals for novel infrastructure added to the overall complexity of the project and its approval.
Speculation on the permitting barriers centers around a few factors, but a multi-state, multi-level route involving unproven high-speed vacuum-tube technology inherently triggers exhaustive safety, environmental, and engineering reviews that can stretch for years, even for conventional projects.
There are also other elements, of course, like officials who may face political exposure if a privately funded, untested system encountered anything such as cost overruns, delays, or safety issues. On the outset of this project, there were limited things such as engineering plans or demonstrated technology maturity, which also added to the potential skepticism.
The East Coast vision for Boring Co., once framed as a privately funded revolution that could reshape Northeast travel, quietly ended without construction of the promised network. Musk’s recent statement frames the outcome as a regulatory impasse, unfortunate but not unexpected.
The Boring Company’s latest Tesla tunnel truck mod “fits like a glove”
Elon Musk will give ‘every kid in America’ a SpaceX share in 2027
Elon Musk reveals why Boring Co’s biggest East Coast project never happened
SpaceX reveals how its 1 Million AI satellite network will work and prevent space collisions
Tesla Roadster: Three configs, one can fly, 0-60 in 0.8 seconds
