News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
The Tesla Semi is entering a new Pilot Program with Paper Transport, LLC (PTI), a Wisconsin-based transportation provider. The company will test the Semi’s Long Range configuration through “dedicated operations within the Chicago market.”
Chicago presents an interesting challenge for the Semi, as it will be a colder-weather climate that will test the Semi’s ability to operate in lower temperatures and in potentially large accumulations of snow. This is something Tesla has been testing with the Semi in Alaska and even in Northern California during the colder months, but Chicago will present a truly tough midwestern winter.
Tesla Semi spotted on journey home after winter performance testing
PTI says it is using the Semi to evaluate its strategy of reducing transportation emissions while maintaining performance, reliability, and cost efficiency. These are major arguments for the Semi being introduced into new fleets.
CEO of PTI Tyler Ellison said:
“PTI has been a leader in sustainable transportation solutions for over 15 years. We take a consultative approach to helping customers identify and implement the right transportation solution for their network. Our partnership with Tesla expands our portfolio alongside renewable natural gas and intermodal, giving customers more ways to reduce Scope 3 emissions without compromising service or economics.”
PTI is far from the first company to adopt the Semi within a fleet, as Tesla entered strategic agreements with PepsiCo. and its subsidiary Frito-Lay for a Pilot Program that extended throughout the California region.
Tesla has let companies like those utilize the Semi to determine whether it would be suitable for their operations. Additionally, Tesla gets valuable information regarding the Semi’s performance, knowing what to improve and what is ideal for companies that will utilize the all-electric truck for regional and nationwide logistics.
PTI plans to utilize the Long Range configuration, which is priced at $290,000 and features a range of approximately 500 miles, a three-motor powertrain, up to 800 kW of drive power, and consumption of just 1.7 kWh per mile.
Tesla Semi pricing revealed after company uncovers trim levels
VP of Maintenance at PTI, Bryan Ellen, added:
“We are excited to partner with Tesla, leveraging their ever-evolving technology. We are bullish in our estimation of the parallels available between our dedicated model and the efficiency of their fully electric Class 8 tractor. We anticipate a growing synergy between our businesses as we work to facilitate this sustainable solution for our customers.”
PTI has logged more than 87 million miles using sources like compressed and renewable gas, but now is looking to take it a step further with fully electric operations.
Tesla revealed on Monday that it is building a new autonomous vehicle at Gigafactory Texas, its plant just outside of the City of Austin. This particular vehicle will be geared toward those who are in need of a wheelchair-accessible car that would require no human driver for operation.
According to a new report from Wired, Tesla’s Senior Policy Advisor, India Herdman, told members of the Washington D.C. City Council on Monday:
“We are in development for a purpose-built, wheelchair-accessible autonomous vehicle. We know that paratransit can be very difficult, and people who are confined to wheelchairs permanently should still be able to move around freely, so that is an active product being built by Tesla in Texas.”
This builds upon what CEO Elon Musk said last year on X, which confirmed the company was working on accessible rides within its Robotaxi platform, which currently is confined to the Model Y.
Absolutely
— Elon Musk (@elonmusk) September 19, 2025
Tesla is also developing the Cybercab, which started employee rides last week. However, this vehicle is not necessarily geared toward wheelchair accessibility.
That leaves a major gap in the autonomous ride-sharing program that Tesla is attempting to build; the company has been pretty clear that it does not want to complicate its manufacturing lines by bringing in a wide array of body styles.
However, it seems necessary to have something larger that could help transport people to appointments when they cannot drive. For wheelchair accessibility, the Robovan, which was unveiled at the “We, Robot” event in October 2024, seems to be the most ideal solution:
Herdman did not indicate whether she was referring to the Robovan or if Tesla is building yet another body style that is geared toward full autonomy but also caters to the handicapped.
Tesla might need to develop something specifically for the handicapped in order to align with the Americans with Disabilities Act, which prevents discrimination against people with disabilities in transportation services. Uber was hit with a lawsuit late last year for “refusing to reasonably modify its policies, practices, or procedures where necessary to avoid discriminating against riders with disabilities.”
Tesla would obviously like to avoid this.
It will be interesting to see what Tesla will do with this project, and whether it will introduce something new to the market or just continue with the Robovan.
Tesla weirdly confirmed that its steering wheel-less and pedal-less Cybercab vehicle is now in the process of giving employees rides, a huge milestone for the vehicle program.
But the entire thing was super strange. On Friday, Tesla released a video stating that there was “Cool news from Giga Texas” and that employees were now taking rides in Cybercabs that have no manual controls. The units seen on public roads are engineering vehicles that have manual controls inside, a necessity as Tesla moved through the testing phase.
However, Tesla removed the video and reposted it shortly after with a more vague title. It seems like the employee rides are still going, but the video was adjusted slightly. The initial upload showed employees doing things like watching movies and adjusting the climate, but these snippets were removed in the second upload.
Cool news from Giga Texas pic.twitter.com/gvbG456Tzw
— Tesla Robotaxi (@robotaxi) July 11, 2026
Both images below were uploaded with the first video, but were removed after Tesla re-uploaded the announcement. These are not available in the second upload
Credit: Tesla
Credit: Tesla
Nevertheless, the announcement from Tesla is that the Cybercab is operating with employees inside who can control the vehicle’s audio, video, climate, and destination settings through their smartphone app.
Tesla has already been testing Cybercab engineering units, but last month, it was able to self-certify for SAE Level 4, which would enable unsupervised self-driving in Texas. The company is moving toward that, and the plans have always been to launch Cybercab rides this year.
The Cybercab is potentially looked at as the next generation of Tesla’s mobility leg. For the past 15 years, the company has been known as somewhat of an automaker, among many other things. However, these passenger vehicles that Tesla has manufactured are now moving into a new realm, as they will eventually drive themselves with no supervision thanks to the Full Self-Driving suite.
The Cybercab is just the next step of that: a true vehicle developed for the sole purpose of ride-hailing. It has no human controls, it has only two seats, and it will get passengers from Point A to Point B with no awkward driver, no need for manual inputs, and with no stress.
Tesla is moving forward with other developments related to the Cybercab project as well. However, the big announcement will come when Tesla finally announces that it is launching Cybercab rides to the general public, something that it plans to launch either late this year or early 2027.
Tesla Semi enters new Pilot Program with interesting challenge
Tesla is building a wheelchair-accessible Robotaxi
