News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
Elon Musk handed Grok something no other AI company can get their hands on
Elon Musk says SpaceX will feed engineering data into Grok’s next model, avoiding restricted material.
Elon Musk said Tuesday that SpaceX will feed its internal engineering data into the next major training run for Grok, the AI model now folded into SpaceX following February’s merger. In a post on X, Musk wrote that SpaceX’s “massive corpus of world-class engineering data,” excluding anything restricted under U.S. arms export law, will be added during supplemental training of what he called the “2T run,” a reference to a roughly two trillion parameter model that would nearly double the parameters behind the latest Grok 4.5 that’s rolling out.
SpaceX’s massive corpus of world-class engineering data (excluding material blocked by ITAR) will be added during supplemental training of the 2T run.
This will dramatically improve Grok’s engineering capabilities. https://t.co/BbQEViFByn
— Elon Musk (@elonmusk) July 21, 2026
The excluded material that Musk is referring to would fall under the International Traffic in Arms Regulations (ITAR), which restricts export of technical data tied to defense and space hardware. That likely rules out propulsion specifics for Merlin and Raptor engines along with guidance and control details for SpaceX’s launch vehicles, but leaves manufacturing knowledge, materials science, and Starlink hardware design on the table.
The announcement extends a pattern that has been building since SpaceX’s Nasdaq debut in June, when the company went public with Grok and xAI’s Colossus supercomputer folded into the pitch to investors.
Days after that listing, SpaceX closed its $60 billion all stock acquisition of coding startup Cursor, giving xAI both enterprise software distribution and a stream of real world developer data to train on. Grok 4.5 launched July 8 running partly on that Cursor training data, with Musk describing it as roughly comparable to Anthropic’s Opus 4.7 but faster and cheaper to run.
Feeding SpaceX’s own engineering data into the next AI model follows the same logic Musk has applied across xAI’s sister companies. Tesla supplies real world driving data and manufacturing expertise, X supplies conversational data, and now SpaceX supplies aerospace engineering data built up since 2002.
Musk did not give a release date for the upcoming AI model, referred to elsewhere as Grok 4.6. He has said the two trillion parameter run is in its final training phase and expected to wrap this week.
Tesla has extended its Bay Area ride-hailing service to include pickups and drop-offs at San Francisco International Airport (SFO). The update, shared via the company’s official channels on July 21, allows users in the region to request rides directly to and from one of California’s busiest airports.
The expansion builds on Tesla’s secured limousine permit for SFO operations. Public records show the permit became effective March 20, 2026, and remains active through January 31, 2027. Tesla vehicles operating the service now display authorized limousine permits issued by the City and County of San Francisco.
Our Bay Area rideshare service now goes to SFO ✈️
— Tesla AI (@Tesla_AI) July 21, 2026
Tesla’s ride-hailing program in California relies on Model Y vehicles equipped with Full Self-Driving (Supervised) technology. Human safety drivers remain present in compliance with state regulations, distinguishing the service from fully driverless operations.
The Bay Area geofence covers a broad area spanning north of San Francisco to south of San Jose, offering extensive connectivity across the region.
UPDATE: Elon Musk reveals why Tesla didn’t say ‘Robotaxi’ upon California launch
This SFO addition follows earlier progress at other Bay Area airports. Tesla previously expanded service to San Jose Mineta International Airport (SJC) in late 2025. The company had engaged with SFO, SJC, and Oakland International Airport officials as early as September 2025 to secure necessary approvals for passenger transport.
The service provides a new option for travelers seeking electric, app-based transportation integrated with Tesla’s ecosystem. Rides are booked through Tesla’s dedicated ride-hailing application, which handles matching, routing, and payments. Pricing follows standard ride-hailing models, with potential adjustments based on distance, time, and demand.
Tesla’s California ride-hailing program launched in July 2025 with an initial invite-only rollout in the Bay Area. It started alongside operations in Austin, Texas, marking the company’s second major U.S. market.
The Bay Area remains a primary focus in California, with service centered on high-demand corridors connecting residential, commercial, and now major transportation hubs. This latest airport integration represents a practical step in Tesla’s broader mobility ambitions within the state.
Tesla has officially revealed its 2026 Summer Update, which comes with a variety of crazy new features, including Navigation fixes that owners have been wanting for months.
Tesla routinely releases a larger update with the Spring, Summer, Fall, and Winter updates, where it ships a variety of new features, bug fixes, and other additions to customer cars.
The 2026 Spring Update featured things like “Hey Grok” voice assistance, a redesigned self-driving app, Unreal Engine visual upgrades, and more.
🚨 TESLA’S SUMMER UPDATE FOR 2026 IS HERE:
Featuring:
✅ Self-Driving Stats in Mobile App
✅ Caraoke with Scoring
✅ Automatic Navigation
✅ Preferred Routes
✅ Set Arrival Energy from Mobile App
✅ Send Custom Wraps from Mobile App
✅ Rear Display Lock
✅ Other Improvements
🔌… https://t.co/C9IW3egEhH— TESLARATI (@Teslarati) July 21, 2026
Tesla’s Summer Release has about ten new features; we’ll show you each and detail them below:
New Grok Voice Commands
“Grok can now make phone calls, search and play music, adjust climate, open the glovebox, and answer questions about your Tesla.”
Self-Driving Stats in Mobile App
“View and share self-driving stats from the mobile app.”
Caraoke With Scoring
“Caraoke now scores your singing while in Park. High scores are saved to your Tesla profile.”
Automatic Navigation
“Automatic Navigation now adapts to your routine.
In addition to Home, Work, and upcoming calendar events, your vehicle can now suggest and route to places you visit regularly – like a school drop-off on the way to work, or the gym on the way home.”
Preferred Routes
“For a more personalized experience, navigation now prioritizes routes that you’ve taken before”
Set Arrival Energy from Mobile App
“Set your desired Arrival Energy from your phone.”
Send Custom Wraps from Mobile App
“Skip the USB drive and upload a custom wrap of your car from the mobile app. Instructions for creating a custom wrap here: https://github.com/teslamotors/custom-wraps.”
Rear Display Lock
“Kids can watch content on the rear screen, but only the front row can control it through the rear screen app.”
Other Improvements
- Find Superchargers by name when searching for a destination
- Add Apple Music songs to queue from search and artist page
- Set your preferred zoom level for the Self-Driving visualization
- Intro animations for new Model 3 and Y
Elon Musk handed Grok something no other AI company can get their hands on
Tesla expands ridesharing service in California to new hotspot
