News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla has taken home the “Overall Loyalty to Make” award from S&P Global Mobility for the fourth consecutive year, reinforcing Tesla owners’ willingness to come back. The 2025 awards are based on S&P Global Mobility’s analysis of 13.6 million new retail vehicle registrations in the U.S. from October 2024 through September 2025. The complete list of 2025 winners includes General Motors for Overall Loyalty to Manufacturer, Tesla for Overall Loyalty to Make, Chevrolet Equinox for Overall Loyalty to Model, Mini for Most Improved Make Loyalty, Subaru for Overall Loyalty to Dealer, and Tesla again for both Ethnic Market Loyalty to Make and Highest Conquest Percentage.
Tesla’s streak in this category started in 2022, and the brand has now won the Highest Conquest Percentage award for six straight years, meaning it keeps pulling buyers away from other brands at a rate no competitor has matched. Tesla’s retention among Asian households reached 63.6% and among Hispanic households 61.9%, rates that significantly outpace national averages for those groups. That breadth of appeal across demographics adds a layer of significance to a win that some might dismiss as routine.
The timing matters too. After several consecutive quarters of decline, Tesla’s share of U.S. EV sales jumped to 59% in Q4 2025. That rebound, arriving just as competitors were flooding the market with new models and incentives, suggests Tesla’s loyalty numbers are not simply the result of limited alternatives. Buyers are still choosing it when they have plenty of other options.
What keeps Tesla owners coming back has a lot to do with the and convenience of charging. The Supercharger network is the most straightforward example. With over 65,000 Superchargers globally, it remains the largest and most reliable fast-charging network in the world, and owners who have built their routines around it face a real practical cost when considering a switch. Competitors have made progress, but the consistency, speed, and availability of Tesla’s network is still the benchmark the rest of the industry is chasing. Then there is the software side. Tesla has built a model where the car you own today is functionally different from the car you bought two years ago, through over-the-air updates that add continuous game-changing improvements such as Full Self-Driving that has moved from a driver-assist feature to an increasingly capable autonomous system. For many Tesla owners, leaving the brand means starting over with a car that will not get meaningfully better over time, and that is a trade-off fewer and fewer are willing to make.
Tesla Robotaxi services in Austin have been operating since last Summer, but Tesla has admittedly been delayed in its expansion of the geofence, fleet size, and other details in a bid to prioritize safety as new technology rolls out.
But those barriers are being broken with new guardrails being removed from the program.
Tesla has achieved a significant advancement in its autonomous ride-hailing program. As of May 4, the Robotaxi fleet in Austin, Texas, has begun operating unsupervised during evening hours for the first time. This expansion moves beyond previous limitations that restricted unsupervised service to daylight hours, typically ending in mid-afternoon.
Tesla Robotaxi in Austin is operating unsupervised in the evenings for the first time today.
Previously in Austin, unsupervised operation ended mid-afternoon
— Robotaxi Tracker (@RtaxiTracker) May 4, 2026
The change brings Austin in line with operations in Dallas and Houston. Those cities have supported evening unsupervised runs since their initial launches in April, and both recently received additions of new unsupervised vehicles to their fleets. This coordinated progress across Texas strengthens Tesla’s regional presence and provides a broader testing ground for the technology.
This milestone carries substantial weight in the development of autonomous vehicles. Extending operations into low-light conditions meaningfully expands the Robotaxi’s operational design domain (ODD)—the specific environments and scenarios in which the system is approved to operate safely without human intervention.
Nighttime driving presents unique technical demands: diminished visibility, headlight glare from oncoming traffic, reduced contrast for identifying pedestrians and lane markings, and greater variability in camera sensor exposure.
Tesla’s pure vision approach, powered by neural networks trained on vast real-world datasets rather than lidar or pre-mapped routes, must handle these variables reliably. Demonstrating consistent unsupervised performance after sunset validates the robustness of the end-to-end AI stack and its ability to generalize across diverse lighting conditions.
Beyond technical validation, the expansion holds important operational and economic implications. Evening hours often coincide with peak urban demand for rides, including commutes, dining, and entertainment outings.
Enabling service during these periods increases daily vehicle utilization, allowing each Robotaxi to generate more revenue while gathering additional high-value training data. Higher utilization accelerates the virtuous cycle of data collection, model improvement, and further ODD growth.
Looking ahead, this step paves the way for more ambitious rollouts. Success in low-light environments positions Tesla to pursue near-24-hour operations, potentially integrating highways and expanding into varied weather patterns. Regulators worldwide frequently demand evidence of safe performance across day-night cycles before granting wider approvals.
Proven capability in Texas could expedite deployments in planned cities such as Phoenix, Miami, Orlando, Tampa, and Las Vegas during the first half of 2026.
Tesla confirms Robotaxi expansion plans with new cities and aggressive timeline
Moreover, scaling evening service supports Tesla’s long-term vision of a high-efficiency robotaxi network. Greater fleet productivity lowers the cost per mile, making autonomous mobility more accessible and competitive against traditional ride-hailing.
As the company iterates on software updates informed by nighttime data, reliability is expected to compound rapidly, unlocking denser urban coverage and longer-distance trips.
In summary, the introduction of an unsupervised evening Robotaxi service in Austin represents more than an incremental schedule adjustment. It signals a critical maturation of the underlying technology and sets the foundation for broader geographic and temporal expansion.
With Texas operations gaining momentum, Tesla is steadily advancing toward transforming urban transportation at scale.
Cybertruck
Tesla Cybercab just rolled through Miami inside a glass box
Tesla paraded a Cybercab in a glass display at Miami’s F1 Grand Prix event this week.
Tesla set up an “Autonomy Pop-Up” at Lummus Park in Miami Beach from April 29 through May 3, 2026, embedded within the official F1 Miami Grand Prix Fan Fest. The centerpiece was a Cybertruck towing the Cybercab inside a glass display case marked “Future is Autonomous,” rolling through the beachfront crowd.
Miami is on Tesla’s confirmed list of cities for robotaxi expansion in the first half of 2026, making the promotion a strategic promotion that lays groundwork in a target market.
This was not Tesla’s first time using Miami as a showcase city. In December 2025, Tesla hosted “The Future of Autonomy Visualized” at its Miami Design District showroom, coinciding with Art Basel Miami Beach. That event featured the Cybercab prototype and Optimus robots interacting with attendees. The F1 pop-up this week marks Tesla’s return to Miami and follows a pattern Tesla has been running since early 2026. Just two weeks before Miami, Tesla stationed Optimus at the Tesla Boston Boylston Street showroom on April 19 and 20, directly on the final stretch of the Boston Marathon, letting tens of thousands of runners and spectators meet the robot for free, generating massive earned media at zero advertising cost.
Tesla is sending its humanoid Optimus robot to the Boston Marathon
Tesla has confirmed plans to expand its robotaxi service to seven cities in the first half of 2026, including Dallas, Houston, Phoenix, Miami, Orlando, Tampa, and Las Vegas, building on the unsupervised service already running in Austin. Musk has said he expects robotaxis to cover between a quarter and half of the United States by end of year. On the production side, Musk told shareholders that the Cybercab manufacturing process could eventually produce up to 5 million vehicles per year, targeting a cycle time of one unit every ten seconds. Scaling robotaxis to 10 million operational units over the next ten years is a key condition of his compensation package, alongside selling 20 million passenger vehicles.
As for the Cybercab’s price, Musk has said buyers will be able to purchase one for under $30,000, with an average operating cost around $0.20 per mile. Whether those numbers hold through full production remains to be seen.
Cybercab at F1 Fan Fest in Miami
by
u/Joshalander in
teslamotors
Tesla owners keep coming back for more
Tesla Robotaxi service in Austin achieves monumental new accomplishment
