News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla stock (NASDAQ: TSLA) endured one of its sharpest single-day declines in years on July 23, tumbling approximately 14.5 percent and closing near $320 after opening the session around $374. The drop erased more than $140 billion in market value amid heavy trading volume and left the shares at multi-week lows.
The sell-off followed the company’s second-quarter 2026 results, released the previous evening. Tesla reported record revenue of $28.2 billion, up 26 percent year over year, driven by a Q2-record 480,126 vehicle deliveries. Energy storage deployments also rose strongly.
Tesla (TSLA) Q2 2026 earnings results: miss on EPS, beat on revenue
Yet profitability disappointed sharply. Operating income fell 57 percent to $398 million, compressing the operating margin to just 1.4 percent. Non-GAAP earnings per share came in at $0.33, well below the roughly $0.53 analysts had expected. Free cash flow turned negative by $1.1 billion as capital expenditures surged 142 percent to $5.8 billion, largely tied to accelerated spending on artificial intelligence, robotics, and autonomous systems.
The losses on capex were expected, as Tesla said it would be spending heavily in 2026.
Investors also reacted to lingering uncertainty surrounding key product timelines. During the Earnings Call, management reiterated ambitions for Robotaxi deployment and the Optimus humanoid robot, but offered limited new concrete milestones, renewing questions about execution pace that have long accompanied Tesla’s ambitious roadmap.
The magnitude of the decline places it among Tesla’s more severe one-day percentage losses since its 2010 initial public offering. Historically, the two largest single-day drops (split-adjusted) remain September 8, 2020, when shares fell 21.1 percent amid broader market volatility and valuation concerns, and January 13, 2012, with a 19.3 percent plunge during the company’s early growth struggles.
Other notable declines include an 18.6 percent drop on March 16, 2020, at the onset of pandemic-related market turmoil. Thursday’s move ranks roughly ninth on the all-time list but stands out as the steepest in more than a year.
Despite the short-term pain, Tesla’s long-term trajectory has repeatedly recovered from such volatility. The latest results underscore both the strength of its core automotive and energy businesses and the near-term costs of heavy investment in next-generation technologies.
Elon Musk clapped back at France’s decision to withhold the approval for Tesla’s Full Self-Driving (FSD) Supervised system, projecting a clear and blunt message to French Transport Minister Phillippe Tabarot, after he publicly rejected the technology in its current form.
Tabarot outlines several concerns with Tesla Full Self-Driving in a detailed video statement, where he said, “The safety trade-offs are not yet sufficient to authorize it as it currently stands,” he said. He emphasized that FSD is not a true self-driving system and that the driver remains fully responsible.
Key issues Tabarot also brought up included allowing speeding when surrounding traffic exceeds limits and what he believes are insufficient guarantees of driver attention during complex urban maneuvers such as lane changes, intersections, and roundabouts.
Delaying the approval of FSD in France will cost lives
— Elon Musk (@elonmusk) July 22, 2026
While acknowledging technological progress and France’s support for autonomous innovation, Tabarot stressed that deployment must prioritize road safety. He noted ongoing technical discussions with Tesla, the Netherlands, and other European partners, with further ecosystem meetings planned for the fall.
Musk’s rebuke highlights the human cost of regulatory caution. Tesla’s latest safety reports provide compelling data supporting accelerated adoption. In the most recent 12-month period, vehicles using FSD (Supervised) recorded one major collision per approximately 5.1 million miles driven, dramatically better than the U.S. national average of one crash per 698,000 miles.
Even Tesla vehicles driven manually with active safety features outperform the average by a wide margin. These figures come from billions of real-world miles of telemetry, showing FSD vehicles involved in far fewer incidents than both manual Teslas and the broader U.S. fleet.
Critics argue Tesla’s comparisons require careful scrutiny regarding reporting thresholds and fleet demographics, yet the data consistently positions FSD as a potential lifesaver. With road fatalities remaining a leading cause of death worldwide, Musk contends that proven safer technology should not face prolonged bureaucratic hurdles.
France’s measured approach reflects the broader European regulatory caution, which many, especially Musk, have been critical of in the past. However, as autonomous systems from Tesla and competitors like Waymo demonstrate superior safety in independent studies, pressure is mounting for harmonized approvals.
Musk’s warning carries the belief that every month of delay may equate to avoidable tragedies on European roads.
In a striking revelation that underscores the lucrative crossover between Big Tech and space exploration, Alphabet Inc., Google’s parent company, disclosed a massive $94.1 billion equity stake in SpaceX following the rocket company’s blockbuster initial public offering earlier this year.
The disclosure came in Alphabet’s quarterly filing, marking the first time the long-held private investment has been publicly valued at market prices. Google was an early backer, investing alongside Fidelity in 2015 with roughly $500-900 million at a time when SpaceX was valued around $12 billion.
That bet has delivered extraordinary returns, roughly a hundredfold, transforming a strategic play on satellite internet and launch capabilities into one of Alphabet’s largest assets.
Google, $GOOGL, has said they hold $94 billion in SpaceX, $SPCX, shares after IPO.
— unusual_whales (@unusual_whales) July 23, 2026
Of the total holding, approximately $80 billion remains subject to short-term post-IPO lockup restrictions, preventing near-term sales. An additional $14.1 billion faces longer-term restrictions, extending into the third quarter of 2027. This structure limits immediate liquidity but protects against market volatility as SpaceX transitions into public trading.
The SpaceX position contributed significantly to gains in Alphabet’s broader investment portfolio, which also includes a major stake in AI leader Anthropic. Combined, these holdings helped drive nearly $100 billion in investment gains during the second quarter, providing a substantial boost to net income amid ongoing AI spending pressures.
Analysts view the disclosure as validation of Alphabet’s venture strategy beyond its core search and cloud businesses. The investment aligns with deeper ties, including reported multi-billion-dollar deals for AI computing capacity on SpaceX infrastructure. As SpaceX advances Starship flights, Starlink expansion, and ambitious Mars goals under Elon Musk, Google’s stake positions it to benefit from the commercialization of space.
For Alphabet, the windfall highlights how patient, forward-looking bets in transformative sectors can yield outsized rewards. While lockups temper short-term impact, the holding cements SpaceX as a cornerstone of Alphabet’s diversified portfolio in an era where aerospace, AI, and connectivity increasingly intersect. Investors will watch closely as restrictions lift and SpaceX’s public performance unfolds.
Tesla stock tumbles after earnings, one of its sharpest single-day declines
Elon Musk is not happy about this Tesla Full Self-Driving approval delay
