News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
-
-
Investor's Corner
SpaceX and Nvidia team up on Musk’s orbital AI bet
SpaceX revealed a new Nvidia satellite partnership, then Musk pledged an exclusive Nvidia hardware commitment.
SpaceX and Nvidia are now working together on the hardware that will power Musk’s orbital data center ambitions. SpaceX announced on X on Tuesday that it is partnering with Nvidia to design the compute payload for Starmind AI1, the first satellite in a planned constellation built to run AI workloads directly in orbit. Each Starmind satellite will carry Nvidia’s Rubin GPUs and Vera CPUs, according to the post, which included renderings of the payload design.
The announcement landed hours before SpaceX’s first earnings call as a public company, where Musk went further, saying the company has committed to building its AI infrastructure exclusively on Nvidia hardware. “We think the Vera Rubin architecture is the best architecture. We think it’s the best AI computer, and we greatly value our close cooperation and partnership on many levels with Nvidia,” Musk told investors on the call,. “So we’re exclusive to Nvidia.”
Musk said SpaceX plans to deploy Nvidia’s Vera Rubin NVL72 rackscale system, codenamed Kyber, both on the ground and in space. He set a target of 2 gigawatts of compute capacity online by the end of this year, scaling to roughly 10 gigawatts by the end of 2027.
SpaceX’s newest Starmind will make earth data centers obsolete
Starmind has been in development since Musk confirmed the name in June, following an xAI trademark filing that tipped off the project before SpaceX made it official. The idea is massive in scope and instead of moving data down to ground based servers, satellites equipped with onboard processors and large solar arrays would compute AI workloads in orbit and beam results back to Earth. SpaceX has already filed with the FCC for a constellation of up to one million satellites to support the effort, citing constant solar power and the absence of zoning restrictions as advantages over terrestrial data centers.
The Nvidia exclusivity marks a shift in tone from just two weeks ago, when Musk was busy knocking down a report that SpaceX had ordered $52 billion worth of Nvidia GPUs through Foxconn, calling it fake news at the time. The dollar figure in that rumor may have been wrong, but the underlying direction seems correct. SpaceX’s AI division already leases Colossus compute capacity to Anthropic and Google, and Tuesday’s earnings report showed AI revenue climbing sharply as those deals ramp up.
Nvidia shares rose roughly 3% in Tuesday trading on the news, while SpaceX stock climbed nearly 9% during the day before giving back gains after hours as investors digested the earnings report’s capital spending figures.
-
SpaceX (NASDAQ: SPCX) reported a beat in revenues and EBITDA in its first earnings call report while also minimizing losses as its business continues to gain momentum.
After its IPO in July, SpaceX saw some tough losses on Wall Street due to a major selloff after a delay in its 13th Starship test flight. The ship launched later that week and completed what was arguably the most successful IFT operation in the Starship program’s history.
Nevertheless, the company is continuing on and reported some encouraging financials while also promoting what appears to be a robust outlook moving forward in its Space, AI, and Connectivity divisions.
SpaceX to report first-ever earnings today: here’s what to expect
Earnings Results
- Revenues: $7.8 billion reported vs. $6.7 billion expected
- Adjusted EBITDA: $3.5 billion vs. $2 billion expected
- Net loss of $541 million, an improvement of $467 million from net loss of $1.0 billion
Additionally, CFO Bret Johnsen had these comments:
“2026 has been a momentous year so far, and the second quarter demonstrated the true power of SpaceX. Revenue growth accelerated across all our business segments and we delivered strong operating leverage, with significant margin expansion led by our new AI compute agreements. Our unparalleled leadership in launch, Starlink subscriber growth, new enterprise and government partnerships, and best-in-class AI infrastructure underscore our ability to drive meaningful scale and deliver attractive returns. As a newly public company, we are delighted to welcome our broad base of shareholders and bondholders. We ended the second quarter with $100 billion of cash, cash equivalents, and marketable securities, and $47.5 billion in backlog. This financial strength gives us substantial capacity to invest in Starship, Starlink Broadband and Mobile satellites, and our AI platform, while maintaining a disciplined long-term capital allocation framework.”
Space Business Highlights
SpaceX shared some of its biggest Space Business Highlights for Q2:
- Space revenues grew 55% sequentially and 29% year-over-year to $962 million, driven by a higher number of large customer launches and a favorable customer shift compared to the prior year
- Total costs and expenses for the Space segment were up by $389 million year-over-year, as we continued to accelerate R&D investments in our Starship program, which we believe will reduce the cost to orbit by 99% or more relative to the historical average, and unlock significant revenue potential across all business segments
- Leading launch provider for the world with 78 launches and 1,041 metric tons of mass to orbit deployed over the six months ended June 30, 2026, primarily allocated to Connectivity for the deployment of our Starlink constellation
- Starship V3 development continued to advance towards full and rapid reusability:
- Completed Starship V3’s first suborbital mission in May, Flight 12, which achieved a successful lift off from our new Starbase pad, a precision landing of Starship’s upper stage, and deployment of modified V2 Starlink satellites
- Subsequent to the second quarter, completed Starship Flight 13 in July, which achieved all flight objectives including deploying 20 production V3 satellites, demonstrating in-space relight of a Raptor engine, and executing the softest ever splashdown of Starship, providing critical views of an intact heatshield
SpaceX will report its earnings today at 4:30 P.M. EDT.
-
Elon Musk issued a second pointed warning to SpaceX short sellers on Tuesday, just hours before the company was set to release its first quarterly earnings as a publicly traded firm. Responding to a report highlighting elevated short interest, Musk wrote on X: “I try to warn them, but they just double down …”
The comment came as data from S3 Partners showed roughly 95 percent of available SPCX shares to borrow were on loan, translating to about 34 percent short interest as a percentage of the float. The stock has traded under pressure since its record-breaking IPO in June 2026, declining significantly from early peaks.
I try to warn them, but they just double down … 🤷♂️
— Elon Musk (@elonmusk) August 4, 2026
This marks the second such message from Musk in under three weeks.
On July 17, amid post-IPO volatility, he stated: “The survival probability of firms who maintain a significant short position in SpaceX over time is very low.” At that time, SPCX had fallen roughly 30 percent from its peak above a $2.6 trillion valuation, with short sellers reportedly realizing gains of about $8.7 billion.
-
Musk’s warning aligned with optimistic analyses projecting that Starship-driven cost reductions could enable a multi-trillion-dollar space economy through applications such as orbital solar power, asteroid mining, data centers, and Mars-related projects, positioning SpaceX as critical infrastructure.
SpaceX is scheduled to report second-quarter results after the market close later today, followed by a webcast. Analysts anticipate revenue near $6.9 billion, reflecting growth in Starlink, launch services, and AI-related segments. The earnings release precedes a major lockup expiration on August 6 that could free hundreds of millions of insider shares.
Musk has a long track record of confronting short sellers, particularly regarding Tesla, where he has argued that persistent bearish positions underestimate transformative technologies. Critics view his optimism as overly ambitious given near-term stock fluctuations, while supporters see temporary dips as opportunities in a longer-term expansion of the space economy.
As SpaceX opens its books to public scrutiny for the first time, the high short interest and Musk’s repeated cautions set the stage for heightened market attention on the results and management’s commentary.
SpaceX and Nvidia team up on Musk’s orbital AI bet
SpaceX reports beat in first earnings while minimizing losses
