Connect with us

News

Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features

Tesla Smart Summon in action. (Credit: Rody Davis/YouTube)

Published

6 years ago

on

A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.

The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.

“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”

The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.

“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”

Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.

Tesla Owners Silicon Valley Smart Summon Model 3s (Credit: @MinimalDuck)

When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:

  • Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
  • Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
  • Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
  • Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.

One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.

Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.

Advertisement
-
-
Related Topics:

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement -
Comments

Investor's Corner

SpaceX reports beat in first earnings while minimizing losses

Published

44 minutes ago

on

August 4, 2026

By

Credit: SpaceX | X

SpaceX (NASDAQ: SPCX) reported a beat in revenues and EBITDA in its first earnings call report while also minimizing losses as its business continues to gain momentum.

After its IPO in July, SpaceX saw some tough losses on Wall Street due to a major selloff after a delay in its 13th Starship test flight. The ship launched later that week and completed what was arguably the most successful IFT operation in the Starship program’s history.

Nevertheless, the company is continuing on and reported some encouraging financials while also promoting what appears to be a robust outlook moving forward in its Space, AI, and Connectivity divisions.

SpaceX to report first-ever earnings today: here’s what to expect

Earnings Results

  • Revenues: $7.8 billion reported vs. $6.7 billion expected
  • Adjusted EBITDA: $3.5 billion vs. $2 billion expected
  • Net loss of $541 million, an improvement of $467 million from net loss of $1.0 billion

Additionally, CFO Bret Johnsen had these comments:

“2026 has been a momentous year so far, and the second quarter demonstrated the true power of SpaceX. Revenue growth accelerated across all our business segments and we delivered strong operating leverage, with significant margin expansion led by our new AI compute agreements. Our unparalleled leadership in launch, Starlink subscriber growth, new enterprise and government partnerships, and best-in-class AI infrastructure underscore our ability to drive meaningful scale and deliver attractive returns. As a newly public company, we are delighted to welcome our broad base of shareholders and bondholders. We ended the second quarter with $100 billion of cash, cash equivalents, and marketable securities, and $47.5 billion in backlog. This financial strength gives us substantial capacity to invest in Starship, Starlink Broadband and Mobile satellites, and our AI platform, while maintaining a disciplined long-term capital allocation framework.”

Space Business Highlights

SpaceX shared some of its biggest Space Business Highlights for Q2:

  • Space revenues grew 55% sequentially and 29% year-over-year to $962 million, driven by a higher number of large customer launches and a favorable customer shift compared to the prior year
  • Total costs and expenses for the Space segment were up by $389 million year-over-year, as we continued to accelerate R&D investments in our Starship program, which we believe will reduce the cost to orbit by 99% or more relative to the historical average, and unlock significant revenue potential across all business segments
  • Leading launch provider for the world with 78 launches and 1,041 metric tons of mass to orbit deployed over the six months ended June 30, 2026, primarily allocated to Connectivity for the deployment of our Starlink constellation
  • Starship V3 development continued to advance towards full and rapid reusability:
    • Completed Starship V3’s first suborbital mission in May, Flight 12, which achieved a successful lift off from our new Starbase pad, a precision landing of Starship’s upper stage, and deployment of modified V2 Starlink satellites
    • Subsequent to the second quarter, completed Starship Flight 13 in July, which achieved all flight objectives including deploying 20 production V3 satellites, demonstrating in-space relight of a Raptor engine, and executing the softest ever splashdown of Starship, providing critical views of an intact heatshield

SpaceX will report its earnings today at 4:30 P.M. EDT.

Advertisement
-
-
Continue Reading

Elon Musk

Elon Musk sends second warning to SpaceX shorts ahead of first earnings

Published

1 hour ago

on

August 4, 2026

By

Credit: Grok Imagine

Elon Musk issued a second pointed warning to SpaceX short sellers on Tuesday, just hours before the company was set to release its first quarterly earnings as a publicly traded firm. Responding to a report highlighting elevated short interest, Musk wrote on X: “I try to warn them, but they just double down …”

The comment came as data from S3 Partners showed roughly 95 percent of available SPCX shares to borrow were on loan, translating to about 34 percent short interest as a percentage of the float. The stock has traded under pressure since its record-breaking IPO in June 2026, declining significantly from early peaks.

This marks the second such message from Musk in under three weeks.

On July 17, amid post-IPO volatility, he stated: “The survival probability of firms who maintain a significant short position in SpaceX over time is very low.” At that time, SPCX had fallen roughly 30 percent from its peak above a $2.6 trillion valuation, with short sellers reportedly realizing gains of about $8.7 billion.

Elon Musk sends first warning to SpaceX short sellers

Advertisement
-
-

Musk’s warning aligned with optimistic analyses projecting that Starship-driven cost reductions could enable a multi-trillion-dollar space economy through applications such as orbital solar power, asteroid mining, data centers, and Mars-related projects, positioning SpaceX as critical infrastructure.

SpaceX is scheduled to report second-quarter results after the market close later today, followed by a webcast. Analysts anticipate revenue near $6.9 billion, reflecting growth in Starlink, launch services, and AI-related segments. The earnings release precedes a major lockup expiration on August 6 that could free hundreds of millions of insider shares.

Musk has a long track record of confronting short sellers, particularly regarding Tesla, where he has argued that persistent bearish positions underestimate transformative technologies. Critics view his optimism as overly ambitious given near-term stock fluctuations, while supporters see temporary dips as opportunities in a longer-term expansion of the space economy.

As SpaceX opens its books to public scrutiny for the first time, the high short interest and Musk’s repeated cautions set the stage for heightened market attention on the results and management’s commentary.

Continue Reading

News

Tesla’s AI lead doubles down on FSD’s speed strategy, and owners are confused

Published

5 hours ago

on

August 4, 2026

By

Credit: Tesla

Tesla’s AI lead Ashok Elluswamy doubled down on the company’s strategy regarding Full Self-Driving’s speed settings, and owners are definitely confused.

Earlier versions of Full Self-Driving allowed owners to set a max speed that the vehicle could travel while operating under the semi-autonomous driver assistance platform. This allowed more customization for the driver, giving them the ability to experience FSD’s robust performance with their own personal preferences.

Speed is massively important for obvious reasons — it’s not only a question of keeping the vehicle occupants comfortable by traveling at a safe speed, but it’s also something that could contribute to a ticket or infraction from law enforcement.

With the release of FSD v14 last year, Tesla removed the ability to set a max speed and instead opted for five Speed Profiles, ranging from “Sloth,” the most conservative, to “Mad Max,” the most aggressive and spirited. These profiles not only control speed, but also how frequently the vehicle will execute passes, perform lane changes, and other contributing factors.

The removal of the Max Speed setting was a major complaint amongst the Tesla community because it left owners scrambling for a way to experience suitable behaviors while traveling at an appropriate speed. Most felt the driving profiles would be a good indicator of the behaviors, while speed would still be left up to the discretion of the driver.

Instead, Tesla’s Speed Profiles determine both, and the constant tinkering of how they behave has been a major bottleneck and point of confusion for both owners and the company. From update to update, the Speed Profiles will change, sometimes more drastically than others. Some owners have complained that the “Standard” profile is too fast, while others have experienced “Mad Max” traveling below the speed limit:

These things change with each update, but the big complaint is that owners are on the hook for any tickets that come from FSD’s infractions; that’s the caveat of the suite being named FSD (Supervised). It ultimately means the driver is responsible, and the automaker has no liability when it comes to speeding tickets or general traffic infractions.

It is the driver’s responsibility to take over or adjust based on this.

Elluswamy essentially confirmed that there are no plans to bring back Max Speed control, because it is what he referred to as “an anti pattern.” He then echoed something that CEO Elon Musk has started to really push with FSD, and that’s the idea that Tesla is really honing in on the preferences of the driver.

Owners were confused by Tesla’s decision, stating that there must be a better way, especially considering disengagements for incorrect speeds are common:

From personal experience and using FSD for over 72 percent of my driving miles since v14 was released late last year, I make Speed Profile adjustments constantly. If FSD is traveling a tad too quickly, I will scale it back, and if it’s too conservative, I’ll make it more aggressive.

I don’t complain about making the Speed Profile changes too frequently, but it would certainly be nice to have it happen less frequently. There are far too many times I am concerned about getting a ticket, even in Standard mode.

The biggest issue for me, personally, which seems to be echoed throughout the community, is the fact that Tesla’s goal is to minimize disengagements. Many drivers are stating that speed is a major reason for disengagements.

However, Tesla is not willing to bring back this one level of input because it would technically be a regression.

Advertisement
-
-

Whether it’s right or wrong in your opinion, it is what Tesla is going with, and it seems like it has pivoted quite a bit from its other strategies for minimizing interventions by pushing its AI to behave in a way that would fit the occupant’s personal preferences.

Continue Reading