News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
Elon Musk calls Earth’s data centers “peanuts” next to what SpaceX is planning in orbit
Elon Musk says SpaceX capex efficiency is underestimated as orbital data centers loom by 2028.
Elon Musk is pushing back on one of the biggest worries hanging over SpaceX stock. In a reply on X on Sunday, Musk said the company’s capital expenditure efficiency is severely underestimated. He was responding to a Milk Road Stocks post citing analyst Kyle Reidhead, who estimates SpaceX will need to spend roughly $470 billion over the next five quarters.
Reidhead built that figure around the target SpaceX set on its third quarter earnings call: 13 gigawatts or more of compute by the end of 2027. In his breakdown, Nvidia captures 83 to 89 percent of the spending. SpaceX ended the quarter with 1.7 GW of nameplate compute and guided to $35 billion to $40 billion in fourth quarter capex, as Teslarati reported.
Musk did not attach a number to his claim, but the earnings call shows the argument. CFO Bret Johnsen said new compute currently pays for itself in under a year at today’s pricing, and Musk said that window could shrink to six months next year. Using that pace, Reidhead argues about $230 billion of the $470 billion could come from operating cash flow and about $60 billion from SpaceX’s roughly $90 billion cash pile, leaving around $180 billion to borrow. Musk confirmed last week that SpaceX had already closed a new $40 billion debt raise to buy GPUs.
The ground buildout is not the end goal. It is what is meant to pay for the move to orbit. Replying on Friday to charts built from Sequoia partner Shaun Maguire’s SpaceX model, Musk wrote that “Terrestrial compute will be peanuts compared to orbital compute,” adding that orbital compute deployed per month “probably exceeds terrestrial around the end of 2028 and then far exceeds it in 2029.”
Maguire’s model shows how steep that path is. It has capex climbing from $88 billion this year to $290 billion in 2027 and $369 billion in 2028, with SpaceX burning $77.8 billion in cash this year and $122.6 billion next year before turning $114.9 billion cash positive in 2028. Musk’s response to the model was, “I think we can do better.”
The orbital half runs through Starmind. SpaceX plans to operate up to 1 million AI satellites flying in clusters of about 10, linked by roughly 10 terabits of bandwidth, with deployment of thousands of units starting as soon as late 2027 out of its Gigasat factory in Bastrop, Texas, according to SpaceX’s space safety page. Musk has said each Starmind spacecraft will carry more than 250 kW of solar power.
Getting there depends on launch volume. Maguire’s model assumes 250 Starship flights in 2028, up from two this year and 38 next year. The nearer test is financial: SpaceX guided to $33 billion to $37 billion in first quarter 2027 revenue, more than double the $14.58 billion it booked in Q3, and Musk reposted that guidance again on Sunday morning.
Elon Musk
SpaceX President to gift Trump Accounts her SpaceX stock
Gwynne Shotwell’s 2 million SpaceX shares are headed to children’s Trump Accounts starting this December.
SpaceX President Gwynne Shotwell said Friday that more than 2 million SpaceX shares belonging to her and her husband, Robert, will be distributed to children’s Trump Accounts in December, turning a pledge she made over the summer into an actual transfer. “Robert and I are thrilled that our gift of over 2 million shares of SpaceX stock will be distributed to children’s Trump accounts in December!” Shotwell wrote on X, adding that the shares are “transferring to escrow as we speak.”
The first round goes to children aged 11 to 17 who live in ZIP codes where the median family income is $57,000 or less, along with kids in ZIP codes with too few residents for the Census to report that figure. Shotwell said those families should receive a notice by Monday, Reuters reported.
A second gift is expected to be finalized in the next few weeks. That round will cover eligible children in military families serving overseas, children in foster care, and more kids in Texas counties near the Shotwells’ home where median family income is $90,000 or less. Elon Musk replied to the announcement with “Cool” and a heart emoji.
Shotwell first announced the donation on July 6, less than a month after SpaceX priced its record IPO at $135 per share on the Nasdaq. IPO filings showed Shotwell owned about 12.6 million SpaceX shares, Quartz reported at the time, which makes the gift roughly one sixth of her stake. At the roughly $146 per share used to value Musk’s own pledge earlier this month, 2 million shares are worth about $290 million.
How the stock would actually reach the accounts had been an open question since July. Treasury guidance acknowledged that stock donations could flow into Trump Accounts, but it did not explain the mechanics for a program whose contributions default into an S&P 500 index fund. Shotwell thanked the Treasury, the IRS, the Dell Foundation, Greater Horizons, Invest America and the law firms Morgan Lewis and Gibson Dunn for “working over the past few months to make this happen.”
The transfer also works as a dry run for a far larger gift. On October 19, Musk said he would give one of his SpaceX shares to every kid in America next year and called it “the first of many.” With roughly 72 million children in the country, that pledge is worth about $10.5 billion. President Donald Trump thanked Musk the same day and said the shares would go through Trump Accounts, though neither SpaceX nor the Treasury has published how or when that distribution will happen.
Shotwell’s recipients also fill a gap in the program itself. Trump Accounts launched on July 4, and the $1,000 Treasury deposit only goes to babies born between 2025 and 2028. Teenagers aged 11 to 17 receive no government seed money, so for many of the families getting a notice on Monday, SpaceX stock will be the first asset in the account. The accounts convert into retirement accounts when the child turns 18.
Tesla Full Self-Driving is now the centerpiece of the company’s newly revised Referral Program, which launched on October 29.
Instead of referring people to purchase vehicles and the referrer receiving $250 in Tesla Credit, the new program now incentivizes Full Self-Driving subscriptions.
If a Tesla owner is on an FSD trial and uses a referral code to subscribe to Full Self-Driving, the person whose Referral Link was used will receive one month of FSD (Supervised). Their code can be utilized 12 times per year, with January 1 marking the reset date.
Realistically, this means that if your Referral Code is used by 12 Tesla owners on an FSD trial, you will receive a full year of FSD for free.
🚨 Here is Tesla’s new Referral Program for Full Self-Driving (Supervised):
When someone subscribes to FSD using your link, you’ll get a month free. Up to a year of FSD is available to you for free!
If you’d like to use my link: https://t.co/g00IX9OCE3 https://t.co/GFBzEO2jjS
— TESLARATI (@Teslarati) October 30, 2026
The previous program made it pretty difficult to get referrals; buying a vehicle is obviously a much larger financial strain than subscribing to Full Self-Driving for a month.
Of course, the previous Referral Program also offered a tangible benefit: $250 in credits you could use on Service, Supercharging, or anything in the Tesla Shop. It truly could pay for someone’s travel for a year. It recently bought me a new backpack and a T-shirt.
However, this new program is much more attainable for those who do not have a massive online presence of a slew of friends in the Tesla community who will use the code and max out subscriptions for vehicle purchases.
Woke up to maxed out Referrals! Thank you guys, that’s awesome!
Share your referral link below so others can use it! https://t.co/kesbwTcoTV
— TESLARATI (@Teslarati) October 30, 2026
The Full Self-Driving suite will now be the keystone of the Referral Program, which makes it more inclusive and more fun for everyone with an awesome benefit.
It also gives the impression that Tesla is truly focused on FSD subscriptions, something that saw a tremendous increase in volume in Q3, as 75 percent of deliveries for the quarter came with an FSD subscription attached.
Full Self-Driving data is so instrumental to the suite’s improvement that this kind of program benefits Tesla as much as it does the consumer.
Elon Musk calls Earth’s data centers “peanuts” next to what SpaceX is planning in orbit
SpaceX President to gift Trump Accounts her SpaceX stock
