News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
SpaceX President to gift Trump Accounts her SpaceX stock
Gwynne Shotwell’s 2 million SpaceX shares are headed to children’s Trump Accounts starting this December.
SpaceX President Gwynne Shotwell said Friday that more than 2 million SpaceX shares belonging to her and her husband, Robert, will be distributed to children’s Trump Accounts in December, turning a pledge she made over the summer into an actual transfer. “Robert and I are thrilled that our gift of over 2 million shares of SpaceX stock will be distributed to children’s Trump accounts in December!” Shotwell wrote on X, adding that the shares are “transferring to escrow as we speak.”
The first round goes to children aged 11 to 17 who live in ZIP codes where the median family income is $57,000 or less, along with kids in ZIP codes with too few residents for the Census to report that figure. Shotwell said those families should receive a notice by Monday, Reuters reported.
A second gift is expected to be finalized in the next few weeks. That round will cover eligible children in military families serving overseas, children in foster care, and more kids in Texas counties near the Shotwells’ home where median family income is $90,000 or less. Elon Musk replied to the announcement with “Cool” and a heart emoji.
Shotwell first announced the donation on July 6, less than a month after SpaceX priced its record IPO at $135 per share on the Nasdaq. IPO filings showed Shotwell owned about 12.6 million SpaceX shares, Quartz reported at the time, which makes the gift roughly one sixth of her stake. At the roughly $146 per share used to value Musk’s own pledge earlier this month, 2 million shares are worth about $290 million.
How the stock would actually reach the accounts had been an open question since July. Treasury guidance acknowledged that stock donations could flow into Trump Accounts, but it did not explain the mechanics for a program whose contributions default into an S&P 500 index fund. Shotwell thanked the Treasury, the IRS, the Dell Foundation, Greater Horizons, Invest America and the law firms Morgan Lewis and Gibson Dunn for “working over the past few months to make this happen.”
The transfer also works as a dry run for a far larger gift. On October 19, Musk said he would give one of his SpaceX shares to every kid in America next year and called it “the first of many.” With roughly 72 million children in the country, that pledge is worth about $10.5 billion. President Donald Trump thanked Musk the same day and said the shares would go through Trump Accounts, though neither SpaceX nor the Treasury has published how or when that distribution will happen.
Shotwell’s recipients also fill a gap in the program itself. Trump Accounts launched on July 4, and the $1,000 Treasury deposit only goes to babies born between 2025 and 2028. Teenagers aged 11 to 17 receive no government seed money, so for many of the families getting a notice on Monday, SpaceX stock will be the first asset in the account. The accounts convert into retirement accounts when the child turns 18.
Tesla Full Self-Driving is now the centerpiece of the company’s newly revised Referral Program, which launched on October 29.
Instead of referring people to purchase vehicles and the referrer receiving $250 in Tesla Credit, the new program now incentivizes Full Self-Driving subscriptions.
If a Tesla owner is on an FSD trial and uses a referral code to subscribe to Full Self-Driving, the person whose Referral Link was used will receive one month of FSD (Supervised). Their code can be utilized 12 times per year, with January 1 marking the reset date.
Realistically, this means that if your Referral Code is used by 12 Tesla owners on an FSD trial, you will receive a full year of FSD for free.
🚨 Here is Tesla’s new Referral Program for Full Self-Driving (Supervised):
When someone subscribes to FSD using your link, you’ll get a month free. Up to a year of FSD is available to you for free!
If you’d like to use my link: https://t.co/g00IX9OCE3 https://t.co/GFBzEO2jjS
— TESLARATI (@Teslarati) October 30, 2026
The previous program made it pretty difficult to get referrals; buying a vehicle is obviously a much larger financial strain than subscribing to Full Self-Driving for a month.
Of course, the previous Referral Program also offered a tangible benefit: $250 in credits you could use on Service, Supercharging, or anything in the Tesla Shop. It truly could pay for someone’s travel for a year. It recently bought me a new backpack and a T-shirt.
However, this new program is much more attainable for those who do not have a massive online presence of a slew of friends in the Tesla community who will use the code and max out subscriptions for vehicle purchases.
Woke up to maxed out Referrals! Thank you guys, that’s awesome!
Share your referral link below so others can use it! https://t.co/kesbwTcoTV
— TESLARATI (@Teslarati) October 30, 2026
The Full Self-Driving suite will now be the keystone of the Referral Program, which makes it more inclusive and more fun for everyone with an awesome benefit.
It also gives the impression that Tesla is truly focused on FSD subscriptions, something that saw a tremendous increase in volume in Q3, as 75 percent of deliveries for the quarter came with an FSD subscription attached.
Full Self-Driving data is so instrumental to the suite’s improvement that this kind of program benefits Tesla as much as it does the consumer.
Elon Musk
Tesla made napping in a Robotaxi easier with its latest update
Tesla’s quiet mode reaches Model Y Robotaxis, blacking out the screen for riders wanting rest.
Tesla’s quiet mode, the setting that blacks out the screen for riders who want to rest, has moved beyond the Cybercab. A video posted Thursday by Spencer (@scotsrule08) shows the feature running in a Model Y Robotaxi on a night ride that appears to be in Dallas.
New quiet mode now on @Robotaxi https://t.co/2cM2eM9NeN — Spencer (@scotsrule08) October 29, 2026
The rider taps a small crescent moon icon in the bottom right corner of the map screen. The map, media player, app shortcuts and Grok prompt disappear, leaving a dark display with “Arriving soon,” the destination and a line reading “Tap display to exit quiet mode.” Controls a passenger may still need, including Pull Over, cabin temperature, volume and Support, stay visible. One tap anywhere brings the full map back.
Quiet mode first showed up in the Cybercab last week, which Teslarati reported alongside a new rear camera view. Tesla has been trimming cabin noise in other ways too. On October 25, Spencer reported that Robotaxi turn signals now chime for the first four blinks and then go silent. Tesla has not published release notes for either change.
Elon Musk has been pitching this use for more than a decade. In October 2014, he said that “maybe five or six years from now I think we’ll be able to achieve true autonomous driving where you could literally get in the car, go to sleep and wake up at your destination,”
By 2017 he was setting a higher bar. Speaking at TED, Musk said the hard part was not making self-driving work 99.9 percent of the time, “because, like, if a car crashes one in a thousand times, then you’re probably still not going to be comfortable falling asleep. You shouldn’t be, certainly.”
Owners asked for something similar in their own cars. In December 2019, a Tesla owner requested a Nap Mode that would keep the climate running and wake the occupant with an alarm, and Musk answered “Ok,” as Teslarati covered at the time.
The line returned when the Cybercab was unveiled at the We, Robot event in October 2024. “We’ll move from supervised Full Self-Driving to unsupervised Full Self-Driving, where you can fall asleep and wake up at your destination,” Musk said. On Tesla’s first quarter earnings call in April 2025, he called it the deciding measure: “The acid test is, can you go to sleep in your car and wake up in your destination and I’m confident that will be available in many cities in the US by the end of this year,”
Tesla has run driverless Model Y rides in Dallas and Houston since April, so a passenger dozing off on the way home is now a realistic use of the button. Tesla is also offering new riders a free first trip in both cities, according to an in-app screen shared by tracker Ethan McKanna, and said on its third quarter call that Cybercab rides would launch in Dallas next month.
SpaceX President to gift Trump Accounts her SpaceX stock
Tesla Full Self-Driving becomes main pillar of new Referral Program
