News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Investor's Corner
SpaceX is launching a secret spacecraft that could change how things are made in space
SpaceX’s secret disk-shaped Starfall capsule is targeting a market no reentry vehicle has cracked.
SpaceX is targeting Tuesday, June 23 for the first flight of Starfall, a reentry capsule the company has developed almost entirely in private. The Falcon 9 launch window opens at 6:43 a.m. ET from Space Launch Complex 40 at Cape Canaveral Space Force Station, with a backup window available the same time on June 24. SpaceX has made no public announcement about the vehicle, only providing launch details. Everything known about it has come through FAA and FCC regulatory filings.
What makes Starfall different starts with its shape. Rather than the traditional cone used by Dragon and every other cargo return capsule in operation, Starfall is a flat disk that measures roughly 10.2 feet (3.1 meters) wide and just 2.5 feet (0.75 meters) tall, and weighing 4,630 pounds (2,100 kg) and capable of returning up to 2,200 pounds (1,000 kilograms) of payload from orbit. The disk geometry maximizes structural efficiency and payload volume relative to mass, and the heat shield mechanically jettisons just before splashdown, allowing recovery teams to retrieve both the capsule and the shield separately from the Pacific Ocean.
The difference with Starfall from existing competitors, such as Varda Space Industries, which has largely built the orbital manufacturing market and returns heavy payloads per flight is that Starfall’s specification is roughly 30 times more per mission, and is designed to be mass-produced and launched on either Falcon 9 or Starship. That combination of volume and launch access is something no standalone startup can replicate, and it puts SpaceX in direct competition with the companies that currently pay it to reach orbit.
SpaceX to launch military missile tracking satellites through new Space Force contract
The intended market is orbital manufacturing: pharmaceuticals, protein crystals, semiconductors, and advanced optical fiber that physically cannot be produced in the presence of gravity. FAA documents describe Starfall’s long-term purpose as building a “self-sustaining commercial in-space manufacturing market” and as a potential successor to the industrial capabilities of the International Space Station, which is set to retire in the late 2020s. Military rapid global cargo delivery is a parallel application under active discussion with the Pentagon.
The reason some industries seek manufacturing in space comes down to gravity. On Earth, gravity causes materials to settle, separate, and deform during production. In microgravity, those constraints disappear.
SpaceX’s already controls launch access, which means it currently functions as the landlord for every competitor in the orbital manufacturing return space. Starfall converts that landlord position into vertical ownership, and it would no longer just carry other companies’ capsules to orbit, but rather operate the capsule, own the return logistics, and capture the service revenue directly. Viewed alongside Starlink, Colossus, and the xAI merger, Starfall fits a consistent pattern: SpaceX identifying infrastructure layers that others depend on and moving to own them outright. Orbital manufacturing return is the next layer on that list.
If Tuesday’s reentry, parachute sequence, and recovery demonstration goes as planned, the second FAA-approved test flight follows. A successful pair of demos would position SpaceX to begin offering Starfall as a commercial service, likely first to pharmaceutical and materials science customers before scaling toward the military and broader manufacturing segments.
The Tesla Semi was spotted mounted with ground truth validation equipment as the company nears its looming launch. The Semi is Tesla’s Class 8 all-electric truck, and has been utilized in its earlier stages by many companies like PepsiCo. and Frito-Lay, who have been using it in a pilot program.
The Semi was spotted in Sunnyvale, California, and sports a typical ground truth validation unit that Tesla routinely uses on its vehicles. Ground truth validation is essentially the process of training supervised algorithms to ensure they can perform reliably. Tesla typically performs this on vehicles that are being released soon:
Spotted the new semi adorned with ground truthing equipment. Haven’t seen anyone post this so figured I’d share.
The future is autonomous!!@SawyerMerritt @wholemars pic.twitter.com/qkPDHPUQZ6
— Danny (@dannywinner1) June 21, 2026
The Semi being spotted with this type of validation rig is important because it means the company is working on solidifying a Full Self-Driving model for its commercial vehicle offering. This would be a massive development for not only Tesla but also the logistics industry as a whole.
There are strict regulations on driving hours for commercial truck drivers, and autonomy is a way to potentially combat these issues. FSD is already a widely effective way that owners of typical passenger vehicles take stress out of travel. Even launching a semi-autonomous platform for truck drivers to use to increase safety, reduce fatigue, and increase productivity would be a huge development.
Tesla Semi gets strange-but-understandable comparison from Jay Leno
The Semi has already proven to be an ideal solution for companies that use commercial logistics. It has increased efficiency and reduced operating costs for many companies that have been able to use it in pilot programs.
There are expected to be some bumps along the way. Tesla saw some challenges with FSD on the Cybertruck, as it had never had a vehicle with cameras at that height, so some of the features with FSD were not immediately available. Just a week ago, Tesla launched Actually Smart Summon (ASS) for Cybertruck, nearly three years after the vehicle was first delivered to customers.
President Donald Trump unveiled an upgraded Boeing 747-8 at Joint Base Andrews on June 19, 2026, describing the Qatar-gifted aircraft as an interim Air Force One equipped with advanced communications systems, including Starlink, Elon Musk’s SpaceX satellite internet service.
The plane, valued at around $400 million and modified for presidential use, serves as a bridge until the delayed VC-25B replacements arrive. Trump highlighted its luxury features and new technology during remarks to service members.
Trump stated:
“We have communication equipment up there that nobody’s ever seen before. It’s the highest level and, uh, including Starlink. My friend Elon is going to be very happy, but, uh, Starlink and we have, uh, four or five different sets of double and triple communications like people haven’t seen.”
He added:
“And it represents what can happen with hard work, innovation, and aggressive timelines because we did this quickly and yet there’s never been communication like is on this plane.”
🚨 President Trump confirmed today that the new Air Force One is equipped with Starlink:
“We have communication equipment up there that nobody’s ever seen before, it’s the highest level and including Starlink…my friend Elon is going to be very happy.” pic.twitter.com/IhkDmtr5hL
— TESLARATI (@Teslarati) June 20, 2026
The aircraft features a redesigned red, white, and blue livery and has been outfitted with Starlink satellite connectivity alongside other secure systems.
Trump praised the plane’s uniqueness, calling it among the world’s most luxurious. The gift from Qatar and subsequent modifications have drawn attention, with the jet positioned as a solution for presidential travel. It is expected to support operations, including potential ceremonial roles such as Fourth of July flyovers.
The event marked the formal introduction of the converted jet, which will help maintain capabilities while the primary Air Force One fleet undergoes modernization. Defense observers note the inclusion of commercial satellite technology like Starlink as part of efforts to ensure resilient communications, crucial to keep the country running as the President is in the sky.
President Trump’s comments underscored appreciation for rapid upgrades and innovation in equipping the aircraft. The plane remains a U.S. government asset and is slated for eventual transfer related to presidential library purposes after its service.
SpaceX is launching a secret spacecraft that could change how things are made in space
Tesla Semi spotted with ground truth validation equipment as launch looms
