News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Tesla Full Self-Driving, which is now referred to in Europe as “Tesla Assisted Driving” (TAD), is getting hit with a handful of new changes at the hands of the Netherlands’ vehicle authority, the RDW (Rijksdienst voor het Wegverkeer).
On 3 November, the RDW announced that it has assessed and approved a set of changes to Tesla’s FSD Supervised driver-assistance system. The updates introduce the official European name TAD and impose stricter controls on the system’s speed behaviour.
The new name will appear on the in-car display, in the owner’s manual, and in all other driver-facing information. The change applies to Tesla models equipped with Tesla Assisted Driving and hardware version 4.0 (HW4) or later.
Importantly, the RDW stressed that the name change does not alter the system’s fundamental operation: it remains a supervised driver-assistance feature that supports the driver in performing driving tasks. The driver stays fully responsible for controlling the vehicle at all times.
Beyond the rebranding, the most significant functional adjustments concern speed settings. Drivers will still be able to set a speed margin, a percentage by which the system may exceed the applicable speed limit when necessary for safety or traffic flow. However, the maximum allowable margin has been reduced from +50% to a maximum of +10%.
In addition, every time the vehicle is started, the speed-margin setting will default to 0% deviation, and other speed-related functions will be disabled by default. These changes will be delivered through an over-the-air (OTA) software update from Tesla.
Tesla requested the RDW’s review of these “minor changes.” After evaluating how the modifications were implemented and how the system behaves, the authority found no adverse or unintended effects on the system’s operation or the vehicle’s driving behaviour. Consequently, the existing type approval remains valid under the same conditions and for the same use; no amendment or extension of the approval is required.
The RDW has informed the nine EU member states that have already accepted its type approval—Belgium, Denmark, Estonia, Croatia, Latvia, Lithuania, Slovenia, Slovakia and Czechia—about the updates. Broader EU-wide approval is still under discussion within the European Technical Committee on Motor Vehicles (TCMV). Those proceedings remain confidential, and the RDW has declined to comment on them.
The approved changes align with earlier discussions involving German authorities, which had advocated both for clearer naming to avoid misleading drivers and for a tighter speed offset.
By formally incorporating these adjustments while leaving the core type approval intact, the RDW has cleared the way for Tesla to roll out the updated TAD software via OTA to eligible vehicles in the Netherlands and the other countries that recognise the Dutch approval. The system continues to function strictly as supervised driver assistance, with the human driver remaining the responsible party.
Tesla has released a fresh point-of-view video capturing the next-generation Roadster’s headline stunt from its October 15 unveiling, giving fans a visceral look at the car as it jumps and rotates over its siblings within the company’s vehicle lineup.
Tesla posted the video on X today with the caption “POV you’re a flying car,” and the roughly 30-second clip reveals never-before-seen angles directly attached to the Roadster. It’s really unbelievable:
The sequence reveals the uncrewed prototype firing its cold-gas thrusters, lifting off the ground, and barrel-rolling fully inverted while sailing over a staged lineup that includes a Model 3, Model Y, Cybercab, Cybertruck, and Tesla Semi.
Here’s an image of it that Tesla shared right after the unveiling event for a better perspective of what you’re looking at:
Credit: Tesla
There are also some other cool takeaways from the video, including the shift to the inverted-ramp demonstration. The Roadster uses its underbody suction-fan system to climb, then lock itself upside down on the ramp.
This generates multiple Gs of downforce, which then translates into the Roadster releasing these systems to enable a mid-air roll. The car then settles on its wheels gently as thruster vapor provides a perfect cushion.
All of the runs at SpaceX’s McGregor, Texas, test site, which is where the unveiling took place, were autonomous. Elon Musk stated this was a safety measure.
Tesla shows what Roadster drivers will see on screen before thruster activation
Tesla’s vehicle-engineering chief Lars Moravy dubbed the mid-air roll the “kickflip,” prompting Musk to quip that Tony Hawk would be proud and that the car could clear even more of the fleet. The thrusters, which use high-pressure compressed air and fast electric actuators, provide the precise, short-duration force needed for both the launch and the controlled rotation; the same hardware is intended for production versions of the higher-end Thrust and Rocket trims.
The second-generation Roadster, first teased in 2017, has been delayed repeatedly. Musk has indicated production is targeted for 2028.
While the company has yet to publish full pricing or independent performance verification, the combination of extreme acceleration, ground-effect suction, and limited flight capability has already positioned the car as one of the most theatrical EV reveals in years.
Musk has also said Tesla plans a dedicated Texas test track so future owners can experience the maneuvers themselves, far from public roads. The new POV clip simply lets everyone else feel a fraction of that experience from the car’s own cameras.
News
SpaceX’s Starfall just went from secret to storefront
SpaceX now pitches Starfall missions with 1,000 kg payloads, weeks of microgravity, and Starlink connectivity.
SpaceX has put up a dedicated commercial page for Starfall, its disk shaped reentry capsule, laying out for the first time what customers actually get when they book a flight. The page, live at spacex.com/starfall, pitches “affordable, routine access to microgravity” and invites companies to get in touch about flying manufacturing, research or testing payloads.
The specs are short and specific. Each Starfall mission carries up to 1,000 kg of payload, supplies 1 kW of power and connects through an Ethernet interface. Mission length is tailored to the customer, and the payload stays online the entire time through Starlink, which means researchers can pull data from an experiment while it is still in orbit instead of waiting for splashdown.
SpaceX is launching a secret spacecraft that could change how things are made in space
SpaceX is aiming the service at three markets. Biomedical customers are told they can grow stem cell organoids, replacement tissue and layered biomaterials. Pharmaceutical companies are pitched on protein and small molecule drug crystals, which form smaller and more uniform shapes without gravity driven convection. Materials science rounds out the list, with semiconductors and other next generation materials grown in vacuum and microgravity.
The page also makes clear which rocket SpaceX is counting on. “By launching on Starship, Starfall brings a reliable and scalable cadence previously unavailable to the market,” the company wrote, contrasting weeks of continuous microgravity with the seconds offered by drop towers and parabolic flights. No price or first operational flight date is listed.
The commercial push is a sharp turn from how Starfall started. SpaceX said almost nothing about the capsule ahead of its first flight in June, and nearly everything known came from FAA and FCC filings describing a disk about 10.2 feet wide and 2.5 feet tall that can return 2,200 pounds of cargo. By its second flight on the Bandwagon-5 rideshare in October, Starfall was listed by name on the mission page, though SpaceX still did not say what it carried.
Customers appear to be lining up. SpaceX said in its third quarter results that it signed three commercial Starfall missions during the quarter. On the earnings call, President Gwynne Shotwell described the capsule as providing “routine relatively low cost access to microgravity environments for scientific research, including improving our understanding of diseases like cancer and diabetes,” and said the three new missions would fly on Starship.
The branding effort extends past the website. SpaceX added a Starfall T-shirt to its online store on Monday as part of a batch of new merchandise, giving the program a place next to Starship, Starlink and Starshield in the company’s lineup.
The move also puts SpaceX in more direct competition with companies it launches. Varda Space Industries, which has built much of the in-space manufacturing market so far, flew its W-Series 7 capsule on the same Bandwagon-5 mission as Starfall in October. Varda’s capsules are roughly three times smaller than Starfall, and SpaceX controls the ride to orbit for both.
Starfall’s near term cadence depends on Starship. SpaceX is preparing for Flight 15 after completing static fires of Ship 42 and its Super Heavy booster in late October, and is aiming to catch both stages with the launch tower on that flight.
Tesla Full Self-Driving gets hit with some adjustments in Europe
Tesla shows off Roadster ‘kickflip’ over vehicle lineup in crazy new POV video
