News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
News
Tesla Cybercabs take over Austin’s F1 weekend
Tesla Cybercabs swarmed Austin’s F1 Grand Prix as sightings hit a record during race weekend.
Tesla’s driverless Cybercabs used the Formula 1 United States Grand Prix in Austin as their biggest public stress test yet. On Sunday afternoon, Tesla head of AI software Ashok Elluswamy quoted a photo from X user Ben Steindl showing a long line of gold Cybercabs and Model Y Robotaxis stacked up on a road near Circuit of the Americas. “Robotaxis as far as the eye can see!” Elluswamy wrote. Steindl’s original post was more matter of fact: “@Tesla @robotaxi is busy for the Austin F1.”
The fleet also handled the trip home. The race started at 3 p.m. Central, and once it ended, Cybercab Spotter, an account that logs Cybercab sightings around Austin, posted that “People are requesting Cybercabs to get home.”
Robotaxis as far as the eye can see! 🤩
— Ashok Elluswamy (@aelluswamy) October 25, 2026
Tesla set this up days in advance without announcing it. Late on October 22, rider David Moss posted Robotaxi app screenshots showing the Austin service area wrapping around the track toward Elroy and FM 812, with ride requests open until 1 a.m. A banner in the app read “Last call is 1am · Limited to nearby dropoffs.” Austin rides ended at 11 p.m. as recently as early October, as Teslarati reported, before moving to midnight on October 17.
Not every rider got dropped at the gate. Early app searches showed spots like COTA Karting as “Service blocked,” and one rider who took a Cybercab to the track Friday said the rideshare area was less than a 20 minute walk from the front gate.
The weekend also produced a new activity record. Cybercab Spotter counted 1,250 Cybercab sightings in Austin on Saturday, qualifying day. The previous high was 1,072 on October 16. Sightings count the same car more than once, so they measure how busy the fleet is rather than how big it is. For size, the Texas automated vehicle registry listed 463 Cybercabs at midday Sunday, up from the 300+ Tesla claimed on October 10, when Elluswamy also said Dallas is next for Cybercab.
The track was out of reach for Tesla’s main rival. Waymo runs in Austin only through Uber, and its service area stops well short of COTA. Waymo did not announce any race day service.
Tesla has not said how many rides it gave to and from the circuit, or whether the expanded zone and 1 a.m. cutoff will stay after race weekend. On the third quarter earnings call, Elluswamy said 2 a.m. service is coming “pretty soon” and that Tesla plans to run Robotaxi around the clock before the end of the year. The company is also aiming to hand the first Cybercabs to customers before 2026 ends, which would put cars like these outside Tesla’s own fleet for the first time.
News
Tesla makes good on its Cybercab promise in just two weeks
Tesla Cybercab riders can now pull up a rear camera view and darken the screen.
Tesla has given Cybercab passengers a way to see what is behind them, along with a way to turn the cabin screen off entirely.
Riders in Austin can now bring up a live rearview camera feed on the Cybercab’s center display in the middle of a trip. Austin rider Ethan McKanna spotted the change late Friday night, posting from a ride that “You can now open the camera to view what’s behind you in Cybercab!” His photo shows a strip of rear camera video across the top of the screen, with another Cybercab following on a bridge. Sawyer Merritt shared the image Saturday and wrote that it “sounds like” there is also a new quiet mode that darkens the entire screen for riders who want to relax, sleep, or avoid a bright display at night.
The camera view goes beyond the rear feed. Tesla UI software engineer Evan, who posts as @CarCoder, replied to McKanna with a tip: “You can also tap it to see more cameras, and swipe it up or down to hide and show.” Until now, the Cybercab only showed its rear and repeater feeds on the “Please Exit Safely” screen at the end of a ride, so passengers could check for cyclists and traffic before opening a door.
Quiet mode surfaced a day earlier. Austin rider Jackson Blatz posted a video Friday morning of the new Robotaxi interface in a Cybercab with the option. Tesla has not published release notes for either feature.
The rear camera view moved quickly from request to release. Earlier this month, Cybercab rider Dan Burkland asked Tesla to let passengers pull up the rear and repeater cameras whenever they want, “especially for peace of mind.” Evan answered “In development,” as Teslarati reported at the time. About two weeks later, riders have it.
The feature fills a gap created by the Cybercab’s design. With no steering wheel, no pedals, no mirrors and no rear window, a passenger has no natural way to glance behind the car. The eight exterior cameras that feed Tesla’s autonomy software were already on board, so the change only required software.
There is also an AI angle to how it was built. Yun-Ta Tsai, a senior staff engineer on Tesla’s AI team, quoted Merritt’s post and wrote that the “(human) camera view tuning is optimized with Grok and implements part of the algorithm by directly programming the fixed-function hardware, so I don’t even need to check the datasheet.” Tsai did not say which part of the algorithm Grok handled. Grok already plays a bigger role inside the vehicle, with Grok Bot now enabled across every Cybercab and the Model Y Robotaxi fleet after Tesla brought the agent into its cars in September.
The two features join a busy week of changes for riders in Austin, which also brought a redesigned Live Activity for iPhone and Apple Watch and live trip sharing. They also arrive as Tesla prepares the Cybercab for life outside its own fleet. On the third quarter earnings call, Lars Moravy said the company is aiming to deliver Cybercabs to customers before the end of 2026. Tesla has not said whether the camera view and quiet mode will also come to its Model Y Robotaxis.
Elon Musk
Tesla shows what Roadster drivers will see on screen before thruster activation
Tesla’s Roadster video reveals a fighter jet inspired cockpit with a 5,500 PSI thruster gauge.
Tesla has given future owners their clearest look yet at the cockpit of its next generation Roadster. In a 34 second video posted to X on Friday afternoon, the company walked through the car’s touchscreen with a caption: “Inspired by fighter jet cockpits, Roadster’s interface was designed around the pilot.”
The clip opens on a black screen with red graphics and a 3D wireframe of the car, which sits beside the Roadster’s squared off yoke. Tapping parts of the model brings up controls for the rear wing, including low drag and high downforce positions, along with a charging page with a charge limit bar and a small music player. A row of tabs along the bottom reads Home, Vehicle, Listen, Climate and Navigate.
Most of the video is spent in Track Mode. The dashboard shows a live circuit map, a list of session lap times, brake and motor temperatures, and pressure and temperature readouts for each tire. A setup page lets the driver pick Auto, Low Drag, High Downforce or Custom aero modes, adjust aero balance and brake balance, and switch stability and traction control off. Along the bottom, a status bar reads “Thruster · 5,500 PSI” next to a “Boost Ready” indicator.
That gauge ties the software to the hardware Tesla showed off near Waco, Texas on October 15. The Thrust and Rocket versions use cold gas thrusters fed by carbon overwrapped pressure vessels, and Tesla lists 0 to 60 mph times of under 0.9 seconds and under 0.59 seconds for them, as Teslarati detailed in its breakdown of the three Roadster configurations. The base Performance car relies on a fan and ground sealing system for grip, and the aero settings on screen match the active wings and suction setup covered in our look at how the Roadster generates downforce.
The Roadster layout is a departure from the rest of Tesla’s lineup. Instead of a map centered screen, the Roadster puts the car itself at the center of the home page, and Tesla’s Roadster page lists two smaller forward displays alongside the main touchscreen. Tesla has not said whether any of the Track Mode telemetry will make its way to the Model 3 Performance or other vehicles.
The interface could still change before deliveries. Elon Musk said at the event that Roadster production will begin in 2028, and Tesla says the flagship Rocket version is not approved for public road use. Reservations are open with a $50,000 payment, while Thrust is listed as a limited release and Rocket is invite only.
Those who want to see the car in person will get their first chance this weekend. The Roadster goes on display in the lobby of the Petersen Automotive Museum in Los Angeles from October 24 to 27, according to Sawyer Merritt, the first time the public will be able to view it up close.
Tesla Cybercabs take over Austin’s F1 weekend
Tesla makes good on its Cybercab promise in just two weeks
