Connect with us

News

Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features

Tesla Smart Summon in action. (Credit: Rody Davis/YouTube)

Published

on

A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.

The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.

“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”

The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.

“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”

Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.

Advertisement
-
Tesla Owners Silicon Valley Smart Summon Model 3s (Credit: @MinimalDuck)

When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:

  • Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
  • Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
  • Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
  • Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.

One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.

Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
Comments

News

Why Elon Musk’s target date for buying an Optimus robot is harder than it sounds

Musk says China’s magnet export ban cost Optimus months, and robot hands remain shockingly hard.

Published

on

By

Concept rendering of Tesla Optimus in mass production

Elon Musk says China’s export curbs on magnets used in electric motors set back Tesla’s Optimus program by two to three months, and that the robot’s hands remain the hardest part of the project. He made the comments Saturday during a live interview with Tesla Owners Silicon Valley at the X Takeover event at Giga Texas, in front of roughly 2,000 attendees. The Optimus discussion begins around the 49 minute mark of the stream.

On the hands, Musk was blunt and noted that a general purpose humanoid needs fine motor skills that are “incredibly difficult to get right. Shockingly difficult,” he said in the interview. He pointed to a problem he says no one has demonstrated yet: “One of the hardest things also generally is to do precision and force at the same time,” such as driving a small self tapping screw into wood. Touch sensors add another layer, since it is “actually kind of hard to get touch sensors that elastically deform and can handle high cycle life and it won’t just break after a few thousand cycles.”

He also took aim at rival robot videos. “Any complicated looking robot demo, it’s a canned demo. It’s not real,” Musk said, adding that real AI means showing a robot something it has never seen and watching it still cope, the way FSD handles a city it has never driven.

Musk expects the Optimus ramp to be slower than a new vehicle production ramp. “The initial part of that S curve of production ramp is going to be very slow at the beginning,” Musk said, partly because “unlike cars, there’s no pre existing supply chain for robot stuff.” That echoes his July reply on X that Optimus production “will be extremely slow at first, as everything is new.”

The magnet disclosure puts a number on a problem Musk first raised in 2025. He said China “prevented the export of magnets for use in electric motors” and that it “set back the Optimus program by like two or three months.” Then he added: “We had robots with no arms.” Tesla’s fix is to bring the supply chain home. “You’ve got to be able to make all the parts domestically,” he said. Teslarati reported in April 2025 that Musk tied the issue to permanent magnets in the arm actuators, where motors have to be as small as possible.

Advertisement
-

Tesla Optimus V3 hand and arm details revealed in new patents

Production is moving regardless, with a reported internal goal of more than 1,000 a week by the end of 2026. Teslarati recently covered how Tesla is certifying supply partners in China for Optimus parts, while the company’s hand design has been the subject of new patent filings.

Musk has said he wants Optimus available to the public by late 2027, though Tesla has not confirmed that date or published updated production figures.

Continue Reading

Investor's Corner

Elon Musk drops a Thanksgiving hint about Starship’s biggest test yet

Elon Musk says Starship Flight 15 will try to catch the ship itself, a first.

Published

on

By

Elon Musk says SpaceX’s next Starship flight will try something nobody has done before, by catching the ship itself. Speaking to roughly 2,000 people at the X Takeover event at Giga Texas on Saturday, Musk said Flight 15 is about four to six weeks away and “probably launches a little bit before Thanksgiving, is my guess.”

That is a slip from earlier reporting, which had pointed to a launch as early as October 19. Musk explained why the date keeps moving. “We’re making a bunch of improvements to the rocket between every flight,” he said, adding that there are often hundreds, sometimes thousands, of small changes. This time the list is short, “but some of them take a fair bit of work and we’ve got to go inside the tank to make some of these changes.”

“We’re going to try to catch the ship, which is a super big deal,” Musk said. “If we do so, that’ll be the first time that there’s been full recovery of an orbital class rocket.” SpaceX has already caught the Super Heavy booster with the tower’s mechanical arms, and has talked about catching the ship since late 2025, but the upper stage has never been caught.

Musk also laid out what comes after. “The next big milestone would be to refly both the booster and the ship,” he said, describing a Flight 16 where “all parts of an orbital rocket are reflown.”

The reason SpaceX wants this comes down to cost and cadence. Every Starship ship so far has ended its flight in the ocean, and SpaceX expects most of those water landings to end in fireballs. A ship that returns to Starbase intact can be inspected and flown again. SpaceX’s IPO filing, says Starship V3 is designed to deliver 100 metric tons to orbit in a fully reusable configuration, that SpaceX aims to cut the cost to reach orbit by 99% or more versus the historical average, and that tower catches should allow “multiple launches per day.”

Advertisement
-

The payoff goes beyond cheaper launches. The next generation Starlink V3 satellites are too large for Falcon 9 and can only fly on Starship, which can carry up to 60 per flight. Flight 14 on September 28 deployed the first 26 of them after Starship reached orbit despite an early engine shutdown, as Teslarati reported. Musk blamed engine computer software, and said the heat shield “was extremely robust,” which he claimed in August had solved Starship’s biggest challenge.

NASA’s Moon plans depend on the same capability. NASA’s inspector general has described a lander mission that needs a propellant depot in low Earth orbit and more than 10 tanker flights, with SpaceX targeting one tanker launch every six days. That schedule only works if ships and boosters come back fast and fly again. Also, ship to ship propellant transfer has not been attempted yet.

One interesting hurdle yet to be explored is bringing the ship back to the launch site, with reentry over land, which will undoubtedly come with a lot of aviation safety reviews.

Continue Reading

Lifestyle

Tesla’s mirrorless Cybercab will give riders a visibility upgrade

Tesla engineer confirms Cybercab update letting riders pull up rear and repeater cameras on demand.

Published

on

By

Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)
Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)

Tesla is working on a Cybercab update that would let passengers pull up the vehicle’s rear and side cameras on demand, and the request came straight from a rider.

The exchange played out on X late Friday. Cybercab rider Dan Burkland shared photos of the two-seater’s cabin screen after an evening ride, praised the UI team’s work, and left one request: let riders open the rear and repeater cameras whenever they want, “especially for peace of mind.” Tesla UI software engineer Evan (@CarCoder) answered with two words: “In development.”

The idea fits a pattern Teslarati has tracked since public rides began. Days after paid Cybercab service opened in Austin, Tesla sent riders a survey that asked them to rate the touchscreen, the app and the cabin, and to pick the features they wanted most. We reported on that survey in September, and a camera view is the kind of small software change Tesla can push quickly if riders keep asking.

Advertisement
-

It also speaks to something unique about the vehicle. With no steering wheel, no pedals and no driver, passengers have no mirror to check and no way to see behind them. The hardware is clearly built for camera awareness, from the repeater cameras to the rear camera. Letting a passenger look through those same cameras would give a nervous first time rider a way to confirm what is around the car.

The timing matters because the fleet is growing fast. Tesla’s Robotaxi account said on Saturday that more than 300 Cybercabs are now serving Austin, an eightfold increase in 30 days, and Tesla AI chief Ashok Elluswamy named Dallas as the next city. More cars and more cities mean more people riding in a driverless vehicle for the first time, which is exactly when small trust features carry weight.

For now, the feature is confirmed only as in development. If Tesla follows its usual pattern with Cybercab software, riders could see it appear in a point release without any announcement, and Teslarati will watch for it.

Continue Reading