Connect with us

News

Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features

Tesla Smart Summon in action. (Credit: Rody Davis/YouTube)

Published

on

A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.

The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.

“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”

The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.

“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”

Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.

Advertisement
-
Tesla Owners Silicon Valley Smart Summon Model 3s (Credit: @MinimalDuck)

When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:

  • Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
  • Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
  • Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
  • Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.

One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.

Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
Comments

News

Tesla Robotaxi app update now tells riders if Cybercab is the better choice

Tesla’s Robotaxi app now shows ETAs, wait times and availability for Cybercab and Model Y.

Published

on

By

Concept art of a Tesla Cybercab in Las Vegas Strip as rendered via Grok

Tesla has rolled out a new vehicle selection screen in its Robotaxi app, and it puts the numbers riders care about most in front of them before they book.

Version 26.11.0 of the app shows the estimated arrival time, the expected wait and current availability for each vehicle option on a single screen, according to a video shared by @gheeunit  on X on November 7. Riders deciding between a Cybercab and a Model Y Robotaxi can now compare those figures side by side instead of picking a car first and learning how long it will take afterward.

Tesla first gave riders that choice on September 3, the day paid Cybercab rides began in Austin. The original version of the screen listed the Cybercab, which seats two, next to the Model Y, which seats four. A later build, 26.8.2, added a seating capacity indicator so groups knew which car would fit them. What it did not show was whether choosing the Cybercab meant standing on the curb a few extra minutes.

That question matters more now than it did two months ago. Tesla had 45 Cybercabs on the Texas DMV roster when rides started. By late October the state listed 573, alongside 631 Model Ys, and community trackers logged a record 1,576 Cybercab sightings across Austin on Halloween alone. With two large fleets sharing one service area, the closest car and the quickest pickup are not always the same vehicle.

Advertisement
-

Inline availability also changes what happens when demand spikes. If no Cybercab is free nearby, the rider sees that on the selection screen rather than after trying to book one.

For now the comparison is mostly an Austin feature. Riders in Dallas, Houston, Fort Worth and the Florida markets are still matched with Model Y vehicles, though Tesla said on its third quarter earnings call that Cybercab rides would launch in Dallas this month.

The update follows a steady run of smaller changes to the rider experience. Late last month Tesla brought a quiet mode that blacks out the cabin screen to Model Y Robotaxis after first testing it in the Cybercab, and it has stretched Austin service to run from 6 a.m. to 2 a.m.

The Cybercab side of that selection screen is about to get much busier. Elon Musk said this week that Tesla will wind down Cybertruck production at Gigafactory Texas around the middle of 2027 to make room for more Cybercab output, and Tesla has said it is aiming to get Cybercabs to customers by the end of this year.

Tesla has not published official release notes for version 26.11.0.

Advertisement
-
Continue Reading

Cybertruck

Tesla is ending Cybertruck production

Published

on

Credit: diagnosticdennis/Instagram and @smile__no via Tesla Owners of Santa Clarita Valley/X

Tesla is ending Cybertruck production sometime in mid-2027, according to CEO Elon Musk.

Musk made the announcement on X last night, which came as a shock to many. He said that the Cybertruck will end production “to make room for increased Cybercab production” at Gigafactory Texas.

It is a huge blow to the fans of Tesla who have come to love the Cybertruck and identify with it as a symbol of their fandom. It has been the best-selling electric pickup, but it has had an underwhelming sales performance in terms of what was expected. This is mostly due to Tesla not meeting the prices it planned to offer the Cybertruck, as its unveiling and actual release were four years apart.

Overall, the responses were mixed. Some fans understood the move toward Cybercab production, especially as Tesla is truly pushing the autonomous future through its Robotaxi platform. However, others did not understand it.

“Damn, how many Cybercabs do you guys need?” one response read. Another said it was “Sad but understandable.”Even analyst Gary Black had responded to the news, stating he hoped Tesla planned to replace it with a traditional pickup design.

It doesn’t seem like that will be the case.

Tesla is so hell-bent on delivering autonomy and eventually providing a driverless service that owning a car seems like an arbitrary idea, according to their thesis. Instead, Cybercabs will be available to pick you up and drop you off on demand, safely, without any human help.

As a result, Tesla has thinned its lineup considerably, and one can only ask where the vehicle lineup goes from here. Eventually, it seems like Cybercab could be the only vehicle that Tesla will sell.

Continue Reading

Elon Musk

SpaceX’s next Starship flight set to make history on Friday the 13th

SpaceX is targeting Friday, November 13 for Starship Flight 15 and its first ship catch.

Published

on

By

SpaceX is targeting Friday, November 13 for Starship Flight 15, the mission the company plans to use for its first attempt at catching the ship itself with the launch tower.

SpaceX Vice President of Launch Kiko Dontchev shared the date on stage at the UP.Summit on Thursday, according to Ars Technica’s Eric Berger, who was in attendance. It is the first launch target to come directly from a SpaceX executive. Until now, the public schedule had relied on FAA air traffic planning slides, which listed Flight 15 for no earlier than November 8 and later November 12. SpaceX has not posted an official mission page yet, and no launch time has been shared.

The date lands inside the window Elon Musk sketched out last month. Speaking at Giga Texas on October 10, Musk said the flight would “probably launch a little bit before Thanksgiving,” as Teslarati reported. On SpaceX’s third quarter earnings call ten days later, he confirmed that Flight 15 would try to catch both the Super Heavy booster and the ship, and put the odds of a successful ship catch at “more likely than not.” SpaceX also aired an animation of the maneuver during that webcast, showing the ship swinging vertical over Starbase before dropping into the tower’s chopsticks.

The hardware is ready. Booster 22 fired all 33 of its Raptor engines for a full duration static fire at Pad 2 on October 25. Ship 42 followed with a single engine burn simulating a deorbit maneuver on October 26 and a 60 second firing of all six engines the next day, according to NASASpaceflight. Ship 42 had already rehearsed the catch in September, when the Pad 2 arms lifted it into position and crews connected the quick disconnect arm while the vehicle hung from the tower.

The remaining hurdle is regulatory. The FAA’s Starship page does not yet list a Flight 15 license. SpaceX President Gwynne Shotwell said in October that, after “significant constructive engagement with the FAA,” she expects the license to cover a return to the launch site and a tower catch for both stages. Bringing the ship home means a reentry path that heads toward land, rather than ending over open ocean as every Starship flight so far has.

Advertisement
-

SpaceX has caught Super Heavy three times, on Flights 5, 7 and 8, but the ship comes back from orbital velocity and has never been caught. Flight 14 on September 28 was the first Starship to reach orbit, deploying 26 Starlink V3 satellites before splashing down despite an early engine shutdown that Musk blamed on engine computer software.

Musk has called a successful ship catch “the first time that there’s been full recovery of an orbital class rocket,” and he has already named the step after it: a Flight 16 where both the booster and the ship fly again. NASASpaceflight reports that Ship 43, the next vehicle in line, is set for static fire testing in December.

Continue Reading