Connect with us

News

Tesla Autopilot’s 4D upgrade could lead to more FSD features

Tesla Autopilot (Source: Elon Musk | Twitter)

Published

on

Tesla CEO Elon Musk stated that the company’s Autopilot systems are being upgraded to 4D, which will improve the performance and capabilities of the semi-autonomous driving function. Currently, Autopilot is operating with “~2.5D,” Musk said.

The developments came from a question that was asked by a Twitter follower of Musk’s who has issues using Tesla’s Summon feature on his driveway. Summon allows owners to retrieve their vehicles by using their Smartphones. By holding the “COME TO ME” button within the Tesla app, the car will use GPS vectoring to travel to the location of the phone.

Summon is a part of Tesla’s Full Self-Driving suite. But, the rework of Autopilot’s dimensional upgrade is apart of something much bigger. Perhaps it deals with a complete rewrite of Autopilot that will extend the company’s FSD features.

However, the owner stated that the grade of his driveway is slightly steeper than 10%, which inhibits the vehicle from traveling up roads that have inclines. The steepness of the slope, along with normal transitions from a street to a driveway, can present issues for Tesla’s Autopilot. This could be due to the lack of information that Tesla’s Neural Network has for navigating these environments.

Advertisement
-

With that being said, Tesla is developing a 4-dimensional system for Autopilot. The development of new elements for Autopilot to comprehend the surroundings and road environment of the vehicle could lead to more drastic improvements and an increasingly accurate comprehension of the roads a vehicle travels on.

Tesla’s currently Autopilot suite uses ~2.5D, Musk said. Now, it uses two-dimensional images along with labels, which could account for the around 2.5 dimensions that Musk spoke of in the tweet.

Tesla Autopilot (Source: Elon Musk | Twitter)

Adding dimensions to the Autopilot system will simply increase the accuracy of how the car reacts in certain situations. Currently, Tesla uses images from Autopilot cameras that are labeled with information. Tesla could use 3-dimensional stereoscopic scenes that are reconstructed from video, along with timestamps to improve accuracy.

A few members of the Tesla community put their two cents in on what the 4-dimensional Autopilot system could entail.

Reddit user u/__TSLA__ stated that curating a massive series of traffic scenarios and objects that a car might encounter during a drive could improve the accuracy of Autopilot and Tesla’s self-driving capabilities.

However, another Reddit user, u/Semmel_Baecker, said that 4D could mean that the Autopilot cameras could build a real-time 3D environment and then predict the movements of labeled objects in 4D based on past behaviors of other vehicles. This strategy would effectively use the Neural Network to learn the reactions of other drivers or objects.

Tesla continues to develop Autopilot behaviors to eventually release a “feature complete” Full Self-Driving suite in the future. The electric automaker continues to release patents that aim to build a more accurate Autopilot system that will accelerate the company’s journey toward Level 5 Autonomy, which Musk says is coming soon.

Advertisement
-

Most recently, Tesla submitted a patent titled, “Enhanced Object Detection for Autonomous Vehicles Based on Field View,” that would crop important objects in images and increase the resolution of those images. If pedestrians, vehicles, or other objects are available in an image, they would be available at an increased resolution to improve the accuracy of Autopilot.

Tesla’s exact plans for an Autopilot upgrade to 4-dimensional imagery is unknown. The increased accuracy is necessary for the company’s cars to drive in any environment. Tesla will soon release FSD’s “Driving on City Streets” function, which will complete the suite.

Joey has been a journalist covering electric mobility at TESLARATI since August 2019. In his spare time, Joey is playing golf, watching MMA, or cheering on any of his favorite sports teams, including the Baltimore Ravens and Orioles, Miami Heat, Washington Capitals, and Penn State Nittany Lions. You can get in touch with joey at joey@teslarati.com. He is also on X @KlenderJoey. If you're looking for great Tesla accessories, check out shop.teslarati.com

Advertisement
Comments

Investor's Corner

Elon Musk drops a Thanksgiving hint about Starship’s biggest test yet

Elon Musk says Starship Flight 15 will try to catch the ship itself, a first.

Published

on

By

Rendering of Elon Musk overlooking a Starship fleet (Credit: Grok)

Elon Musk says SpaceX’s next Starship flight will try something nobody has done before, by catching the ship itself. Speaking to roughly 2,000 people at the X Takeover event at Giga Texas on Saturday, Musk said Flight 15 is about four to six weeks away and “probably launches a little bit before Thanksgiving, is my guess.”

That is a slip from earlier reporting, which had pointed to a launch as early as October 19. Musk explained why the date keeps moving. “We’re making a bunch of improvements to the rocket between every flight,” he said, adding that there are often hundreds, sometimes thousands, of small changes. This time the list is short, “but some of them take a fair bit of work and we’ve got to go inside the tank to make some of these changes.”

“We’re going to try to catch the ship, which is a super big deal,” Musk said. “If we do so, that’ll be the first time that there’s been full recovery of an orbital class rocket.” SpaceX has already caught the Super Heavy booster with the tower’s mechanical arms, and has talked about catching the ship since late 2025, but the upper stage has never been caught.

Musk also laid out what comes after. “The next big milestone would be to refly both the booster and the ship,” he said, describing a Flight 16 where “all parts of an orbital rocket are reflown.”

The reason SpaceX wants this comes down to cost and cadence. Every Starship ship so far has ended its flight in the ocean, and SpaceX expects most of those water landings to end in fireballs. A ship that returns to Starbase intact can be inspected and flown again. SpaceX’s IPO filing, says Starship V3 is designed to deliver 100 metric tons to orbit in a fully reusable configuration, that SpaceX aims to cut the cost to reach orbit by 99% or more versus the historical average, and that tower catches should allow “multiple launches per day.”

Advertisement
-

The payoff goes beyond cheaper launches. The next generation Starlink V3 satellites are too large for Falcon 9 and can only fly on Starship, which can carry up to 60 per flight. Flight 14 on September 28 deployed the first 26 of them after Starship reached orbit despite an early engine shutdown, as Teslarati reported. Musk blamed engine computer software, and said the heat shield “was extremely robust,” which he claimed in August had solved Starship’s biggest challenge.

NASA’s Moon plans depend on the same capability. NASA’s inspector general has described a lander mission that needs a propellant depot in low Earth orbit and more than 10 tanker flights, with SpaceX targeting one tanker launch every six days. That schedule only works if ships and boosters come back fast and fly again. Also, ship to ship propellant transfer has not been attempted yet.

One interesting hurdle yet to be explored is bringing the ship back to the launch site, with reentry over land, which will undoubtedly come with a lot of aviation safety reviews.

Continue Reading

Lifestyle

Tesla’s mirrorless Cybercab will give riders a visibility upgrade

Tesla engineer confirms Cybercab update letting riders pull up rear and repeater cameras on demand.

Published

on

By

Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)
Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)

Tesla is working on a Cybercab update that would let passengers pull up the vehicle’s rear and side cameras on demand, and the request came straight from a rider.

The exchange played out on X late Friday. Cybercab rider Dan Burkland shared photos of the two-seater’s cabin screen after an evening ride, praised the UI team’s work, and left one request: let riders open the rear and repeater cameras whenever they want, “especially for peace of mind.” Tesla UI software engineer Evan (@CarCoder) answered with two words: “In development.”

The idea fits a pattern Teslarati has tracked since public rides began. Days after paid Cybercab service opened in Austin, Tesla sent riders a survey that asked them to rate the touchscreen, the app and the cabin, and to pick the features they wanted most. We reported on that survey in September, and a camera view is the kind of small software change Tesla can push quickly if riders keep asking.

Advertisement
-

It also speaks to something unique about the vehicle. With no steering wheel, no pedals and no driver, passengers have no mirror to check and no way to see behind them. The hardware is clearly built for camera awareness, from the repeater cameras to the rear camera. Letting a passenger look through those same cameras would give a nervous first time rider a way to confirm what is around the car.

The timing matters because the fleet is growing fast. Tesla’s Robotaxi account said on Saturday that more than 300 Cybercabs are now serving Austin, an eightfold increase in 30 days, and Tesla AI chief Ashok Elluswamy named Dallas as the next city. More cars and more cities mean more people riding in a driverless vehicle for the first time, which is exactly when small trust features carry weight.

For now, the feature is confirmed only as in development. If Tesla follows its usual pattern with Cybercab software, riders could see it appear in a point release without any announcement, and Teslarati will watch for it.

Continue Reading

News

Tesla’s Cybercab fleet jumped 8x in a month, with Dallas up next

Tesla confirms its first official Cybercab fleet number as Austin scales fast and Dallas looms.

Published

on

By

Tesla says more than 300 Cybercabs are now serving Austin, the first time the company has put an official number on its active Cybercab fleet. The figure came from the Robotaxi account on X on Saturday, which wrote that one month after launch the service had “scaled to 300+ Cybercabs serving Austin – an 8x increase in 30 days.”

Ashok Elluswamy, Tesla’s head of AI software, quoted the post with a line that carried the bigger news. “Two years since the 10/10 Cybercab WeRobot event, the cabs are everywhere in Austin now. Dallas soon,” he wrote. It is the first time Tesla has named the next city for public Cybercab rides.

Tesla opened Cybercab rides to the public in Austin on September 4, as Teslarati reported, a day after an invite only launch event. The ramp since then has been steep. Our September 28 report had the fleet at well over 100 units after availability jumped from 58 to 125 in a single week. On Thursday, Tesla added 150 Cybercabs to the Texas automated vehicle registry, lifting its registered count to 319 from 169. The first seven appeared on the registry on August 31.

RobotaxiTracker, a community site that counts vehicles from sightings and state records, listed 275 vehicles in unsupervised service in Austin on Saturday, 105 of them Cybercabs, which is well below Tesla’s figure. Tracker counts can lag official numbers, though Sawyer Merritt noted that Cybercab wait times in Austin stayed short on Saturday evening even with more than 2,000 fans in town for X Takeover.

Advertisement
-

Regulators are watching the rollout. NHTSA opened an audit query into Tesla’s certification that the Cybercab meets federal safety standards, and sworn answers are due October 30. Tesla reports third quarter earnings on October 21, which gives the company a natural venue to define its fleet numbers and put a date on Dallas.

Continue Reading