Connect with us

News

Tesla Autopilot’s 4D upgrade could lead to more FSD features

Tesla Autopilot (Source: Elon Musk | Twitter)

Published

on

Tesla CEO Elon Musk stated that the company’s Autopilot systems are being upgraded to 4D, which will improve the performance and capabilities of the semi-autonomous driving function. Currently, Autopilot is operating with “~2.5D,” Musk said.

The developments came from a question that was asked by a Twitter follower of Musk’s who has issues using Tesla’s Summon feature on his driveway. Summon allows owners to retrieve their vehicles by using their Smartphones. By holding the “COME TO ME” button within the Tesla app, the car will use GPS vectoring to travel to the location of the phone.

Summon is a part of Tesla’s Full Self-Driving suite. But, the rework of Autopilot’s dimensional upgrade is apart of something much bigger. Perhaps it deals with a complete rewrite of Autopilot that will extend the company’s FSD features.

Advertisement
-->

However, the owner stated that the grade of his driveway is slightly steeper than 10%, which inhibits the vehicle from traveling up roads that have inclines. The steepness of the slope, along with normal transitions from a street to a driveway, can present issues for Tesla’s Autopilot. This could be due to the lack of information that Tesla’s Neural Network has for navigating these environments.

With that being said, Tesla is developing a 4-dimensional system for Autopilot. The development of new elements for Autopilot to comprehend the surroundings and road environment of the vehicle could lead to more drastic improvements and an increasingly accurate comprehension of the roads a vehicle travels on.

Tesla’s currently Autopilot suite uses ~2.5D, Musk said. Now, it uses two-dimensional images along with labels, which could account for the around 2.5 dimensions that Musk spoke of in the tweet.

Tesla Autopilot (Source: Elon Musk | Twitter)

Adding dimensions to the Autopilot system will simply increase the accuracy of how the car reacts in certain situations. Currently, Tesla uses images from Autopilot cameras that are labeled with information. Tesla could use 3-dimensional stereoscopic scenes that are reconstructed from video, along with timestamps to improve accuracy.

A few members of the Tesla community put their two cents in on what the 4-dimensional Autopilot system could entail.

Reddit user u/__TSLA__ stated that curating a massive series of traffic scenarios and objects that a car might encounter during a drive could improve the accuracy of Autopilot and Tesla’s self-driving capabilities.

Advertisement
-->

However, another Reddit user, u/Semmel_Baecker, said that 4D could mean that the Autopilot cameras could build a real-time 3D environment and then predict the movements of labeled objects in 4D based on past behaviors of other vehicles. This strategy would effectively use the Neural Network to learn the reactions of other drivers or objects.

Tesla continues to develop Autopilot behaviors to eventually release a “feature complete” Full Self-Driving suite in the future. The electric automaker continues to release patents that aim to build a more accurate Autopilot system that will accelerate the company’s journey toward Level 5 Autonomy, which Musk says is coming soon.

Most recently, Tesla submitted a patent titled, “Enhanced Object Detection for Autonomous Vehicles Based on Field View,” that would crop important objects in images and increase the resolution of those images. If pedestrians, vehicles, or other objects are available in an image, they would be available at an increased resolution to improve the accuracy of Autopilot.

Tesla’s exact plans for an Autopilot upgrade to 4-dimensional imagery is unknown. The increased accuracy is necessary for the company’s cars to drive in any environment. Tesla will soon release FSD’s “Driving on City Streets” function, which will complete the suite.

Advertisement
-->

Joey has been a journalist covering electric mobility at TESLARATI since August 2019. In his spare time, Joey is playing golf, watching MMA, or cheering on any of his favorite sports teams, including the Baltimore Ravens and Orioles, Miami Heat, Washington Capitals, and Penn State Nittany Lions. You can get in touch with joey at joey@teslarati.com. He is also on X @KlenderJoey. If you're looking for great Tesla accessories, check out shop.teslarati.com

Advertisement
Comments

News

Tesla hosts Rome Mayor for first Italian FSD Supervised road demo

The event marked the first time an Italian mayor tested the advanced driver-assistance system in person in Rome’s urban streets.

Published

on

Credit: @andst7/X

Tesla definitely seems to be actively engaging European officials on FSD’s capabilities, with the company hosting Rome Mayor Roberto Gualtieri and Mobility Assessor Eugenio Patanè for a hands-on road demonstration. 

The event marked the first time an Italian mayor tested the advanced driver-assistance system in person in Rome’s urban streets. This comes amid Tesla’s push for FSD’s EU regulatory approvals in the coming year.

Rome officials experience FSD Supervised

Tesla conducted the demo using a Model 3 equipped with Full Self-Driving (Supervised), tackling typical Roman traffic including complex intersections, roundabouts, pedestrian crossings and mixed users like cars, bikes and scooters.

The system showcased AI-based assisted driving, prioritizing safety while maintaining flow. FSD also handled overtakes and lane decisions, though with constant driver supervision.

Investor Andrea Stroppa detailed the event on X, noting the system’s potential to reduce severe collision risks by up to seven times compared to traditional driving, based on Tesla’s data from billions of global fleet miles. The session highlighted FSD’s role as an assistance tool in its Supervised form, not a replacement, with the driver fully responsible at all times.

Advertisement
-->

Path to European rollout

Tesla has logged over 1 million kilometers of testing across 17 European countries, including Italy, to refine FSD for local conditions. The fact that Rome officials personally tested FSD Supervised bodes well for the program’s approval, as it suggests that key individuals are closely watching Tesla’s efforts and innovations.

Assessor Patanè also highlighted the administration’s interest in technologies that boost road safety and urban travel quality, viewing them as aids for both private and public transport while respecting rules.

Replies on X urged involving Italy’s Transport Ministry to speed approvals, with one user noting, “Great idea to involve the mayor! It would be necessary to involve components of the Ministry of Transport and the government as soon as possible: it’s they who can accelerate the approval of FSD in Italy.”

Continue Reading

News

Tesla FSD (Supervised) blows away French journalist after test ride

Cadot described FSD as “mind-blowing,” both for the safety of the vehicle’s driving and the “humanity” of its driving behaviors.

Published

on

Credit: Grok Imagine

Tesla’s Full Self-Driving (Supervised) seems to be making waves in Europe, with French tech journalist Julien Cadot recently sharing a positive first-hand experience from a supervised test drive in France. 

Cadot, who tested the system for Numerama after eight years of anticipation since early Autopilot trials, described FSD as “mind-blowing,” both for the safety of the vehicle’s driving and the “humanity” of its driving behaviors.

 

Julien Cadot’s FSD test in France

Cadot announced his upcoming test on X, writing in French: “I’m going to test Tesla’s FSD for Numerama in France. 8 years I’ve been waiting to relive the sensations of our very first contact with the unbridled Autopilot of the 2016s.” He followed up shortly after with an initial reaction, writing: “I don’t want to spoil too much because as media we were allowed to film everything and I have a huge video coming… But: it’s mind-blowing! Both for safety and for the ‘humanity’ of the choices.”

His later posts detailed FSD’s specific maneuvers that he found particularly compelling. These include the vehicle safely overtaking a delivery truck by inches, something Cadot said he personally would avoid to protect his rims, but FSD handled flawlessly. He also praised FSD’s cyclist overtakes, as the system always maintained the required 1.5-meter distance by encroaching on the opposite lane when clear. Ultimately, Cadot noted FSD’s decision-making prioritized safety and advancement, which is pretty remarkable.

Advertisement
-->

FSD’s ‘human’ edge over Autopilot

When asked if FSD felt light-years ahead of standard Autopilot, Cadot replied: “It’s incomparable, it’s not the same language.” He elaborated on scenarios like bypassing a parked delivery truck across a solid white line, where FSD assessed safety and proceeded just as a human driver might, rather than halting indefinitely. This “humanity” impressed Cadot the most, as it allowed FSD to fluidly navigate real-world chaos like urban Paris traffic. 

Tesla is currently hard at work pushing for the rollout of FSD to several European countries. Recent reports have revealed that Tesla has received approval to operate 19 FSD test vehicles on Spain’s roads, though this number could increase as the program develops. As per the Dirección General de Tráfico (DGT), Tesla would be able to operate its FSD fleet on any national route across Spain. Recent job openings also hint at Tesla starting FSD tests in Austria. Apart from this, the company is also holding FSD demonstrations in Germany, France, and Italy.

Continue Reading

Elon Musk

Tesla Optimus shows off its newest capability as progress accelerates

Published

on

Credit: Tesla

Tesla Optimus showed off its newest capability as progress on the project continues to accelerate toward an ultimate goal of mass production in the coming years.

Tesla is still developing Optimus and preparing for the first stages of mass production, where units would be sold and shipped to customers. CEO Elon Musk has always marketed the humanoid robot as the biggest product in history, even outside of Tesla, but of all time.

He believes it will eliminate the need to manually perform monotonous tasks, like cleaning, mowing the lawn, and folding laundry.

However, lately, Musk has revealed even bigger plans for Optimus, including the ability to relieve humans of work entirely within the next 20 years.

Development at Tesla’s Artificial Intelligence and Robotics teams has progressed, and a new video was shown of the robot taking a light jog with what appeared to be some pretty natural form:

Optimus has also made several public appearances lately, including one at the Neural Information Processing Systems, or NeurIPS Conference. Some spectators shared videos of Optimus’s charging rig, as well as its movements and capabilities, most interestingly, the hand:

The hand, forearm, and fingers have been one of the most evident challenges for Tesla in recent times, especially as it continues to work on its 3rd Generation iteration of Optimus.

Musk said during the Q3 Earnings Call:

“I don’t want to downplay the difficulty, but it’s an incredibly difficult thing, especially to create a hand that is as dexterous and capable as the human hand, which is incredible. The human hand is an incredible thing. The more you study the human hand, the more incredible you realize it is, and why you need four fingers and a thumb, why the fingers have certain degrees of freedom, why the various muscles are of different strengths, and fingers are of different lengths. It turns out that those are all there for a reason.”

The interesting part of the Optimus program so far is the fact that Tesla has made a lot of progress with other portions of the project, like movement, for example, which appears to have come a long way.

However, without a functional hand and fingers, Optimus could be rendered relatively useless, so it is evident that it has to figure this crucial part out first.

Continue Reading