Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.
Presented some of the recent work from the Tesla Autopilot team at CVPR this year, especially about "Occupancy Networks" – our approach to solve general obstacle detection and using it to enable sophisticated collision avoidance. Full talk here: https://t.co/wpGXlNHaWl (1/12)
— Ashok Elluswamy (@aelluswamy) August 21, 2022
In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.
These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.
The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.
Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.
In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.
Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”
These predictions are already used to prevent a lot of collisions. For e.g., Autopilot prevents ~40 crashes / day where human drivers mistakenly press the accelerator at 100% instead of the brakes. In the video Autopilot automatically brakes, saving this person's legs (7/12) pic.twitter.com/XtMssPT9cM
— Ashok Elluswamy (@aelluswamy) August 21, 2022
You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.
Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.
In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”
Note: Johnna is a Tesla shareholder and supports its mission.
Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1
News
Tesla FSD fleet is nearing 7 billion total miles, including 2.5 billion city miles
As can be seen on Tesla’s official FSD webpage, vehicles equipped with the system have now navigated over 6.99 billion miles.
Tesla’s Full Self-Driving (Supervised) fleet is closing in on almost 7 billion total miles driven, as per data posted by the company on its official FSD webpage.
These figures hint at the massive scale of data fueling Tesla’s rapid FSD improvements, which have been quite notable as of late.
FSD mileage milestones
As can be seen on Tesla’s official FSD webpage, vehicles equipped with the system have now navigated over 6.99 billion miles. Tesla owner and avid FSD tester Whole Mars Catalog also shared a screenshot indicating that from the nearly 7 billion miles traveled by the FSD fleet, more than 2.5 billion miles were driven inside cities.
City miles are particularly valuable for complex urban scenarios like unprotected turns, pedestrian interactions, and traffic lights. This is also the difference-maker for FSD, as only complex solutions, such as Waymo’s self-driving taxis, operate similarly on inner-city streets. And even then, incidents such as the San Francisco blackouts have proven challenging for sensor-rich vehicles like Waymos.
Tesla’s data edge
Tesla has a number of advantages in the autonomous vehicle sector, one of which is the size of its fleet and the number of vehicles training FSD on real-world roads. Tesla’s nearly 7 billion FSD miles then allow the company to roll out updates that make its vehicles behave like they are being driven by experienced drivers, even if they are operating on their own.
So notable are Tesla’s improvements to FSD that NVIDIA Director of Robotics Jim Fan, after experiencing FSD v14, noted that the system is the first AI that passes what he described as a “Physical Turing Test.”
“Despite knowing exactly how robot learning works, I still find it magical watching the steering wheel turn by itself. First it feels surreal, next it becomes routine. Then, like the smartphone, taking it away actively hurts. This is how humanity gets rewired and glued to god-like technologies,” Fan wrote in a post on X.
News
Tesla starts showing how FSD will change lives in Europe
Local officials tested the system on narrow country roads and were impressed by FSD’s smooth, human-like driving, with some calling the service a game-changer for everyday life in areas that are far from urban centers.
Tesla has launched Europe’s first public shuttle service using Full Self-Driving (Supervised) in the rural Eifelkreis Bitburg-Prüm region of Germany, demonstrating how the technology can restore independence and mobility for people who struggle with limited transport options.
Local officials tested the system on narrow country roads and were impressed by FSD’s smooth, human-like driving, with some calling the service a game-changer for everyday life in areas that are far from urban centers.
Officials see real impact on rural residents
Arzfeld Mayor Johannes Kuhl and District Administrator Andreas Kruppert personally tested the Tesla shuttle service. This allowed them to see just how well FSD navigated winding lanes and rural roads confidently. Kruppert said, “Autonomous driving sounds like science fiction to many, but we simply see here that it works totally well in rural regions too.” Kuhl, for his part, also noted that FSD “feels like a very experienced driver.”
The pilot complements the area’s “Citizen Bus” program, which provides on-demand rides for elderly residents who can no longer drive themselves. Tesla Europe shared a video of a demonstration of the service, highlighting how FSD gives people their freedom back, even in places where public transport is not as prevalent.
What the Ministry for Economic Affairs and Transport says
Rhineland-Palatinate’s Minister Daniela Schmitt supported the project, praising the collaboration that made this “first of its kind in Europe” possible. As per the ministry, the rural rollout for the service shows FSD’s potential beyond major cities, and it delivers tangible benefits like grocery runs, doctor visits, and social connections for isolated residents.
“Reliable and flexible mobility is especially vital in rural areas. With the launch of a shuttle service using self-driving vehicles (FSD supervised) by Tesla in the Eifelkreis Bitburg-Prüm, an innovative pilot project is now getting underway that complements local community bus services. It is the first project of its kind in Europe.
“The result is a real gain for rural mobility: greater accessibility, more flexibility and tangible benefits for everyday life. A strong signal for innovation, cooperation and future-oriented mobility beyond urban centers,” the ministry wrote in a LinkedIn post.
News
Tesla China quietly posts Robotaxi-related job listing
Tesla China is currently seeking a Low Voltage Electrical Engineer to work on circuit board design for the company’s autonomous vehicles.
Tesla has posted a new job listing in Shanghai explicitly tied to its Robotaxi program, fueling speculation that the company is preparing to launch its dedicated autonomous ride-hailing service in China.
As noted in the listing, Tesla China is currently seeking a Low Voltage Electrical Engineer to work on circuit board design for the company’s autonomous vehicles.
Robotaxi-specific role
The listing, which was shared on social media platform X by industry watcher @tslaming, suggested that Tesla China is looking to fill the role urgently. The job listing itself specifically mentions that the person hired for the role will be working on the Low Voltage Hardware team, which would design the circuit boards that would serve as the nervous system of the Robotaxi.
Key tasks for the role, as indicated in the job listing, include collaboration with PCB layout, firmware, mechanical, program management, and validation teams, among other responsibilities. The role is based in Shanghai.
China Robotaxi launch
China represents a massive potential market for robotaxis, with its dense urban centers and supportive policies in select cities. Tesla has limited permission to roll out FSD in the country, though despite this, its vehicles have been hailed as among the best in the market when it comes to autonomous features. So far, at least, it appears that China supports Tesla’s FSD and Robotaxi rollout.
This was hinted at in November, when Tesla brought the Cybercab to the 8th China International Import Expo (CIIE) in Shanghai, marking the first time that the autonomous two-seater was brought to the Asia-Pacific region. The vehicle, despite not having a release date in China, received a significant amount of interest among the event’s attendees.