Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.
Presented some of the recent work from the Tesla Autopilot team at CVPR this year, especially about "Occupancy Networks" – our approach to solve general obstacle detection and using it to enable sophisticated collision avoidance. Full talk here: https://t.co/wpGXlNHaWl (1/12)
— Ashok Elluswamy (@aelluswamy) August 21, 2022
In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.
These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.
The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.
Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.
In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.
Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”
These predictions are already used to prevent a lot of collisions. For e.g., Autopilot prevents ~40 crashes / day where human drivers mistakenly press the accelerator at 100% instead of the brakes. In the video Autopilot automatically brakes, saving this person's legs (7/12) pic.twitter.com/XtMssPT9cM
— Ashok Elluswamy (@aelluswamy) August 21, 2022
You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.
Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.
In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”
Note: Johnna is a Tesla shareholder and supports its mission.
Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1
Tesla’s 2026 Summer Update turns Grok from a talking companion into a true in-car controller, with considerably expanded capabilities. Where the assistant once answered questions and handled navigation, it can now operate hardware and software through ordinary speech, including several requests at the same time.
Grok has become incredibly robust over the past few quarters, and this new ability that Tesla has included with its Summer Update is perhaps the clearest sign of just how capable it has become.
You can issue many commands to Grok at once, and each will be taken care of: anything from headlight control to climate adjustments to mirror folding can now all be taken care of with a simple sentence spoken toward Grok:
This is cool, you can now give Grok a ton of commands at once in your Tesla and it’ll do them all together.
The commands I gave:
• Fold mirrors
• Turn on wipers to fastest setting
• Change temp to 65°
• Open self-driving app
• Open gloveboxComes with Tesla’s 2026 Summer… pic.twitter.com/drZxoHrknv
— Sawyer Merritt (@SawyerMerritt) August 26, 2026
Here’s another example I used in my Model Y:
🚨 Using Grok to control the cabin temperature and turn on headlights in 2026 Model Y on FSD v14.3.8 and 2026.26.6.5 pic.twitter.com/7clgQkGABk
— TESLARATI (@Teslarati) August 27, 2026
Tesla’s official Release Notes list the core powers of Grok’s new capabilities: Grok can place phone calls from a paired phone, search a streaming service and queue music, adjust climate, and search the Controls panel. Drivers can also ask it questions about the vehicle or the latest features included in a recent software update.
It can also take care of driving settings, dynamics, and other relevant preferences that deal with how the car operates and handles.
Tesla Summer Update begins rolling out: a look at the new features
It’s also more of a use case than a novelty feature. Grok was great for learning about something that was being pondered while Full Self-Driving was taking care of the major automotive responsibilities, but it did have some useful functionality when it came to navigation.
Another less-noted improvement is the swift transition that Grok has from thinking of its answer to giving you one. In the past, it would take a few seconds for Grok to truly come up with a valuable response. It now seems that it is improving, at least slightly.
Tesla Full Self-Driving is set to get a major fix with pothole avoidance, a feature that CEO Elon Musk said recently was “coming soon.” The feature has been included within the FSD v14 release notes for some time as an upcoming improvement.
Potholes come in all shapes and sizes, but one thing is universal about them, and that is the fact that every driver wants to avoid them. Driving into or over a pothole can cause tire and wheel damage, alignment issues, and even, in some more severe instances, injury to occupants or major damage to a vehicle in despair.
Tesla Cybercab uses a unique strategy for picking up the right rider
Musk said late last night in a post that pothole avoidance while utilizing the Full Self-Driving suite is “coming soon.”
Coming soon
— Elon Musk (@elonmusk) August 31, 2026
Full Self-Driving, even in its most recent and robust forms, still has its shortcomings. While the suite has performed exceptionally well with avoiding on-road obstacles like cardboard boxes, horse droppings, car parts, and other debris, it still seems to struggle with recognizing certain things.
Potholes and other abrupt changes in a road’s layout are things that FSD still tends to struggle with. Perhaps the suite’s 3D modeling is still in need of some additional data or some sort of script that will help it to avoid a potentially destructive pothole or bump in the road that would be easily recognizable by the human eye.
Musk has mentioned pothole avoidance for some time, with the initial idea coming in April 2019 when an owner first requested the feature. Musk said that Tesla would “definitely” develop pothole avoidance.
In August 2020, Musk said Tesla was in the process of labeling bumps and potholes so cars can either slow down or steer around them altogether.
Tesla to utilize micro maps for pothole-detection in future update
Avoiding major disturbances in the road is a necessary feature for Full Self-Driving to have, especially as Tesla is working toward a fully autonomous program that will eventually allow every occupant in the vehicle to sleep, work, or enjoy leisure time while traveling.
That truly begins this week with the launch of Cybercab on Thursday.
Elon Musk
Elon Musk says he knows how to save Earth for a billion years
Elon Musk says sentient AI satellites launched from the Moon could keep Earth livable forever.
Elon Musk spent part of his weekend describing a plan to keep the planet livable for roughly a billion years, and it starts with satellites that can think for themselves.
In a post on X, Musk argued that swapping fossil fuels for solar and wind power will not be enough to protect humanity from what he called extremely severe extinction events, the kind that occur roughly every 100 million years. His fix is what he called sentient satellites, or solar-powered satellites, controlled by AI, that would sit in a fixed spot between Earth and the Sun after being launched off the Moon using a giant electromagnetic catapult instead of rockets.
The satellites’ onboard AI would make continuous, small adjustments rather than waiting on human instructions. The mass driver is Musk’s proposed way of getting the raw material there cheaply by using an electromagnetic launch track built on the Moon, where lower gravity and no atmosphere make it far easier to fling cargo into space than it is from Earth.
But we do need to act much faster than that if people still want to live where the beach is today. We have about 50 years or so to take action, which should be more than enough time for the space satellites to solve any heating problems. https://t.co/xhrVQALwQw
— Elon Musk (@elonmusk) August 30, 2026
Musk shared a Grok generated estimate suggesting roughly 5 percent of Florida’s land, or about 1.68 million acres, could face regular flooding by 2070 under a high sea level rise scenario, and said humanity has about 50 years to act before coastal living looks very different than it does today.
This is not the first time Musk has floated the idea. He raised a similar concept in November, describing a solar powered AI satellite constellation that could make tiny adjustments to incoming sunlight to fine tune Earth’s temperature. Musk has also tied planetary risk to his broader vision at SpaceX, where his compensation package is explicitly linked to establishing a self-sustaining Mars colony, one he has described as an insurance policy against the kind of extinction event he referenced this weekend, and where he has said humans could set foot within five to seven years.
Elon Musk’s Grok can basically control anything in your Tesla now
Tesla is fixing Full Self-Driving’s pothole problem
