Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.
Presented some of the recent work from the Tesla Autopilot team at CVPR this year, especially about "Occupancy Networks" – our approach to solve general obstacle detection and using it to enable sophisticated collision avoidance. Full talk here: https://t.co/wpGXlNHaWl (1/12)
— Ashok Elluswamy (@aelluswamy) August 21, 2022
In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.
These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.
The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.
Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.
In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.
Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”
These predictions are already used to prevent a lot of collisions. For e.g., Autopilot prevents ~40 crashes / day where human drivers mistakenly press the accelerator at 100% instead of the brakes. In the video Autopilot automatically brakes, saving this person's legs (7/12) pic.twitter.com/XtMssPT9cM
— Ashok Elluswamy (@aelluswamy) August 21, 2022
You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.
Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.
In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”
Note: Johnna is a Tesla shareholder and supports its mission.
Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1
Elon Musk
Elon Musk’s xAI gains first access to Saudi supercluster with 600k Nvidia GPUs
The facility will deploy roughly 600,000 Nvidia GPUs, making it one of the world’s most notable superclusters.
A Saudi-backed developer is moving forward with one of the world’s largest AI data centers, and Elon Musk’s xAI will be its first customer. The project, unveiled at the U.S.–Saudi Investment Forum in Washington, D.C., is being built by Humain, a company supported by Saudi Arabia’s Public Investment Fund.
The facility will deploy roughly 600,000 Nvidia GPUs, making it one of the world’s most notable superclusters.
xAI secures priority access
Nvidia CEO Jensen Huang stated that the planned data center marks a major leap not just for the region but for the global AI ecosystem as a whole. Huang joked about the sheer capacity of the build, emphasizing how unusual it is for a startup to receive infrastructure of such magnitude. The facility is designed to deliver 500 megawatts of Nvidia GPU power, placing it among the world’s largest AI-focused installations, as noted in a Benzinga report.
“We worked together to get this company started and off the ground and just got an incredible customer with Elon. Could you imagine a startup company, approximately $0 billion in revenues, now going to build a data center for Elon? 500 megawatts is gigantic. This company is off the charts right away,” Huang said.
Global Chipmakers Join Multi-Vendor Buildout To Enhance Compute Diversity
While Nvidia GPUs serve as the backbone of the first phase, Humain is preparing a diversified hardware stack. AMD will supply its Instinct MI450 accelerators, which could draw up to 1 gigawatt of power by 2030 as deployments ramp. Qualcomm will also contribute AI200 and AI250 data center processors, accounting for an additional 200 megawatts of compute capacity. Cisco will support the networking and infrastructure layer, helping knit the multi-chip architecture together.
Apart from confirming that xAI will be the upcoming supercluster’s first customer, Musk also joked about the rapid scaling needed to train increasingly large AI models. He joked that a theoretical expansion one thousand times larger of the upcoming supercluster “would be 8 bazillion, trillion dollars,” highlighting the playful exaggeration he often brings to discussions around extreme compute demand.
Elon Musk
Elon Musk debunks pay package and lip reader claims in double takedown
Musk’s quick debunks highlighted once more that X is an ideal platform for directly countering misinformation.
Elon Musk recently took to X to debunk some misinformation about his 2025 CEO performance award, as well as some comments he made during Donald Trump’s banquet in honor of Saudi Prince Mohammed bin Salman.
Musk’s quick debunks highlighted once more that X is an ideal platform for directly countering misinformation.
Musk’s pay package
Elon Musk’s 2025 CEO performance award was created as a path for him to gain a 25% stake in Tesla. It would also make him a trillionaire, provided that he manages to meet all of the performance award’s aggressive targets. This has not stopped critics from running with the apparent narrative that Musk will be getting the $1 trillion with utmost certainty, however.
This included the More Perfect Union account on X, which noted that “Elon Musk is set to make more than every U.S. elementary school teacher combined, according to the Washington Post.”
Musk responded to the pro-union amount’s post, highlighting that he has not earned any of his $2025 performance award so far. Musk also noted that those who believe he will be getting $1 trillion should invest in TSLA stock, as his compensation is tied to the company’s performance and growth. Investors who hold their TSLA until Musk achieves his full pay package would likely get notable returns.
Lip reader fail
Musk also debunked claims from the Daily Mail, which claimed that he made an “explosive” remark at Trump’s banquet for Saudi Prince Mohammed bin Salman. Citing observations from lip reader Nicola Hickling, the Mail claimed that Musk asked Pfizer CEO Albert Bourla, “What is your opinion, is he a terrorist?” The publication also posted a video of Musk allegedly making the risqué comment on X.
Musk proceeded to correct the publication, stating that the lip reader’s observations were fake. Instead of asking the Pfizer CEO if the Saudi Prince was a terrorist, Musk noted that he was asking the executive about cancer medicine. “False, I was asking about upcoming cancer drugs,” Musk wrote in a response on X.
Musk’s comments resulted in numerous critical responses to the Mail’s video, with some X users joking that the lip reader who analyzed the clip should probably get a visual acuity test, or a better training course on lip reading at least.
News
Tesla Diner to transition to full-service restaurant as Chef heads for new venture
“I am leaving the Tesla Diner project to focus on the opening of Mish, my long-desired Jewish deli. Projects like Mish and the Tesla Diner require a sharpness of focus and attention, and my focus and attention is now squarely on Mish.”
Tesla Diner, the all-in-one Supercharging and dining experience located in Los Angeles, will transition to a full-service restaurant in January, staff said, as Chef Eric Greenspan said he would take on a new project.
A report from the Los Angeles Times says Greenspan confirmed through a text that he would leave the Diner and focus on the opening of his new Jewish deli, Mish.
Greenspan confirmed to the paper:
“I am leaving the Tesla Diner project to focus on the opening of Mish, my long-desired Jewish deli. Projects like Mish and the Tesla Diner require a sharpness of focus and attention, and my focus and attention is now squarely on Mish.”
Greenspan took on the job at the Tesla Diner and curated the menu back in March, focusing on locally-sourced ingredients and items that would play on various company products, like Cybertruck-shaped boxes that hold burgers.
Tesla Cybertruck leftovers are the main course at the Supercharger Diner
The Tesla Diner has operated as somewhat of a self-serve establishment, where Tesla owners can order directly from their vehicles through the center touchscreen. It was not exclusive to Tesla owners. Guests could also enter and order at a counter, and pick up their food, before sitting at a booth or table.
However, the report indicates Tesla is planning to push it toward a sit-down restaurant, full of waiters, waitresses, and servers, all of which will come to a table after you are seated, take your order, and serve your food.
It will be more of a full-featured restaurant experience moving forward, which is an interesting move from the company, but it also sounds as if it could be testing for an expansion.
We know that Tesla is already considering expanding locations, as it will be heading to new areas of the country. CEO Elon Musk has said that Tesla will be considering locations in Palo Alto near the company’s Engineering HQ, and in Austin, where its HQ and Gigafactory Texas are located.
Musk said that the Diner has been very successful in its first few months of operation.
Elon Musk’s xAI gains first access to Saudi supercluster with 600k Nvidia GPUs
Elon Musk debunks pay package and lip reader claims in double takedown
