Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.
Presented some of the recent work from the Tesla Autopilot team at CVPR this year, especially about "Occupancy Networks" – our approach to solve general obstacle detection and using it to enable sophisticated collision avoidance. Full talk here: https://t.co/wpGXlNHaWl (1/12)
— Ashok Elluswamy (@aelluswamy) August 21, 2022
In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.
These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.
The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.
Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.
In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.
Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”
These predictions are already used to prevent a lot of collisions. For e.g., Autopilot prevents ~40 crashes / day where human drivers mistakenly press the accelerator at 100% instead of the brakes. In the video Autopilot automatically brakes, saving this person's legs (7/12) pic.twitter.com/XtMssPT9cM
— Ashok Elluswamy (@aelluswamy) August 21, 2022
You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.
Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.
In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”
Note: Johnna is a Tesla shareholder and supports its mission.
Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1
Elon Musk
SpaceX issues statement on Starship V3 Booster 18 anomaly
The incident unfolded during gas-system pressure testing at the company’s Massey facility in Starbase, Texas.
SpaceX has issued an initial statement about Starship Booster 18’s anomaly early Friday. The incident unfolded during gas-system pressure testing at the company’s Massey facility in Starbase, Texas.
SpaceX’s initial comment
As per SpaceX in a post on its official account on social media platform X, Booster 18 was undergoing gas system pressure tests when the anomaly happened. Despite the nature of the incident, the company emphasized that no propellant was loaded, no engines were installed, and personnel were kept at a safe distance from the booster, resulting in zero injuries.
“Booster 18 suffered an anomaly during gas system pressure testing that we were conducting in advance of structural proof testing. No propellant was on the vehicle, and engines were not yet installed. The teams need time to investigate before we are confident of the cause. No one was injured as we maintain a safe distance for personnel during this type of testing. The site remains clear and we are working plans to safely reenter the site,” SpaceX wrote in its post on X.
Incident and aftermath
Livestream footage from LabPadre showed Booster 18’s lower half crumpling around the liquid oxygen tank area at approximately 4:04 a.m. CT. Subsequent images posted by on-site observers revealed extensive deformation across the booster’s lower structure. Needless to say, spaceflight observers have noted that Booster 18 would likely be a complete loss due to its anomaly.
Booster 18 had rolled out only a day earlier and was one of the first vehicles in the Starship V3 program. The V3 series incorporates structural reinforcements and reliability upgrades intended to prepare Starship for rapid-reuse testing and eventual tower-catch operations. Elon Musk has been optimistic about Starship V3, previously noting on X that the spacecraft might be able to complete initial missions to Mars.
Investor's Corner
Tesla analyst maintains $500 PT, says FSD drives better than humans now
The team also met with Tesla leaders for more than an hour to discuss autonomy, chip development, and upcoming deployment plans.
Tesla (NASDAQ:TSLA) received fresh support from Piper Sandler this week after analysts toured the Fremont Factory and tested the company’s latest Full Self-Driving software. The firm reaffirmed its $500 price target, stating that FSD V14 delivered a notably smooth robotaxi demonstration and may already perform at levels comparable to, if not better than, average human drivers.
The team also met with Tesla leaders for more than an hour to discuss autonomy, chip development, and upcoming deployment plans.
Analysts highlight autonomy progress
During more than 75 minutes of focused discussions, analysts reportedly focused on FSD v14’s updates. Piper Sandler’s team pointed to meaningful strides in perception, object handling, and overall ride smoothness during the robotaxi demo.
The visit also included discussions on updates to Tesla’s in-house chip initiatives, its Optimus program, and the growth of the company’s battery storage business. Analysts noted that Tesla continues refining cost structures and capital expenditure expectations, which are key elements in future margin recovery, as noted in a Yahoo Finance report.
Analyst Alexander Potter noted that “we think FSD is a truly impressive product that is (probably) already better at driving than the average American.” This conclusion was strengthened by what he described as a “flawless robotaxi ride to the hotel.”
Street targets diverge on TSLA
While Piper Sandler stands by its $500 target, it is not the highest estimate on the Street. Wedbush, for one, has a $600 per share price target for TSLA stock.
Other institutions have also weighed in on TSLA stock as of late. HSBC reiterated a Reduce rating with a $131 target, citing a gap between earnings fundamentals and the company’s market value. By contrast, TD Cowen maintained a Buy rating and a $509 target, pointing to strong autonomous driving demonstrations in Austin and the pace of software-driven improvements.
Stifel analysts also lifted their price target for Tesla to $508 per share over the company’s ongoing robotaxi and FSD programs.
Elon Musk
SpaceX Starship Version 3 booster crumples in early testing
Photos of the incident’s aftermath suggest that Booster 18 will likely be retired.
SpaceX’s new Starship first-stage booster, Booster 18, suffered major damage early Friday during its first round of testing in Starbase, Texas, just one day after rolling out of the factory.
Based on videos of the incident, the lower section of the rocket booster appeared to crumple during a pressurization test. Photos of the incident’s aftermath suggest that Booster 18 will likely be retired.
Booster test failure
SpaceX began structural and propellant-system verification tests on Booster 18 Thursday night at the Massey’s Test Site, only a few miles from Starbase’s production facilities, as noted in an Ars Technica report. At 4:04 a.m. CT on Friday, a livestream from LabPadre Space captured the booster’s lower half experiencing a sudden destructive event around its liquid oxygen tank section. Post-incident images, shared on X by @StarshipGazer, showed notable deformation in the booster’s lower structure.
Neither SpaceX nor Elon Musk had commented as of Friday morning, but the vehicle’s condition suggests it is likely a complete loss. This is quite unfortunate, as Booster 18 is already part of the Starship V3 program, which includes design fixes and upgrades intended to improve reliability. While SpaceX maintains a rather rapid Starship production line in Starbase, Booster 18 was generally expected to validate the improvements implemented in the V3 program.
Tight deadlines
SpaceX needs Starship boosters and upper stages to begin demonstrating rapid reuse, tower catches, and early operational Starlink missions over the next two years. More critically, NASA’s Artemis program depends on an on-orbit refueling test in the second half of 2026, a requirement for the vehicle’s expected crewed lunar landing around 2028.
While SpaceX is known for diagnosing failures quickly and returning to testing at unmatched speed, losing the newest-generation booster at the very start of its campaign highlights the immense challenge involved in scaling Starship into a reliable, high-cadence launch system. SpaceX, however, is known for getting things done quickly, so it would not be a surprise if the company manages to figure out what happened to Booster 18 in the near future.
SpaceX issues statement on Starship V3 Booster 18 anomaly
Tesla analyst maintains $500 PT, says FSD drives better than humans now
