Connect with us
Tesla Autopilot now enables the car to perceive space around it Tesla Autopilot now enables the car to perceive space around it

News

Tesla Autopilot now enables the car to perceive space around it

Credit: Ashok Elluswamy

Published

on

Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.

In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.

These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.

The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.

Advertisement
-

Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.

In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.

Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”

You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.

Advertisement
-

Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.

In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”

Note: Johnna is a Tesla shareholder and supports its mission. 

Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1

Johnna Crider is a Baton Rouge writer covering Tesla, Elon Musk, EVs, and clean energy & supports Tesla's mission. Johnna also interviewed Elon Musk and you can listen here

Advertisement
Comments

Elon Musk

Elon Musk says Tesla Cybercab future is ‘obvious to anyone with eyes and a brain’

Published

on

Elon Musk said the Tesla Cybercab will perform “a majority of all passenger miles” where it is allowed to operate and that point is “obvious to anyone with eyes and a brain.”

Musk used the point to double down on the company’s decision to ax the cult-favorite Cybertruck, as its production space will be removed and transitioned into additional Cybercab lines. The move has catalyzed a polarizing conversation on whether its right or wrong.

Whatever side you are on — it’s happening.

Regardless, Musk seems to be getting to the point that he is done talking about the choice. At some point, you have to think that this was truly a difficult decision for him and the company as well, and this is not something he took lightly. In fact, he’s probably a little bit disappointed with it, too.

But the point remains that the Cybertruck is gone. Musk’s focus is purely on developing an autonomous platform that the world will utilize for transportation, and he’s telling you that anyone “with eyes and a brain” can see it:

Tesla is betting that all of its passengers in the future will be okay with not owning their own personal cars and will be fine with ride-hailing for the rest of their lives. Every dinner, every errand, every trip to the airport and transportation thereafter, will all be operated by ride-sharing, and in Tesla’s perfect world, it will happen in a Cybercab.

As of now, Cybercab is only active in Austin, but it has been spotted all over the country with a driver behind the wheel in those prototypes. In Austin, the car has no steering wheel or pedals for people to control the vehicle.

The Cybertruck dilemma is one that has truly come across the entire Tesla community and while it seems to be a great idea to keep it because people love it, the business side of things is steering Musk and Tesla in another direction.

Advertisement
-
Continue Reading

Elon Musk

Tesla slims Cybertruck offerings to only its most expensive trim

Published

on

Credit: u/dregonzz/Reddit

Tesla has slimmed its Cybertruck offerings to offer only its most expensive trim: the Cyberbeast.

After announcing that the Cybertruck would no longer be produced and the company would wind down manufacturing sometime in the middle of 2027, Tesla started to eliminate some of the configurations offered to customers.

Advertisement
-

Now, only one remains: the $109,990 Cyberbeast. This is truly what seems like Tesla’s last effort to deter any remaining orders from coming in: eliminate the cheap trims and leave only the high-dollar vehicle within the lineup of Cybertruck options.

Those who want to take advantage of this last-ditch opportunity to own Tesla’s symbolic pickup have to pay to play.

Tesla says the reason for the wind down is truly because of Cybercab and its importance to the future.

Despite cries for Tesla to continue production of the pickup, Musk says it is too difficult to ramp a high-volume line instead of ending the truck altogether. He also says Cybercab is what will take passengers around for the “majority of all miles in any jurisdiction where it is not prohibited by law.”

Tesla is going all in on autonomy, and that’s never been a secret. But the commitment to a two-door, two-seat Cybercab truly limits people from having options for labor or hobbies. It also limits people from having their entire family in a single car.

Parents with even a single child will be required to take multiple vehicles if Cybercab is truly the only option Tesla plans to have.

Elon Musk keeps justifying Tesla Cybertruck’s cancelation, but it’s confusing

Tesla has stated the Robovan will also be in production eventually, but it still does not seem like the most ideal vehicle to own. It seems like it is geared more toward commercial uses, but Tesla might have something in the pipeline for families.

Advertisement
-
Continue Reading

News

Tesla exec hints at a wild fix for Robotaxi’s biggest weather problem

Tesla VP Lars Moravy says focused lasers could keep robotaxi cameras clear instead of wipers.

Published

on

By

Tesla Cybercab in a rainy Austin, Texas rendering

Tesla may one day use lasers instead of wiper blades to keep its robotaxi cameras clear. Lars Moravy, Tesla’s Vice President of Vehicle Engineering, floated the idea in a new episode of Jay Leno’s Garage released Monday, where he and design chief Franz von Holzhausen walked Leno through the Model Y L.

“If you fire them in a focused area, you can clean the sheet of water and create a barrier,” Moravy said. “When you think about autonomy, it might be a good solution to only clean the area where the camera is.” He added that clearing an entire windshield would take too many lasers to be practical.

The comment brings back one of Tesla’s stranger patents. The company filed for “Pulsed Laser Cleaning of Debris Accumulated on Glass Articles in Vehicles and Photovoltaic Assemblies” in May 2019, and the U.S. Patent Office granted it in September 2021. An updated divisional version was granted on March 31, 2026. The system detects debris on the glass, identifies what it is, and pulses the laser at a calibrated rate so the beam never penetrates deeper than the glass itself. The filing names windshields, side windows, camera lenses and solar panels as possible targets.

Lasers were once rumored for the Cybertruck, which appeared at its November 2019 unveiling with no wipers at all. Tesla eventually settled on a single oversized blade, and Elon Musk admitted the wiper was the part of the truck that troubled him the most. That production line is now scheduled to shut down around mid 2027 to make room for more Cybercab output.

Advertisement
-

What has changed since then is who is in the vehicle. A privately owned car has a driver who can notice a smeared windshield and do something about it. A Cybercab heading to its next pickup has nobody on board to check. Tesla has been chipping away at that problem with conventional hardware. Model Y Robotaxis in Austin were spotted with washers on their side repeater cameras in January, and a lens cleaning patent granted in May describes a fluid and wiper assembly for vehicle cameras and Optimus’ eyes. A laser would remove the fluid and the blades, both of which need regular replacement across a fleet.

The same episode gave Leno his first ride on Full Self-Driving (Supervised). The Model Y L pulled over on its own when an ambulance approached with its sirens on. “We got it on self-driving mode! I’m not touching anything,” Leno said. Moravy and von Holzhausen also explained that owners remain responsible while using FSD (Supervised), while Tesla takes responsibility for Robotaxi rides because it acts as the operator. Tesla launched the Model Y L in the U.S. in July at $61,990.

Moravy gave no timeline, and he described the laser setup as something Tesla is considering rather than a confirmed feature. The fleet it would serve keeps getting bigger, though. Tesla launched unsupervised Robotaxi service in San Antonio on Monday, its eighth city, and expanded its Austin service area to roughly 443 square miles on the same day. Several of those markets, including Houston, Miami and Tampa, see heavy seasonal rain.

Continue Reading