Connect with us
Tesla Autopilot now enables the car to perceive space around it Tesla Autopilot now enables the car to perceive space around it

News

Tesla Autopilot now enables the car to perceive space around it

Credit: Ashok Elluswamy

Published

on

Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.

In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.

Advertisement

These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.

The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.

Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.

In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.

Advertisement

Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”

You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.

Advertisement

Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.

In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”

Note: Johnna is a Tesla shareholder and supports its mission. 

Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1

Advertisement

Johnna Crider is a Baton Rouge writer covering Tesla, Elon Musk, EVs, and clean energy & supports Tesla's mission. Johnna also interviewed Elon Musk and you can listen here

Advertisement
Comments

News

Ford is charging for a basic EV feature on the Mustang Mach-E

When ordering a new Ford Mustang Mach-E, you’ll now be hit with an additional fee for one basic EV feature: the frunk.

Published

on

Credit: Ford Motor Company

Ford is charging an additional fee for a basic EV feature on its Mustang Mach-E, its most popular electric vehicle offering.

Ford has shuttered its initial Model e program, but is venturing into a more controlled and refined effort, and it is abandoning the F-150 Lightning in favor of a new pickup that is currently under design, but appears to have some favorable features.

However, ordering a new Mustang Mach-E now comes with an additional fee for one basic EV feature: the frunk.

The frunk is the front trunk, and due to the lack of a large engine in the front of an electric vehicle, OEMs are able to offer additional storage space under the hood. There’s one problem, though, and that is that companies appear to be recognizing that they can remove it for free while offering the function for a fee.

Advertisement

Ford is charging $495 for the frunk.

Interestingly, the frunk size varies by vehicle, but the Mustang Mach-E features a 4.7 to 4.8 cubic-foot-sized frunk, which measures approximately 9 inches deep, 26 inches wide, and 14 inches high.

Advertisement

When the vehicle was first released, Ford marketed the frunk as the ultimate tailgating feature, showing it off as a perfect place to store and serve cold shrimp cocktail.

Ford Mach-E frunk is perfect for chowders and chicken wings, and we’re not even joking

It appears the decision to charge for what is a simple advantage of an EV is not going over well, as even Ford loyal customers say the frunk is a “basic expectation” of an EV. Without it, it seems as if fans feel the company is nickel-and-diming its customers.

It will be pretty interesting to see the Mach-E without a frunk, and while it should not be enough to turn people away from potentially buying the vehicle, it seems the decision to add an additional charge to include one will definitely annoy some customers.

Advertisement
Continue Reading

News

Tesla to improve one of its best features, coding shows

According to the update, Tesla will work on improving the headlights when coming into contact with highly reflective objects, including road signs, traffic signs, and street lights. Additionally, pixel-level dimming will happen in two stages, whereas it currently performs with just one, meaning on or off.

Published

on

Credit: @jojje167 on X

Tesla is looking to upgrade its Matrix Headlights, a unique and high-tech feature that is available on several of its vehicles. The headlights aim to maximize visibility for Tesla drivers while being considerate of oncoming traffic.

The Matrix Headlights Tesla offers utilize dimming of individual light pixels to ensure that visibility stays high for those behind the wheel, while also being considerate of other cars by decreasing the brightness in areas where other cars are traveling.

Here’s what they look like in action:

As you can see, the Matrix headlight system intentionally dims the area where oncoming cars would be impacted by high beams. This keeps visibility at a maximum for everyone on the road, including those who could be hit with bright lights in their eyes.

Advertisement

There are still a handful of complaints from owners, however, but Tesla appears to be looking to resolve these with the coming updates in a Software Version that is currently labeled 2026.2.xxx. The coding was spotted by X user BERKANT:

Advertisement

According to the update, Tesla will work on improving the headlights when coming into contact with highly reflective objects, including road signs, traffic signs, and street lights. Additionally, pixel-level dimming will happen in two stages, whereas it currently performs with just one, meaning on or off.

Finally, the new system will prevent the high beams from glaring back at the driver. The system is made to dim when it recognizes oncoming cars, but not necessarily objects that could produce glaring issues back at the driver.

Tesla’s revolutionary Matrix headlights are coming to the U.S.

This upgrade is software-focused, so there will not need to be any physical changes or upgrades made to Tesla vehicles that utilize the Matrix headlights currently.

Advertisement
Continue Reading

Elon Musk

xAI’s Grok approved for Pentagon classified systems: report

Under the agreement, Grok can be deployed in systems handling classified intelligence analysis, weapons development, and battlefield operations. 

Published

on

xAI-supercomputer-memphis-environment-pushback
Credit: xAI

Elon Musk’s xAI has signed an agreement with the United States Department of Defense (DoD) to allow Grok to be used in classified military systems.

Previously, Anthropic’s Claude had been the only AI system approved for the most sensitive military work, but a dispute over usage safeguards has reportedly prompted the Pentagon to broaden its options, as noted in a report from Axios.

Under the agreement, Grok can be deployed in systems handling classified intelligence analysis, weapons development, and battlefield operations. 

The publication reported that xAI agreed to the Pentagon’s requirement that its technology be usable for “all lawful purposes,” a standard Anthropic has reportedly resisted due to alleged ethical restrictions tied to mass surveillance and autonomous weapons use.

Advertisement

Defense Secretary Pete Hegseth is scheduled to meet with Anthropic CEO Dario Amodei in what sources expect to be a tense meeting, with the publication hinting that the Pentagon could designate Anthropic a “supply chain risk” if the company does not lift its safeguards. 

Axios stated that replacing Claude fully might be technically challenging even if xAI or other alternative AI systems take its place. That being said, other AI systems are already in use by the DoD. 

Grok already operates in the Pentagon’s unclassified systems alongside Google’s Gemini and OpenAI’s ChatGPT. Google is reportedly close to an agreement that will result in Gemini being used for classified use, while OpenAI’s progress toward classified deployment is described as slower but still feasible. 

The publication noted that the Pentagon continues talks with several AI companies as it prepares for potential changes in classified AI sourcing.

Advertisement
Continue Reading