Connect with us
Tesla Autopilot now enables the car to perceive space around it Tesla Autopilot now enables the car to perceive space around it

News

Tesla Autopilot now enables the car to perceive space around it

Credit: Ashok Elluswamy

Published

on

Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.

In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.

Advertisement

These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.

The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.

Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.

In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.

Advertisement

Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”

You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.

Advertisement

Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.

In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”

Note: Johnna is a Tesla shareholder and supports its mission. 

Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1

Advertisement

Johnna Crider is a Baton Rouge writer covering Tesla, Elon Musk, EVs, and clean energy & supports Tesla's mission. Johnna also interviewed Elon Musk and you can listen here

Advertisement
Comments

News

Tesla Semi enters new Pilot Program with interesting challenge

Published

on

Credit: PTI

The Tesla Semi is entering a new Pilot Program with Paper Transport, LLC (PTI), a Wisconsin-based transportation provider. The company will test the Semi’s Long Range configuration through “dedicated operations within the Chicago market.”

Chicago presents an interesting challenge for the Semi, as it will be a colder-weather climate that will test the Semi’s ability to operate in lower temperatures and in potentially large accumulations of snow. This is something Tesla has been testing with the Semi in Alaska and even in Northern California during the colder months, but Chicago will present a truly tough midwestern winter.

Tesla Semi spotted on journey home after winter performance testing

PTI says it is using the Semi to evaluate its strategy of reducing transportation emissions while maintaining performance, reliability, and cost efficiency. These are major arguments for the Semi being introduced into new fleets.

Advertisement

CEO of PTI Tyler Ellison said:

“PTI has been a leader in sustainable transportation solutions for over 15 years. We take a consultative approach to helping customers identify and implement the right transportation solution for their network. Our partnership with Tesla expands our portfolio alongside renewable natural gas and intermodal, giving customers more ways to reduce Scope 3 emissions without compromising service or economics.”

PTI is far from the first company to adopt the Semi within a fleet, as Tesla entered strategic agreements with PepsiCo. and its subsidiary Frito-Lay for a Pilot Program that extended throughout the California region.

Tesla has let companies like those utilize the Semi to determine whether it would be suitable for their operations. Additionally, Tesla gets valuable information regarding the Semi’s performance, knowing what to improve and what is ideal for companies that will utilize the all-electric truck for regional and nationwide logistics.

Advertisement

PTI plans to utilize the Long Range configuration, which is priced at $290,000 and features a range of approximately 500 miles, a three-motor powertrain, up to 800 kW of drive power, and consumption of just 1.7 kWh per mile.

Tesla Semi pricing revealed after company uncovers trim levels

VP of Maintenance at PTI, Bryan Ellen, added:

“We are excited to partner with Tesla, leveraging their ever-evolving technology. We are bullish in our estimation of the parallels available between our dedicated model and the efficiency of their fully electric Class 8 tractor. We anticipate a growing synergy between our businesses as we work to facilitate this sustainable solution for our customers.”

Advertisement

PTI has logged more than 87 million miles using sources like compressed and renewable gas, but now is looking to take it a step further with fully electric operations.

Continue Reading

News

Tesla is building a wheelchair-accessible Robotaxi

Published

on

A beautiful spring landscape at SoFi Stadium with lush green palm trees and plants with powerful clouds at sunset in Inglewood California USA. (Credit: Tesla)

Tesla revealed on Monday that it is building a new autonomous vehicle at Gigafactory Texas, its plant just outside of the City of Austin. This particular vehicle will be geared toward those who are in need of a wheelchair-accessible car that would require no human driver for operation.

According to a new report from Wired, Tesla’s Senior Policy Advisor, India Herdman, told members of the Washington D.C. City Council on Monday:

“We are in development for a purpose-built, wheelchair-accessible autonomous vehicle. We know that paratransit can be very difficult, and people who are confined to wheelchairs permanently should still be able to move around freely, so that is an active product being built by Tesla in Texas.”

This builds upon what CEO Elon Musk said last year on X, which confirmed the company was working on accessible rides within its Robotaxi platform, which currently is confined to the Model Y.

Advertisement

Tesla is also developing the Cybercab, which started employee rides last week. However, this vehicle is not necessarily geared toward wheelchair accessibility.

That leaves a major gap in the autonomous ride-sharing program that Tesla is attempting to build; the company has been pretty clear that it does not want to complicate its manufacturing lines by bringing in a wide array of body styles.

Advertisement

However, it seems necessary to have something larger that could help transport people to appointments when they cannot drive. For wheelchair accessibility, the Robovan, which was unveiled at the “We, Robot” event in October 2024, seems to be the most ideal solution:

Tesla unveils the Robovan at ‘We, Robot’ event

Herdman did not indicate whether she was referring to the Robovan or if Tesla is building yet another body style that is geared toward full autonomy but also caters to the handicapped.

Tesla might need to develop something specifically for the handicapped in order to align with the Americans with Disabilities Act, which prevents discrimination against people with disabilities in transportation services. Uber was hit with a lawsuit late last year for “refusing to reasonably modify its policies, practices, or procedures where necessary to avoid discriminating against riders with disabilities.”

Advertisement

Tesla would obviously like to avoid this.

It will be interesting to see what Tesla will do with this project, and whether it will introduce something new to the market or just continue with the Robovan.

Continue Reading

News

Tesla weirdly confirms Cybercab employee rides, a huge milestone

Published

on

Credit: Tesla

Tesla weirdly confirmed that its steering wheel-less and pedal-less Cybercab vehicle is now in the process of giving employees rides, a huge milestone for the vehicle program.

But the entire thing was super strange. On Friday, Tesla released a video stating that there was “Cool news from Giga Texas” and that employees were now taking rides in Cybercabs that have no manual controls. The units seen on public roads are engineering vehicles that have manual controls inside, a necessity as Tesla moved through the testing phase.

However, Tesla removed the video and reposted it shortly after with a more vague title. It seems like the employee rides are still going, but the video was adjusted slightly. The initial upload showed employees doing things like watching movies and adjusting the climate, but these snippets were removed in the second upload.

Both images below were uploaded with the first video, but were removed after Tesla re-uploaded the announcement. These are not available in the second upload

tesla cybercab with no manual controls showing a movie with two employees inside

Credit: Tesla

tesla cybercab with no manual controls showing a movie with two employees inside

Credit: Tesla

Nevertheless, the announcement from Tesla is that the Cybercab is operating with employees inside who can control the vehicle’s audio, video, climate, and destination settings through their smartphone app.

Tesla has already been testing Cybercab engineering units, but last month, it was able to self-certify for SAE Level 4, which would enable unsupervised self-driving in Texas. The company is moving toward that, and the plans have always been to launch Cybercab rides this year.

The Cybercab is potentially looked at as the next generation of Tesla’s mobility leg. For the past 15 years, the company has been known as somewhat of an automaker, among many other things. However, these passenger vehicles that Tesla has manufactured are now moving into a new realm, as they will eventually drive themselves with no supervision thanks to the Full Self-Driving suite.

Advertisement

Tesla flexes how it will help the blind with Cybercab

The Cybercab is just the next step of that: a true vehicle developed for the sole purpose of ride-hailing. It has no human controls, it has only two seats, and it will get passengers from Point A to Point B with no awkward driver, no need for manual inputs, and with no stress.

Tesla is moving forward with other developments related to the Cybercab project as well. However, the big announcement will come when Tesla finally announces that it is launching Cybercab rides to the general public, something that it plans to launch either late this year or early 2027.

Advertisement
Continue Reading