Connect with us
Tesla Autopilot now enables the car to perceive space around it Tesla Autopilot now enables the car to perceive space around it

News

Tesla Autopilot now enables the car to perceive space around it

Credit: Ashok Elluswamy

Published

on

Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.

In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.

These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.

The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.

Advertisement
-

Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.

In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.

Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”

You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.

Advertisement
-

Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.

In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”

Note: Johnna is a Tesla shareholder and supports its mission. 

Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1

Johnna Crider is a Baton Rouge writer covering Tesla, Elon Musk, EVs, and clean energy & supports Tesla's mission. Johnna also interviewed Elon Musk and you can listen here

Advertisement
Comments

Investor's Corner

Elon Musk drops a Thanksgiving hint about Starship’s biggest test yet

Elon Musk says Starship Flight 15 will try to catch the ship itself, a first.

Published

on

By

Elon Musk says SpaceX’s next Starship flight will try something nobody has done before, by catching the ship itself. Speaking to roughly 2,000 people at the X Takeover event at Giga Texas on Saturday, Musk said Flight 15 is about four to six weeks away and “probably launches a little bit before Thanksgiving, is my guess.”

That is a slip from earlier reporting, which had pointed to a launch as early as October 19. Musk explained why the date keeps moving. “We’re making a bunch of improvements to the rocket between every flight,” he said, adding that there are often hundreds, sometimes thousands, of small changes. This time the list is short, “but some of them take a fair bit of work and we’ve got to go inside the tank to make some of these changes.”

“We’re going to try to catch the ship, which is a super big deal,” Musk said. “If we do so, that’ll be the first time that there’s been full recovery of an orbital class rocket.” SpaceX has already caught the Super Heavy booster with the tower’s mechanical arms, and has talked about catching the ship since late 2025, but the upper stage has never been caught.

Musk also laid out what comes after. “The next big milestone would be to refly both the booster and the ship,” he said, describing a Flight 16 where “all parts of an orbital rocket are reflown.”

The reason SpaceX wants this comes down to cost and cadence. Every Starship ship so far has ended its flight in the ocean, and SpaceX expects most of those water landings to end in fireballs. A ship that returns to Starbase intact can be inspected and flown again. SpaceX’s IPO filing, says Starship V3 is designed to deliver 100 metric tons to orbit in a fully reusable configuration, that SpaceX aims to cut the cost to reach orbit by 99% or more versus the historical average, and that tower catches should allow “multiple launches per day.”

Advertisement
-

The payoff goes beyond cheaper launches. The next generation Starlink V3 satellites are too large for Falcon 9 and can only fly on Starship, which can carry up to 60 per flight. Flight 14 on September 28 deployed the first 26 of them after Starship reached orbit despite an early engine shutdown, as Teslarati reported. Musk blamed engine computer software, and said the heat shield “was extremely robust,” which he claimed in August had solved Starship’s biggest challenge.

NASA’s Moon plans depend on the same capability. NASA’s inspector general has described a lander mission that needs a propellant depot in low Earth orbit and more than 10 tanker flights, with SpaceX targeting one tanker launch every six days. That schedule only works if ships and boosters come back fast and fly again. Also, ship to ship propellant transfer has not been attempted yet.

One interesting hurdle yet to be explored is bringing the ship back to the launch site, with reentry over land, which will undoubtedly come with a lot of aviation safety reviews.

Continue Reading

Lifestyle

Tesla’s mirrorless Cybercab will give riders a visibility upgrade

Tesla engineer confirms Cybercab update letting riders pull up rear and repeater cameras on demand.

Published

on

By

Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)
Tesla Cybercab camera visibility for passengers (Credit: Dan Burkland via X)

Tesla is working on a Cybercab update that would let passengers pull up the vehicle’s rear and side cameras on demand, and the request came straight from a rider.

The exchange played out on X late Friday. Cybercab rider Dan Burkland shared photos of the two-seater’s cabin screen after an evening ride, praised the UI team’s work, and left one request: let riders open the rear and repeater cameras whenever they want, “especially for peace of mind.” Tesla UI software engineer Evan (@CarCoder) answered with two words: “In development.”

The idea fits a pattern Teslarati has tracked since public rides began. Days after paid Cybercab service opened in Austin, Tesla sent riders a survey that asked them to rate the touchscreen, the app and the cabin, and to pick the features they wanted most. We reported on that survey in September, and a camera view is the kind of small software change Tesla can push quickly if riders keep asking.

Advertisement
-

It also speaks to something unique about the vehicle. With no steering wheel, no pedals and no driver, passengers have no mirror to check and no way to see behind them. The hardware is clearly built for camera awareness, from the repeater cameras to the rear camera. Letting a passenger look through those same cameras would give a nervous first time rider a way to confirm what is around the car.

The timing matters because the fleet is growing fast. Tesla’s Robotaxi account said on Saturday that more than 300 Cybercabs are now serving Austin, an eightfold increase in 30 days, and Tesla AI chief Ashok Elluswamy named Dallas as the next city. More cars and more cities mean more people riding in a driverless vehicle for the first time, which is exactly when small trust features carry weight.

For now, the feature is confirmed only as in development. If Tesla follows its usual pattern with Cybercab software, riders could see it appear in a point release without any announcement, and Teslarati will watch for it.

Continue Reading

News

Tesla’s Cybercab fleet jumped 8x in a month, with Dallas up next

Tesla confirms its first official Cybercab fleet number as Austin scales fast and Dallas looms.

Published

on

By

Tesla says more than 300 Cybercabs are now serving Austin, the first time the company has put an official number on its active Cybercab fleet. The figure came from the Robotaxi account on X on Saturday, which wrote that one month after launch the service had “scaled to 300+ Cybercabs serving Austin – an 8x increase in 30 days.”

Ashok Elluswamy, Tesla’s head of AI software, quoted the post with a line that carried the bigger news. “Two years since the 10/10 Cybercab WeRobot event, the cabs are everywhere in Austin now. Dallas soon,” he wrote. It is the first time Tesla has named the next city for public Cybercab rides.

Tesla opened Cybercab rides to the public in Austin on September 4, as Teslarati reported, a day after an invite only launch event. The ramp since then has been steep. Our September 28 report had the fleet at well over 100 units after availability jumped from 58 to 125 in a single week. On Thursday, Tesla added 150 Cybercabs to the Texas automated vehicle registry, lifting its registered count to 319 from 169. The first seven appeared on the registry on August 31.

RobotaxiTracker, a community site that counts vehicles from sightings and state records, listed 275 vehicles in unsupervised service in Austin on Saturday, 105 of them Cybercabs, which is well below Tesla’s figure. Tracker counts can lag official numbers, though Sawyer Merritt noted that Cybercab wait times in Austin stayed short on Saturday evening even with more than 2,000 fans in town for X Takeover.

Advertisement
-

Regulators are watching the rollout. NHTSA opened an audit query into Tesla’s certification that the Cybercab meets federal safety standards, and sworn answers are due October 30. Tesla reports third quarter earnings on October 21, which gives the company a natural venue to define its fleet numbers and put a date on Dallas.

Continue Reading