Connect with us
Tesla Autopilot now enables the car to perceive space around it Tesla Autopilot now enables the car to perceive space around it

News

Tesla Autopilot now enables the car to perceive space around it

Credit: Ashok Elluswamy

Published

on

Tesla Autopilot is now enabling the car to perceive the space around it thanks to the development of its Occupancy Networks. Tesla’s Autopilot Software Director, Ashok Elluswamy, shared a detailed thread on Twitter about a recent workshop the Autopilot team held. He also shared the workshop on Twitter.

In the video and Twitter Thread, Ashok explained how Tesla developed Occupancy Networks to literally give the car a sense of its surroundings. Humans have the ability to understand the objects around them at any given time. Is that car down the road moving at a slow speed or a fast speed? Do I, a pedestrian, have enough time to get across the street before being hit? What is that in the middle of the road? What is that falling from the sky? I should move out the way.

These reactions to scenarios and split-second decisions come naturally to humans. Tesla’s Autopilot Team is working to program the vehicles to do the same thing and this will save lives. Imagine the car being able to correctly detect its surroundings while the driver isn’t even paying attention. An example is sudden unintended accelerations (SUA). Ashok pointed out that Autopilot prevents around 40 of these types of accidents daily.

The workshop was held in June at this year’s Conference on Computer Vision and Pattern Recognition (CVPR.) in New Orleans. Ashok explained that the team developed Occupancy Networks which enable the car to predict the volumetric occupancy of everything around it.

Advertisement
-

Ashok explained that the typical approaches such as image-space segmentation of free space or pixel-wise depth have many issues. The solution to those issues is Occupancy Networks.

In other words, Occupancy Networks enable the car to perceive the space around it and determine whether or not it can drive in that space. For example, if a UFO were to suddenly crash in front of you while you’re driving, you would react quickly in the safest way possible. This is what the Autopilot Team is training the software to do.

Ashok shared details of how Occupancy Networks used Neural Radience Fields (NeRFs). “The occupancy representation of these networks allows for differentiable rendering of images (based on the Neural Radiance Fields work). However, unlike typical NeRFs, which are per scene, these occupancy nets generalize across scenes.”

You can read Ashok’s full Twitter thread here and you can watch his presentation here. We are a little over a month before Tesla’s AI Day and I’m sure Tesla will share more about the life-saving technology it is working on as well as the Optimus Bot.

Advertisement
-

Dr. Know It All recently published a video about the new 10.69 update and shared his thought about Occupancy Network.

In a message on Twitter, he told me, “The beauty of Occupancy Networks is that the car doesn’t have to know what the objects it sees are, it just has to know that they are there in order to avoid them!”

Note: Johnna is a Tesla shareholder and supports its mission. 

Your feedback is important. If you have any comments, concerns, or see a typo, you can email me at johnna@teslarati.com. You can also reach me on Twitter @JohnnaCrider1

Johnna Crider is a Baton Rouge writer covering Tesla, Elon Musk, EVs, and clean energy & supports Tesla's mission. Johnna also interviewed Elon Musk and you can listen here

Advertisement
Comments

News

SpaceX’s Gwynne Shotwell just made a quiet gesture toward Tesla

SpaceX president Gwynne Shotwell quietly followed Tesla on X, and merger watchers noticed right away.

Published

on

By

SpaceX President and COO Gwynne Shotwell has started following Tesla’s official account on X, a small change that landed in the middle of a very loud merger conversation. Whole Mars Catalog joked about it on Sunday.

A follow is not an announcement, and neither company has said anything about a deal. What gives the moment weight is the timing. Barclays analyst Dan Levy has told clients that an agreement could come before Tesla’s annual meeting, which must be held by December 6, with SpaceX as the buyer in an all stock deal, as we reported after the Roadster unveiling. Wedbush’s Dan Ives has stuck with a 2027 timeline.

Shotwell is the executive most worth watching if the two companies do move closer. When Musk was asked at the All In Summit why Tesla and SpaceX remain separate, Shotwell sat next to him and said SpaceX personnel had already moved into xAI to fill leadership and engineering gaps. The businesses were integrating “faster than I thought,” she said, though “not fully integrated yet.” Her responsibilities have also grown since SpaceX absorbed xAI, and she now oversees operations that include Grok and the company’s AI compute buildout.

The financial links are already there. Tesla’s $2 billion xAI investment turned into a stake of less than one percent in SpaceX, the two share the Terafab chip project in Austin, and Musk exercised his 2018 Tesla options a week after SpaceX began trading, a sequence analysts flagged as giving SpaceX public shares to use in a deal. Musk holds about 20 percent of Tesla and controls 85.1 percent of SpaceX’s voting power, according to our earlier breakdown.

Advertisement
-

The next test is close at hand. SpaceX reports its second earnings as a public company on Tuesday after the close, and Tesla follows on Wednesday. Musk told analysts in July that “we can’t talk about combining companies and that kind of thing on an earnings call,” so a direct answer is unlikely from either stage. Tesla shareholders can still submit and vote on questions through the Say portal until 4 p.m. EDT on Monday, and the merger is a recurring theme in the queue.

Continue Reading

Elon Musk

Tesla Roadster owners to get “Flying Stunt Mode” and looping track access

Musk says Roadster owners can command the unveiling stunts autonomously, with a Texas looping track.

Published

on

By

Elon Musk says owners of the new Tesla Roadster will be able to ask the car to perform the stunts Tesla showed at its unveiling, with the car doing the driving itself. Musk made the comment Saturday in a reply on X to tech blogger Robert Scoble, and he added a promise of a looping track at Tesla’s Texas headquarters.

Scoble had argued that the person in the Roadster is not really driving it. In his description, the driver operates a computer that tells another computer what to do, with steering, braking and acceleration all handled by wire. Musk answered, “True. You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient. Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.”

Advertisement
-

At the October 15 event outside Waco, the car drove up a curved ramp until it was upside down, flew off on cold gas thrusters, flipped and landed. It also hovered over a Cybercab, Cybertruck, Semi, Model Y and Model 3 while moving. As we noted in our breakdown of the three Roadster configurations, Musk said at the event that the car “literally is just going to puff itself up” to perform the maneuvers whenever an owner wants. Saturday’s reply adds that the car would run them on its own.

Tesla has described some of the hardware that would make that possible. The Roadster uses steer by wire with a yoke, and its cold gas thrusters rely on electric actuators for small adjustments in flight. A fan system under the car creates suction, which Tesla says is strong enough to hold it upside down, a setup we covered in our look at the Roadster’s fan system and thrusters.

Musk did not say when an autonomous stunt feature might arrive, how it would work, or what he means by sentient. He also gave no size, location or opening date for the Texas track. Production is planned for Giga Texas in 2027 or 2028, and Tesla says the car is not approved for public road use. The Rocket version, the one built to fly, is invite only.

The comment follows a week of Musk teasing the event, including his claim that the demo would be a banger, which we covered before the stream. Tesla reports third quarter earnings on October 21, and shareholders can submit and vote on questions through the Say portal until 4 p.m. EDT on October 20, according to our earnings Q&A preview. A question about autonomous Roadster stunts and the Texas track would be a quick way to get specifics from management.

Continue Reading

Elon Musk

How to use Grok Bot to block spam calls and texts

Musk told users to ask Grok Bot to scrub their phone numbers from spam lists.

Published

on

By

Elon Musk has a new use case for Grok Bot, and it is the spam call. On Thursday he replied to an X user named Arash with a short instruction: “Ask your @Grok @Bot to remove your phone number from spam call & text lists!” Arash had said he got tired of the calls, had an AI bot find his number on listing sites and file removal requests, and packaged the process as a free skill for others.

The skill is called Spam-Call Scrubber, which is described to find a phone number on people search sites and data brokers, submits the opt outs, completes the confirmation emails those sites send back, and rechecks on a schedule the user picks. Using it requires the Grok Bot app. The pitch is time saved, since most broker opt outs sit behind separate forms on separate sites.



Musk said Grok Bot now gives each bot its own email address, and that it can detect scam emails. On Thursday he also said SpaceX would make users whole if the bot botches a purchase or leaks a card, then told users to shop away from Amazon after the retailer blocked the agent, as Teslarati reported. The terms of service we reviewed at the time put responsibility for what an agent does on the user.

For Tesla owners, Grok Bot is not just a phone app. Tesla brought Grok Bot into its vehicles on September 22, and we argued earlier this week that the Cybercab’s real advantage may be the errands it runs during a ride. Every Cybercab and the rest of the Model Y Robotaxi fleet has it enabled. The more routine tasks like this one become, the more a rider has reason to hand over something personal in the back seat.

The new Spam-Call Scrubber skill can be downloaded for free and works on sites that honor removal requests, while noting that listings can reappear, and illegal robocallers do not check any registry. Whether Spam-Call Scrubber cuts anyone’s call volume is something the first wave of users will find out, and Musk’s endorsement guarantees that wave is coming.

Advertisement
-
Continue Reading