Connect with us

News

Mobileye CTO on Building Autonomous Driving Systems

Published

on

Autonomous driving system

Mobileye autonomous driving systems

Professor Amnon Shashua, co-founder and CTO of Mobileye, gave a talk recently explaining how his company builds its autonomous driving systems. One point he emphasizes is that identifying other vehicles and people in the vicinity of the car is the easy part. What’s difficult to achieve is controlling the car so that it stays within the limits of the roadway, especially when road markings, curbs, and other indications of where the physical edges of the permissible driving space are lacking.

Shashua breaks the process into three main components — sensing, road experience management, and driving policy, which he calls “planning.” The first collates all the data coming into the system from cameras, radar, and, in some cases, Lidar. The second phase creates an environmental model that orients the car and determines its place on the road. The third phase uses all the prior information to determine all the available pathways forward and which is preferred.

Next, he goes on to speak in detail about what he calls “deep learning.” Shashua says despite its current popularity, there is a great deal of hype surrounding it. He explains why some aspects of deep learning fail to give the zero failure results required to make accurate autonomous driving possible. In particular, he shows why what he calls the “end to end approach” does not live up to its promise.

Mobileye autonomous driving

He prefers what he calls “semantic abstraction,” a process that breaks down the tasks the system must perform into discrete subsystems, each with its own function to perform. He feels the latter is more accurate and gives the fewest false positives or false negatives. The end to end system does not require image annotations, but Shashua says Mobileye has 600 people on staff annotating images and expects to have 1,000 or more shortly.

Advertisement

What is important, Shushua maintains, is dealing with what he calls “corner cases.” These are the anomalies that happen in regular driving that are rare, unexpected, or unusual — like a construction vehicle moving slowly near a highway. It is those corner cases that require the most sophisticated technological solutions and the types of situations that end to end systems do not handle well.

Watch the entire 30 minute video for yourself to learn more about some of the elements that go into Tesla’s Autopilot technology.

Source: Mobileye via YouTube

"I write about technology and the coming zero emissions revolution."

Advertisement
Comments

Elon Musk

What is Digital Optimus? The new Tesla and xAI project explained

At its core, Digital Optimus operates through a dual-process architecture inspired by human cognition.

Published

on

Credit: Grok

Tesla and xAI announced their groundbreaking joint project, Digital Optimus, also nicknamed “Macrohard” in a humorous jab at Microsoft, earlier this week.

This software-based AI agent is designed to automate complex office workflows by observing and replicating human interactions with computers. As the first major outcome of Tesla’s $2 billion investment in xAI, it represents a powerful fusion of hardware efficiency and advanced reasoning.

Tesla announces massive investment into xAI

At its core, Digital Optimus operates through a dual-process architecture inspired by human cognition.

Advertisement

Tesla’s specialized AI acts as “System 1”—the fast, instinctive executor—processing the past five seconds of real-time computer screen video along with keyboard and mouse actions to perform immediate tasks.

Advertisement

xAI’s Grok model serves as “System 2,” the strategic “master conductor” or navigator, providing high-level reasoning, world understanding, and directional oversight, much like an advanced turn-by-turn navigation system.

When combined, the two can create a powerful AI-based assistant that can complete everything from accounting work to HR tasks.

Will Tesla join the fold? Predicting a triple merger with SpaceX and xAI

The system runs primarily on Tesla’s low-cost AI4 inference chip, minimizing expensive Nvidia resources from xAI for competitive, real-time performance.

Advertisement

Elon Musk described it as “the only real-time smart AI system” capable, in principle, of emulating the functions of entire companies, handling everything from accounting and HR to repetitive digital operations.

Timelines point to swift deployment. Announced just days ago, Musk expects Digital Optimus to be ready for user experience within about six months, targeting rollout around September 2026.

It will integrate into all AI4-equipped Tesla vehicles, enabling parked cars to handle office work during downtime. Millions of dedicated units are also planned for deployment at Supercharger stations, tapping into roughly 7 gigawatts of available power.

Digital Optimus directly supports Tesla’s broader autonomy strategy. It leverages the same end-to-end neural networks, computer vision, and real-time decision-making tech that power Full Self-Driving (FSD) software and the physical Optimus humanoid robot.

By repurposing idle vehicle compute and extending AI4 hardware beyond driving, the project scales Tesla’s autonomy ecosystem from roads to digital workspaces.

Advertisement

As a virtual counterpart to physical Optimus, it divides labor: software agents manage screen-based tasks while humanoid robots tackle physical ones, accelerating Tesla’s vision of general-purpose AI for productivity, Robotaxi fleets, and beyond.

In essence, Digital Optimus bridges Tesla’s vehicle and robotics autonomy with enterprise-scale AI, promising massive efficiency gains. No other company currently matches its real-time capabilities on such accessible hardware.

It really could be one of the most crucial developments Tesla and xAI begin to integrate, as it could revolutionize how people work and travel.

Advertisement
Continue Reading

News

Tesla adds awesome new driving feature to Model Y

Tesla is rolling out a new “Comfort Braking” feature with Software Update 2026.8. The feature is exclusive to the new Model Y, and is currently unavailable for any other vehicle in the Tesla lineup.

Published

on

Credit: Tesla

Tesla is adding an awesome new driving feature to Model Y vehicles, effective on Juniper-updated models considered model year 2026 or newer.

Tesla is rolling out a new “Comfort Braking” feature with Software Update 2026.8. The feature is exclusive to the new Model Y, and is currently unavailable for any other vehicle in the Tesla lineup.

Tesla writes in the release notes for the feature:

“Your Tesla now provides a smoother feel as you come to a complete stop during routine braking.”

Advertisement

Interestingly, we’re not too sure what catalyzed Tesla to try to improve braking smoothness, because it hasn’t seemed overly abrupt or rough from my perspective. Although the brake pedal in my Model Y is rarely used due to Regenerative Braking, it seems Tesla wanted to try to make the ride comfort even smoother for owners.

Advertisement

There is always room for improvement, though, and it seems that there is a way to make braking smoother for passengers while the vehicle is coming to a stop.

This is far from the first time Tesla has attempted to improve its ride comfort through Over-the-Air updates, as it has rolled out updates to improve regenerative braking performance, handling while using Full Self-Driving, improvements to Steer-by-Wire to Cybertruck, and even recent releases that have combatted Active Road Noise.

Tesla set to activate long-awaited Cybertruck feature

Tesla holds a unique ability to change the functionality of its vehicles through software updates, which have come in handy for many things, including remedying certain recalls and shipping new features to the Full Self-Driving suite.

Advertisement

Tesla seems to have the most seamless OTA processes, as many automakers have the ability to ship improvements through a simple software update.

We’re really excited to test the update, so when we get an opportunity to try out Comfort Braking when it makes it to our Model Y.

Continue Reading

News

Tesla finally brings a Robotaxi update that Android users will love

The breakdown of the software version shows that Tesla is actively developing an Android-compatible version of the Robotaxi app, and the company is developing Live Activities for Android.

Published

on

Credit: Grok

Tesla is finally bringing an update of its Robotaxi platform that Android users will love — mostly because it seems like they will finally be able to use the ride-hailing platform that the company has had active since last June.

Based on a decompile of software version 26.2.0 of the Robotaxi app, Tesla looks to be ready to roll out access to Android users.

According to the breakdown, performed by Tesla App Updates, the company is preparing to roll out an Android version of the app as it is developing several features for that operating system.

The breakdown of the software version shows that Tesla is actively developing an Android-compatible version of the Robotaxi app, and the company is developing Live Activities for Android:

“Strings like notification_channel_robotaxid_trip_name and android_native_alicorn_eta_text show exactly how Tesla plans to replicate the iOS Live Activities experience. Instead of standard push alerts, Android users are getting a persistent, dynamically updating notification channel.”

Advertisement

This is a big step forward for several reasons. From a face-value perspective, Tesla is finally ready to offer Robotaxi to Android users.

The company has routinely prioritized Apple releases because there is a higher concentration of iPhone users in its ownership base. Additionally, the development process for Apple is simply less laborious.

Tesla is working to increase Android capabilities in its vehicles

Secondly, the Robotaxi rollout has been a typical example of “slowly then all at once.”

Advertisement

Tesla initially released Robotaxi access to a handful of media members and influencers. Eventually, it was expanded to more users, so that anyone using an iOS device could download the app and hail a semi-autonomous ride in Austin or the Bay Area.

Opening up the user base to Android users may show that Tesla is preparing to allow even more users to utilize its Robotaxi platform, and although it seems to be a few months away from only offering fully autonomous rides to anyone with app access, the expansion of the user base to an entirely different user base definitely seems like its a step in the right direction.

Continue Reading