Connect with us
Waymo hires former Tesla Executive  Waymo hires former Tesla Executive 

News

Waymo launches its AI research model for self-driving operations

Credit: Waymo

Published

on

Waymo, the driverless ride-hailing arm of Google parent company Alphabet, has now launched a new AI research model for its self-driving operations.

In a pair of press releases on its approach to AI and its new end-to-end multimodal model for autonomous driving, dubbed EMMA, Waymo has shared details about its plans for the AI research model going forward. The company says it is still using the EMMA model in research stages, rather than in operational vehicles, and the approach comes as an alternative that looks a lot like Tesla’s Full Self-Driving (FSD) and other end-to-end model approaches.

“EMMA is research that demonstrates the power and relevance of multimodal models for autonomous driving,” said Drago Anguelov, VP and Head of Research at Waymo. “We are excited to continue exploring how multimodal methods and components can contribute towards building an even more generalizable and adaptable driving stack.”

Waymo says the EMMA model uses real-world knowledge based on its Gemini language model, while the end-to-end approach is expected to eventually let autonomous vehicles operate directly from sensor data and real-time driving scenarios. The company has also highlighted its use of Large Language Models (LLMs) and Vision-Language Models (VLMs), calling its architecture the Waymo Foundation Model.

Hear the company’s executive detail the Waymo research and AI program more below.

Advertisement
-

EMMA research and criticisms

In the announcement press release about EMMA, Waymo lays out the following as key aspects of the research program:

  1. End-to-End Learning: EMMA processes raw camera inputs and textual data to generate various driving outputs including planner trajectories, perception objects, and road graph elements.
  2. Unified Language Space: EMMA maximizes Gemini’s world knowledge by representing non-sensor inputs and outputs as natural language text.
  3. Chain-of-Thought Reasoning: EMMA uses chain-of-thought reasoning to enhance its decision-making process, improving end-to-end planning performance by 6.7% and providing interpretable rationale for its driving decisions.

“The problem we’re trying to solve is how to build autonomous agents that navigate in the real world,” says Srikanth Thirumalai, Waymo VP of Engineering. “This goes far beyond what many AI companies out there are trying to do.”

Still, some have cast doubt on the large-scale end-to-end model, saying that it may be too risky to utilize generative AI models without including significant safeguards.

“It’s bandwagoning around something that sounds impressive but is not a solution,” said Sterling Anderson, Aurora Innovation’s Chief Product Officer, in a statement to Automotive News.

Mobileye CTO Shai Shalev-Shwartz called end-to-end approaches “a huge risk,” especially regarding the verification of decision-making process for vehicles operating on the model. It’s also worth noting that Waymo is currently only researching the approach, and it doesn’t currently have any plans to make it commercially available.

The news comes after Waymo recently closed on a $5.6 billion funding round, effectively bringing the company’s valuation up past $45 billion. The company is also working on its next generation of self-driving vehicles based on the Hyundai Ioniq 5, built at a new factory in Georgia.

Waymo hires former Tesla Executive 

Advertisement
-

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Need accessories for your Tesla? Check out the Teslarati Marketplace:

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Advertisement
Comments

Investor's Corner

Tesla Optimus Gen 3 shows off a cleaner, factory-ready design in new app discovery

Renders hidden inside Tesla’s Android app show Optimus Gen 3’s design before any official reveal.

Published

on

By

Tesla Optimus Gen 3 [Credit: Tesla]

Tesla may have accidentally given a first look at its newest Optimus Gen 3 humanoid robot when photos were found in the Tesla smartphone app.

Design files tucked inside a recent Android version of the Tesla app appear to show the third generation humanoid robot next to the older Gen 2.5 prototype. The assets were extracted from the app package by Tesla community member @wholemars, who posted the renders on X late Tuesday night before deleting them. The Tesla Newswire reshared the side by side comparison on Wednesday, and the images have circulated widely since.

Tesla Optimus Gen 2.5 vs Gen 3 comparison via @WholeMars on X

Tesla Optimus Gen 2.5 vs Gen 3 comparison via @WholeMars on X

The files are labeled “gen3” and were built as models for Tesla app’s own interface, as validated directly by Grok to be official.

The comparison shows a robot that looks built for a factory line rather than a lab bench. Gen 2.5’s exposed mechanical linkages and gold plating on the knees and shins are gone. In their place, Gen 3 uses matte black fairings on the lower legs, paired with a more contoured champagne gold body. Flexible covers now seal the joint where the torso meets the upper thighs, keeping bearings and moving parts sealed from debris and unnecessary contact.

The body panels fit more tightly, and the hands, which Tesla has said carry 22 degrees of freedom, look far more refined than those on earlier units.

This most recent leak fills a gap Tesla has left open for most of the year. Elon Musk said on March 31 that Optimus 3 was walking around but needed “some finishing touches” before it could be shown, a delay Teslarati covered when Tesla missed its first quarter reveal target. Musk later said Tesla would hold the design back until closer to production, partly to keep competitors from copying it. No reveal date has been announced.

The app itself has been preparing for Optimus for months. In July, code in the Tesla app pointed to a dedicated robot phone key, a consent screen for collecting video and spatial data while Optimus works inside a home, and an alert system for low battery and mechanical faults. Finished 3D models of Gen 3 suggest the interface owners will eventually use is moving past placeholder code toward something Tesla intends to ship.

Advertisement
-

Manufacturing is moving in parallel. Tesla tore out the original Model S and Model X lines at Fremont this summer to make room for Optimus production, with a planned capacity of one million robots a year. At Giga Texas, the steel frame of a dedicated Optimus factory is nearing completion ahead of a targeted 2027 start, with Musk pointing to an eventual output of 10 million units annually.

Continue Reading

News

Tesla Semi lands the biggest electric truck deal in U.S. history

Tesla leads a record 2,500 truck order, but not every truck will be a Semi.

Published

on

By

Tesla has landed the largest electric truck order in U.S. history. ZET SCALE, a new alliance of shippers and carriers, named Tesla its primary manufacturer on Tuesday for an initial order of 2,500 electric Class 8 trucks. The deal alone would nearly double the number of electric heavy trucks operating in the country.

According to the press release from Catalyst Mobility, the nonprofit formerly known as CALSTART, Kenworth, RIDE and Volvo were also selected as secondary manufacturers that carriers can pick if their operations call for it. No split between the four brands has been published, so the exact number of Semis in the order is not yet known.

Advertisement
-

Tesla won the top slot through a competitive request for proposals. The alliance, which Catalyst Mobility runs with the Smart Freight Centre, scored bidders on price, range, charging capability and production capacity. Pooling freight demand from founding shippers, including Microsoft and PepsiCo, let every truck maker bid lower than it would for a single fleet. “The Tesla Semi is designed for lower cost per mile operations than diesel,” said Dan Priestley, director of the Tesla Semi program, as noted in the press release.

The financing is built to pull in carriers who have avoided electric trucks. ZET Financial is issuing the purchase order for all 2,500 units and will place them with fleets through a fair market value lease. The trucks will be deployed over the next few years across 10 freight hubs in Los Angeles, Stockton, Bakersfield, Seattle and Tacoma, Houston, Dallas, San Antonio, Chicago, Atlanta, and the Newark and New York area. ZET SCALE says the first order is only the opening round, with a longer term goal of 10,000 trucks or more.

Even if Tesla ends up with only a majority share, it would still be the biggest Semi deal to date. Einride’s 500 unit order in August was the previous record, and WattEV’s 370 truck order in May was the largest California deal at the time. Einride’s CEO has since said he expects all 500 trucks delivered by the end of 2027.

The announcement lands two days before Tesla formally inaugurates its Semi factory in Nevada on September 24. The 1.7 million square foot plant sits next to Gigafactory Nevada’s 4680 cell lines and is designed for 50,000 trucks a year.

Continue Reading

News

Tesla integrates Grok Bot into its vehicles for the ultimate personal assistant

Published

on

Credit: Grok

Tesla has expanded Grok from an in-car chatbot into a hands-free work assistant. On September 22, Tesla officially launched Grok Bot capability, confirming that drivers can now manage email, calendars, files, chats, and tasks by voice and then hand more ambitious errands to the AI-fueled productivity cheat code.

Grok itself is built by xAI. The new car features split into two layers: Connectors link Grok to outside accounts. Grok Bot, currently limited to SuperGrok Heavy subscribers, can complete multi-step tasks such as placing a usual coffee order, booking a reservation, or scheduling an appointment. It truly puts the driver in a nearly complete hands-free driving and productivity setting, with ironically the only task truly requiring your hands being to touch the “Start Self-Driving” button.

We were granted access to Grok Bot’s Tesla integration a few weeks back, and we’ve been able to do a handful of things with it. On a handful of occasions, we’ve used it to order food and have it ready for pickup slightly later into the evening; we’ve managed to pick up groceries after a day of errands with Grok Bot, and outside of the car, it’s helped with budgeting and even my fantasy football draft.

Advertisement
-

Tesla shows another way to utilize it: in their demo, a driver says “Hey Grok,” asks the assistant to check an inbox, and hears that a message concerns a weekend reservation. Grok then scans the calendar, reports no conflicts, and confirms the Tahoe trip is clear. It can also add check-in details to a road-trip itinerary. The point is not novelty chat. It is keeping eyes on the road, or on Full Self-Driving, while the car handles the paperwork of a trip:

This Grok rollout is not a gadget add-on as much as it is Tesla’s thesis in software form: the car should stop being a machine you operate and start being a room you occupy.

Connectors and Grok Bot treat the cabin as an office that happens to move, and that has truly been Tesla’s intention for years now. The car has slowly become an extension of a home more than a vehicle. Inbox, calendar, groceries, takeout, and reservations become voice work, not dashboard chores that you need to do before you get in your car.

Advertisement
-

Responsibility shifts from the driver to the stack, and as many Tesla owners rely on FSD for travel, Grok Bot now handles the monotony of dinner reservations or appointments.

Continue Reading