Connect with us
Waymo hires former Tesla Executive  Waymo hires former Tesla Executive 

News

Waymo launches its AI research model for self-driving operations

Credit: Waymo

Published

on

Waymo, the driverless ride-hailing arm of Google parent company Alphabet, has now launched a new AI research model for its self-driving operations.

In a pair of press releases on its approach to AI and its new end-to-end multimodal model for autonomous driving, dubbed EMMA, Waymo has shared details about its plans for the AI research model going forward. The company says it is still using the EMMA model in research stages, rather than in operational vehicles, and the approach comes as an alternative that looks a lot like Tesla’s Full Self-Driving (FSD) and other end-to-end model approaches.

“EMMA is research that demonstrates the power and relevance of multimodal models for autonomous driving,” said Drago Anguelov, VP and Head of Research at Waymo. “We are excited to continue exploring how multimodal methods and components can contribute towards building an even more generalizable and adaptable driving stack.”

Waymo says the EMMA model uses real-world knowledge based on its Gemini language model, while the end-to-end approach is expected to eventually let autonomous vehicles operate directly from sensor data and real-time driving scenarios. The company has also highlighted its use of Large Language Models (LLMs) and Vision-Language Models (VLMs), calling its architecture the Waymo Foundation Model.

Hear the company’s executive detail the Waymo research and AI program more below.

Advertisement
-->

EMMA research and criticisms

In the announcement press release about EMMA, Waymo lays out the following as key aspects of the research program:

  1. End-to-End Learning: EMMA processes raw camera inputs and textual data to generate various driving outputs including planner trajectories, perception objects, and road graph elements.
  2. Unified Language Space: EMMA maximizes Gemini’s world knowledge by representing non-sensor inputs and outputs as natural language text.
  3. Chain-of-Thought Reasoning: EMMA uses chain-of-thought reasoning to enhance its decision-making process, improving end-to-end planning performance by 6.7% and providing interpretable rationale for its driving decisions.

“The problem we’re trying to solve is how to build autonomous agents that navigate in the real world,” says Srikanth Thirumalai, Waymo VP of Engineering. “This goes far beyond what many AI companies out there are trying to do.”

Still, some have cast doubt on the large-scale end-to-end model, saying that it may be too risky to utilize generative AI models without including significant safeguards.

“It’s bandwagoning around something that sounds impressive but is not a solution,” said Sterling Anderson, Aurora Innovation’s Chief Product Officer, in a statement to Automotive News.

Mobileye CTO Shai Shalev-Shwartz called end-to-end approaches “a huge risk,” especially regarding the verification of decision-making process for vehicles operating on the model. It’s also worth noting that Waymo is currently only researching the approach, and it doesn’t currently have any plans to make it commercially available.

Advertisement
-->

The news comes after Waymo recently closed on a $5.6 billion funding round, effectively bringing the company’s valuation up past $45 billion. The company is also working on its next generation of self-driving vehicles based on the Hyundai Ioniq 5, built at a new factory in Georgia.

Waymo hires former Tesla Executive 

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Need accessories for your Tesla? Check out the Teslarati Marketplace:

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Advertisement
Comments

News

Waymo scrutinized after self-driving taxis cause traffic jams during SF blackout

It’s not farfetched to speculate that it would have been a doomsday scenario for Tesla had FSD behaved this way.

Published

on

Credit: @AnnTrades/X

A power outage across San Francisco over the weekend forced numerous Waymo self-driving taxis to stop at darkened intersections and cause traffic blockages in multiple locations across the city. The disruption left riders stranded, frustrated drivers blocked, and city officials stepping in as the Alphabet-owned company temporarily suspended service amid the widespread gridlock.

Needless to say, it would likely have been a doomsday scenario for Tesla had FSD behaved in a similar way, especially if fleets of its robotaxis blocked traffic for numerous drivers. 

Power outage halts Waymo fleet

The outage knocked out electricity for tens of thousands of customers, leaving traffic signals dark across large parts of the city, as noted in a report from the New York Times. Waymo vehicles began stopping at intersections and remained stationary for extended periods, seemingly unable to operate. Tow truck operators worked through the night removing immobilized vehicles, while videos circulated online showing Waymos with hazard lights flashing as traffic backed up around them.

Waymo later confirmed that it had paused its Bay Area ride-hailing service after the San Francisco mayor’s office contacted the company about the congestion its vehicles were contributing to. Service began coming back online shortly after 3:30 p.m. local time, though some users still reported being unable to request rides. Waymo maintained that no injuries or accidents were reported during the outage.

Autonomous cars during emergencies

The incident surprised industry observers since autonomous vehicles are designed to function during signal outages and temporary connectivity losses. Waymo stated that its vehicles treat nonfunctional signals as four-way stops, but “the sheer scale of the outage led to instances where vehicles remained stationary longer than usual to confirm the state of the affected intersections. This contributed to traffic friction during the height of the congestion.” Experts suggested the problem may have been linked to the vehicles’ reliance on remote assistance teams, which help resolve complex situations the cars cannot handle independently.

Advertisement
-->

“Yesterday’s power outage was a widespread event that caused gridlock across San Francisco, with non-functioning traffic signals and transit disruptions. While the failure of the utility infrastructure was significant, we are committed to ensuring our technology adjusts to traffic flow during such events,” the Waymo spokesperson stated, adding that it is “focused on rapidly integrating the lessons learned from this event, and are committed to earning and maintaining the trust of the communities we serve every day.”

Continue Reading

News

Tesla aims to combat common Full Self-Driving problem with new patent

Tesla writes in the patent that its autonomous and semi-autonomous vehicles are heavily reliant on camera systems to navigate and interact with their environment.

Published

on

Credit: @samsheffer | x

Tesla is aiming to combat a common Full Self-Driving problem with a new patent.

One issue with Tesla’s vision-based approach is that sunlight glare can become a troublesome element of everyday travel. Full Self-Driving is certainly an amazing technology, but there are still things Tesla is aiming to figure out with its development.

Unfortunately, it is extremely difficult to get around this issue, and even humans need ways to combat it when they’re driving, as we commonly use sunglasses or sun visors to give us better visibility.

Cameras obviously do not have these ways to fight sunglare, but a new patent Tesla recently had published aims to fight this through a “glare shield.”

Tesla writes in the patent that its autonomous and semi-autonomous vehicles are heavily reliant on camera systems to navigate and interact with their environment.

The ability to see surroundings is crucial for accurate performance, and glare is one element of interference that has yet to be confronted.

Tesla described the patent, which will utilize “a textured surface composed of an array of micro-cones, or cone-shaped formations, which serve to scatter incident light in various directions, thereby reducing glare and improving camera vision.”

The patent was first spotted by Not a Tesla App.

The design of the micro-cones is the first element of the puzzle to fight the excess glare. The patent says they are “optimized in size, angle, and orientation to minimize Total Hemispherical Reflectance (THR) and reflection penalty, enhancing the camera’s ability to accurately interpret visual data.”

Additionally, there is an electromechanical system for dynamic orientation adjustment, which will allow the micro-cones to move based on the angle of external light sources.

This is not the only thing Tesla is mulling to resolve issues with sunlight glare, as it has also worked on two other ways to combat the problem. One thing the company has discussed is a direct photon count.

CEO Elon Musk said during the Q2 Earnings Call:

“We use an approach which is direct photon count. When you see a processed image, so the image that goes from the sort of photon counter — the silicon photon counter — that then goes through a digital signal processor or image signal processor, that’s normally what happens. And then the image that you see looks all washed out, because if you point the camera at the sun, the post-processing of the photon counting washes things out.”

Future Hardware iterations, like Hardware 5 and Hardware 6, could also integrate better solutions for the sunglare issue, such as neutral density filters or heated lenses, aiming to solve glare more effectively.

Continue Reading

Elon Musk

Delaware Supreme Court reinstates Elon Musk’s 2018 Tesla CEO pay package

The unanimous decision criticized the prior total rescission as “improper and inequitable,” arguing that it left Musk uncompensated for six years of transformative leadership at Tesla.

Published

on

Gage Skidmore, CC BY-SA 4.0 , via Wikimedia Commons

The Delaware Supreme Court has overturned a lower court ruling, reinstating Elon Musk’s 2018 compensation package originally valued at $56 billion but now worth approximately $139 billion due to Tesla’s soaring stock price. 

The unanimous decision criticized the prior total rescission as “improper and inequitable,” arguing that it left Musk uncompensated for six years of transformative leadership at Tesla. Musk quickly celebrated the outcome on X, stating that he felt “vindicated.” He also shared his gratitude to TSLA shareholders.

Delaware Supreme Court makes a decision

In a 49-page ruling Friday, the Delaware Supreme Court reversed Chancellor Kathaleen McCormick’s 2024 decision that voided the 2018 package over alleged board conflicts and inadequate shareholder disclosures. The high court acknowledged varying views on liability but agreed rescission was excessive, stating it “leaves Musk uncompensated for his time and efforts over a period of six years.”

The 2018 plan granted Musk options on about 304 million shares upon hitting aggressive milestones, all of which were achieved ahead of time. Shareholders overwhelmingly approved it initially in 2018 and ratified it once again in 2024 after the Delaware lower court struck it down. The case against Musk’s 2018 pay package was filed by plaintiff Richard Tornetta, who held just nine shares when the compensation plan was approved.

A hard-fought victory

As noted in a Reuters report, Tesla’s win avoids a potential $26 billion earnings hit from replacing the award at current prices. Tesla, now Texas-incorporated, had hedged with interim plans, including a November 2025 shareholder-approved package potentially worth $878 billion tied to Robotaxi and Optimus goals and other extremely aggressive operational milestones.

Advertisement
-->

The saga surrounding Elon Musk’s 2018 pay package ultimately damaged Delaware’s corporate appeal, prompting a number of high-profile firms, such as Dropbox, Roblox, Trade Desk, and Coinbase, to follow Tesla’s exodus out of the state. What added more fuel to the issue was the fact that Tornetta’s legal team, following the lower court’s 2024 decision, demanded a fee request of more than $5.1 billion worth of TSLA stock, which was equal to an hourly rate of over $200,000.

Delaware Supreme Court Elon Musk 2018 Pay Package by Simon Alvarez

Continue Reading