Connect with us
Waymo hires former Tesla Executive  Waymo hires former Tesla Executive 

News

Waymo launches its AI research model for self-driving operations

Credit: Waymo

Published

on

Waymo, the driverless ride-hailing arm of Google parent company Alphabet, has now launched a new AI research model for its self-driving operations.

In a pair of press releases on its approach to AI and its new end-to-end multimodal model for autonomous driving, dubbed EMMA, Waymo has shared details about its plans for the AI research model going forward. The company says it is still using the EMMA model in research stages, rather than in operational vehicles, and the approach comes as an alternative that looks a lot like Tesla’s Full Self-Driving (FSD) and other end-to-end model approaches.

“EMMA is research that demonstrates the power and relevance of multimodal models for autonomous driving,” said Drago Anguelov, VP and Head of Research at Waymo. “We are excited to continue exploring how multimodal methods and components can contribute towards building an even more generalizable and adaptable driving stack.”

Waymo says the EMMA model uses real-world knowledge based on its Gemini language model, while the end-to-end approach is expected to eventually let autonomous vehicles operate directly from sensor data and real-time driving scenarios. The company has also highlighted its use of Large Language Models (LLMs) and Vision-Language Models (VLMs), calling its architecture the Waymo Foundation Model.

Hear the company’s executive detail the Waymo research and AI program more below.

Advertisement

EMMA research and criticisms

In the announcement press release about EMMA, Waymo lays out the following as key aspects of the research program:

  1. End-to-End Learning: EMMA processes raw camera inputs and textual data to generate various driving outputs including planner trajectories, perception objects, and road graph elements.
  2. Unified Language Space: EMMA maximizes Gemini’s world knowledge by representing non-sensor inputs and outputs as natural language text.
  3. Chain-of-Thought Reasoning: EMMA uses chain-of-thought reasoning to enhance its decision-making process, improving end-to-end planning performance by 6.7% and providing interpretable rationale for its driving decisions.

“The problem we’re trying to solve is how to build autonomous agents that navigate in the real world,” says Srikanth Thirumalai, Waymo VP of Engineering. “This goes far beyond what many AI companies out there are trying to do.”

Still, some have cast doubt on the large-scale end-to-end model, saying that it may be too risky to utilize generative AI models without including significant safeguards.

“It’s bandwagoning around something that sounds impressive but is not a solution,” said Sterling Anderson, Aurora Innovation’s Chief Product Officer, in a statement to Automotive News.

Mobileye CTO Shai Shalev-Shwartz called end-to-end approaches “a huge risk,” especially regarding the verification of decision-making process for vehicles operating on the model. It’s also worth noting that Waymo is currently only researching the approach, and it doesn’t currently have any plans to make it commercially available.

Advertisement

The news comes after Waymo recently closed on a $5.6 billion funding round, effectively bringing the company’s valuation up past $45 billion. The company is also working on its next generation of self-driving vehicles based on the Hyundai Ioniq 5, built at a new factory in Georgia.

Waymo hires former Tesla Executive 

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Need accessories for your Tesla? Check out the Teslarati Marketplace:

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Comments

Elon Musk

NYC Comptroller moves to sue Tesla for securities violations

Published

on

MINISTÉRIO DAS COMUNICAÇÕES, CC BY 2.0 , via Wikimedia Commons

New York City Comptroller Brad Lander is urging the NYC Law Department to sue Tesla for securities violations related to CEO Elon Musk’s involvement in the Department of Government Efficiency (DOGE).

Lander said the basis for the potential litigation lies on “material misstatements from Tesla claiming that CEO Elon Musk spends significant time on the company and is highly active in its management, despite his helming the Trump Administration’s DOGE initiative.”

Advertisement

It is a common complaint amongst some Tesla shareholders who are less than enthusiastic about Musk’s involvement in DOGE. Some feel as if Musk is not concerned about Tesla, especially as the stock has dropped over 28 percent this year. However, Musk has continued to double down on his position within the U.S. government.

Nevertheless, Musk’s position in Tesla is still very apparent. He headed an All-Hands meeting just two weeks ago that showed his commitment to the company as he outlined future plans and even joked to employees that they should hold onto their stock.

However, Lander believes Musk’s involvement has hurt New York City pension systems, which have lost over $300 million so far this year. He said:

“In less than three months, Tesla stock has lost nearly 40% of its value, with losses over $300 million for the New York City pension systems. We have long expressed concerns that the Tesla board has failed to provide independent oversight, or to require that Musk – or someone else – serve as a full-time CEO.”

Lander went on to say that “material misstatements from Tesla misled investors about his role at the company,” stating this was his reasoning for calling on the Law Department to file securities litigation against the company.

Advertisement

He believes taking it to court will force changes and will return Tesla shares back to a level that will benefit pension systems in New York City:

“Shareholder litigation could force the changes in governance and leadership that Tesla needs, and help recover some of our pension systems’ losses. Otherwise, we may need to consider divestment.”

The pension systems would be able to pursue financial damages to cover losses and seek governance changes, it says.

Continue Reading

Elon Musk

Tesla is testing a Model 3 with some mysterious cameras in the U.S.

Published

on

Credit: u/Ready_Medium_6693

Tesla is testing a Model 3 with some mysterious cameras, potentially hinting toward the imminent release of the Cybercab and robotaxi platform in the United States.

After Tesla unveiled the Cybercab in Los Angeles in early October, the company suggested that it would be on its way to launching driverless rides in the U.S. in the near future.

Now, Tesla is inching toward a driverless ride-hailing service in Austin, Texas, among some other potential locations, but it is still working toward a platform that is robust enough to handle it.

Although the company’s Full Self-Driving suite is one of the more advanced on the market, Tesla is still working to accomplish what it feels is a mode of transportation that is safer than a human driver. The robotaxi and Cybercab rollouts will likely accomplish that, but there is still work to be done beforehand.

Now, Tesla is testing a Model 3 in the U.S. that was spotted in several different locations in the Northeastern part of the country, as cameras are seen on this vehicle in locations that are not necessarily typical for what it offers currently:

Advertisement

Another one is seen here:

Interestingly, we saw similar camera locations on the Cybercab at the event in October. Tesla is not testing the Cybercab but instead implementing these cameras on a comparable position on its other vehicles.

These are the cameras we spotted on the Cybercab at the event in October:

In the past, Tesla has used a variety of strategies to measure self-driving accuracy, including LiDAR, which has been seen on some testing mules that we have spotted out in public.

Tesla CEO Elon Musk has said that the company does not need LiDAR on testing mules for ground truth, but we still spot them from time to time on public roads.

Advertisement

It’s an appropriate way just to cross Ts and dot Is:

Tesla Model X testing mule spotted with LiDAR rig ahead of Robotaxi event

The company is still moving toward that initial rollout of driverless ride-hailing in Austin in June, and some company executives have stated that the Cybercab will be the vehicle it uses for these initial rides.

Continue Reading

Elon Musk

Tesla adds security feature to Android with latest software update

Published

on

Credit: @greggertruck/X

Tesla is bolstering its release of features to Android users as it is rolling out some new things with its latest software update.

Update v4.43.5 will see Tesla add a Dashcam Viewer for Android phones, a new feature that will make it simpler to access and manage both Dashcam and Sentry Mode videos. This has been available to iPhone users for some time, but Android owners have not had access to this quite yet.

Tesla describes the release of the feature in release notes (via Not a Tesla App):

“The Dashcam Viewer is now available in the Tesla app for Android users.

The Dashcam Viewer makes it easy to access and manage your car’s Dashcam and Sentry Mode videos. Accessing videos on your phone is faster and more convenient, but it does come with a few requirements.

Advertisement

The Dashcam Viewer in the Tesla app allows you to view, delete, or save video clips right from your device. This should result in higher quality content being shared online and fewer videos of owners recording their Tesla’s screens with their phones.”

The feature creates a more convenient option to view things that your Tesla has captured on its dashcam or on its external cameras through Sentry Mode, its security camera system that records things that happen around the vehicle.

Sentry Mode has been a great addition for Tesla owners lately, as more and more instances of vandalism have been occurring in the past few months.

It seems Tesla might have made it a point to roll this feature out, especially as it would allow those who are getting Sentry Mode alerts to capture footage of keying or tire slashing, two common techniques used by those who dislike Tesla and/or Elon Musk.

Tesla quietly added this extra Sentry Mode feature to deter vandals

Advertisement

The last time Tesla rolled out some features to Android owners was in January when it beefed up offerings for those who do not use iOS. The January update saw Phone Key Improvements and Hands-Free Trunk Opening make their way to Android users.

Continue Reading

Trending