Connect with us

News

Tesla’s new patent shows path to Elon Musk’s pure vision FSD approach

Credit: Andres GE

Published

on

Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.

“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.

Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.

In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.

The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.

Advertisement
-->

“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.

The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.

“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.

The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.

Tesla’s “Estimating object properties using visual image data” patent could be accessed below.

Vision Only Patent by Maria Merano on Scribd

Advertisement
-->

The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.

Maria--aka "M"-- is an experienced writer and book editor. She's written about several topics including health, tech, and politics. As a book editor, she's worked with authors who write Sci-Fi, Romance, and Dark Fantasy. M loves hearing from TESLARATI readers. If you have any tips or article ideas, contact her at maria@teslarati.com or via X, @Writer_01001101.

Advertisement
Comments

News

Rivian unveils self-driving chip and autonomy plans to compete with Tesla

Rivian, a mainstay in the world of electric vehicle startups, said it plans to roll out an Autonomy+ subscription and one-time purchase program, priced at $49.99 per month and $2,500 up front, respectively, for access to its self-driving suite.

Published

on

Credit: Rivian

Rivian unveiled its self-driving chip and autonomy plans to compete with Tesla and others at its AI and Autonomy Day on Thursday in Palo Alto, California.

Rivian, a mainstay in the world of electric vehicle startups, said it plans to roll out an Autonomy+ subscription and one-time purchase program, priced at $49.99 per month and $2,500 up front, respectively, for access to its self-driving suite.

CEO RJ Scaringe said it will learn and become more confident and robust as more miles are driven and it gathers more data. This is what Tesla uses through a neural network, as it uses deep learning to improve with every mile traveled.

He said:

“I couldn’t be more excited for the work our teams are driving in autonomy and AI. Our updated hardware platform, which includes our in-house 1600 sparse TOPS inference chip, will enable us to achieve dramatic progress in self-driving to ultimately deliver on our goal of delivering L4. This represents an inflection point for the ownership experience – ultimately being able to give customers their time back when in the car.”

At first, Rivian plans to offer the service to personally-owned vehicles, and not operate as a ride-hailing service. However, ride-sharing is in the plans for the future, he said:

“While our initial focus will be on personally owned vehicles, which today represent a vast majority of the miles to the United States, this also enables us to pursue opportunities in the rideshare space.”

The Hardware

Rivian is not using a vision-only approach as Tesla does, and instead will rely on 11 cameras, five radar sensors, and a single LiDAR that will face forward.

It is also developing a chip in-house, which will be manufactured by TSMC, a supplier of Tesla’s as well. The chip will be known as RAP1 and will be about 50 times as powerful as the chip that is currently in Rivian vehicles. It will also do more than 800 trillion calculations every second.

RAP1 powers the Autonomy Compute Module 3, known as ACM3, which is Rivian’s third-generation autonomy computer.

ACM3 specs include:

  • 1600 sparse INT8 TOPS (Trillion Operations Per Second).
  • The processing power of 5 billion pixels per second.
  • RAP1 features RivLink, a low-latency interconnect technology allowing chips to be connected to multiply processing power, making it inherently extensible.
  • RAP1 is enabled by an in-house developed AI compiler and platform software

As far as LiDAR, Rivian plans to use it in forthcoming R2 cars to enable SAE Level 4 automated driving, which would allow people to sit in the back and, according to the agency’s ratings, “will not require you to take over driving.”

More Details

Rivian said it will also roll out advancements to the second-generation R1 vehicles in the near term with the addition of UHF, or Universal Hands-Free, which will be available on over 3.5 million miles of roadway in the U.S. and Canada.

Rivian will now join the competitive ranks with Tesla, Waymo, Zoox, and others, who are all in the race for autonomy.

Continue Reading

News

Tesla partners with Lemonade for new insurance program

Tesla recently was offered “almost free” coverage for Full Self-Driving by Lemonade’s Shai Wininger, President and Co-founder, who said it would be “happy to explore insuring Tesla FSD miles for (almost) free.”

Published

on

Credit: Tesla

Tesla owners in California, Oregon, and Arizona can now use Lemonade Insurance, the firm that recently said it could cover Full Self-Driving miles for “almost free.”

Lemonade, which offered the new service through its app, has three distinct advantages, it says:

  • Direct Connection for no telematics device needed
  • Better customer service
  • Smarter pricing

The company is known for offering unique, fee-based insurance rates through AI, and instead of keeping unclaimed premiums, it offers coverage through a flat free upfront. The leftover funds are donated to charities by its policyholders.

On Thursday, it announced that cars in three states would be able to be connected directly to the car through its smartphone app, enabling easier access to insurance factors through telematics:

Tesla recently was offered “almost free” coverage for Full Self-Driving by Lemonade’s Shai Wininger, President and Co-founder, who said it would be “happy to explore insuring Tesla FSD miles for (almost) free.”

The strategy would be one of the most unique, as it would provide Tesla drivers with stable, accurate, and consistent insurance rates, while also incentivizing owners to utilize Full Self-Driving for their travel miles.

Tesla Full Self-Driving gets an offer to be insured for ‘almost free’

This would make FSD more cost-effective for owners and contribute to the company’s data collection efforts.

Data also backs Tesla Full Self-Driving’s advantages as a safety net for drivers. Recent figures indicate it was nine times less likely to be in an accident compared to the national average, registering an accident every 6.36 million miles. The NHTSA says a crash occurs approximately every 702,000 miles.

Tesla also offers its own in-house insurance program, which is currently offered in twelve states so far. The company is attempting to enter more areas of the U.S., with recent filings indicating the company wants to enter Florida and offer insurance to drivers in that state.

Continue Reading

News

Tesla Model Y gets hefty discounts and more in final sales push

Published

on

Credit: Tesla

Tesla Model Y configurations are getting hefty discounts and more benefits as the company is in the phase of its final sales push for the year.

Tesla is offering up to $1,500 off new Model Y Standard trims that are available in inventory in the United States. Additionally, Tesla is giving up to $2,000 off the Premium trims of the Model Y. There is also one free upgrade included, such as a paint color or interior color, at no additional charge.

Tesla is hoping to bolster a relatively strong performance through the first three quarters of the year, with over 1.2 million cars delivered through the first three quarters.

This is about four percent under what the company reported through the same time period last year, as it was about 75,000 vehicles ahead in 2024.

However, Q3 was the company’s best quarterly performance of all time, and it surged because of the loss of the $7,500 EV tax credit, which was eliminated in September. The imminent removal of the credit led to many buyers flocking to Tesla showrooms to take advantage of the discount, which led to a strong quarter for the company.

2024 was the first year in the 2020s when Tesla did not experience a year-over-year delivery growth, as it saw a 1 percent slide from 2023. The previous years saw huge growth, with the biggest coming from 2020 to 2021, when Tesla had an 87 percent delivery growth.

This year, it is expected to be a second consecutive slide, with a drop of potentially 8 percent, if it manages to deliver 1.65 million cars, which is where Grok projects the automaker to end up.

Tesla will likely return to its annual growth rate in the coming years, but the focus is becoming less about delivery figures and more about autonomy, a major contributor to the company’s valuation. As AI continues to become more refined, Tesla will apply these principles to its Full Self-Driving efforts, as well as the Optimus humanoid robot project.

Will Tesla thrive without the EV tax credit? Five reasons why they might

These discounts should help incentivize some buyers to pull the trigger on a vehicle before the year ends. It will also be interesting to see if the adjusted EV tax credit rules, which allowed deliveries to occur after the September 30 cutoff date, along with these discounts, will have a positive impact.

Continue Reading