Connect with us

News

Tesla’s new patent shows path to Elon Musk’s pure vision FSD approach

Credit: Andres GE

Published

on

Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.

“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.

Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.

In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.

The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.

“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.

Advertisement
-

The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.

“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.

The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.

Tesla’s “Estimating object properties using visual image data” patent could be accessed below.

Vision Only Patent by Maria Merano on Scribd

The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.

Advertisement
-

Maria--aka "M"-- is an experienced writer and book editor. She's written about several topics including health, tech, and politics. As a book editor, she's worked with authors who write Sci-Fi, Romance, and Dark Fantasy. M loves hearing from TESLARATI readers. If you have any tips or article ideas, contact her at maria@teslarati.com or via X, @Writer_01001101.

Advertisement
Comments

News

Tesla drops big hints ahead of Semi handover event

Published

on

Credit: Tesla

Tesla is set to inaugurate its dedicated Semi factory in Sparks, Nevada, this evening, but drone footage has already started to show who is expected on the handover stage.

Zanegler, a drone operator who regularly documents Tesla Semi operations in Nevada, filmed a row of new-generation Semi units parked outside of the plant with customer branding applied. The liveries visible in the video include companies like PepsiCo, U.S. Foods, Einride, DHL, WattEV, and others that have committed to utilizing Tesla’s Class 8 electric truck in their fleets.

Several of those company names already sit within Tesla’s public ordering book, including PepsiCo, which has been the program’s primary anchor customer since the first Semi deliveries in December 2022. PepsiCo now runs dozens of Tesla Semi units in daily service, with drivers completing regional routes.

Einride placed a 500-unit order in August, which was, at the time, the largest single Semi commitment. First deployments of their Semi units are planned for this month and will eventually span across California, Texas, New Jersey, Illinois, and Georgia. Meanwhile, IMC Logistics announced a 50-truck California order this week.

Tesla Semi lands the biggest electric truck deal in U.S. history

Other names, like LTS, OK Produce, and HMD, have not been widely confirmed as firm buyers, but their presence on the lot is perhaps the clearest signal that Tesla intends to expand on that list this evening at the event.

Tesla first unveiled the Semi back in 2017 with a 2019 production target.

Limited pilot builds reached PepsiCo in late 2022, and high-volume production began at the new 1.7-million-square-foot plant that sits logically positioned next to Tesla’s Gigafactory Nevada. Tesla Semi program director Dan Priestley has said that Tesla expects to build “many thousands” of Semi units this year, but as with every Tesla release, there have been set expectations of an S-curve ramp.

Outside estimates still put 2026 deliveries in the 5,000-to-15,000 range, but it will ultimately depend on Tesla’s readiness to put those units out, as well as how smoothly production is moving internally.

Tesla’s Semi Rollout event is set to start tonight at the Sparks factory, and it will be livestreamed on X starting at 6 p.m. PDT / 9 p.m. ET.

Continue Reading

News

Tesla App now shows you what your Supercharger will look like upon arrival

Published

on

Credit: Tesla

The Tesla App is now giving owners a better indication of what to expect when visiting a Supercharger site, as it is now sharing Site Maps in the app itself, making the feature no longer exclusively available in the car.

Tesla owners can now preview a Supercharger’s layout and live stall status from their phone thanks to the App’s new software version, v4.61.0. Zooming into a supported Supercharger on the charging map now switches the familiar street view into a site-specific map that shows stall positions, occupied bays, out-of-service posts, and a live count of open Superchargers.

It will even show you which specific Tesla model is charging at each occupied stall.

This is the same view drivers first saw inside the car with the 2025 Holiday Update, which started as a pilot for Tesla in California and Texas. Those early maps showed layout, nearby amenities, and the status of each operational stall. The feature has spread to most Superchargers in the U.S., but now Tesla wants the feature available through the Smartphone App, which is now rolling out to owners.

The in-vehicle screen maps remain a richer 3D canvas and originally required AMD Ryzen infotainment hardware, which left many Intel-based Model 3 and Model Y owners without the view. The app version removes that hardware barrier, so any owner can now get a preview of their upcoming Supercharger stop on their phone.

Anyone with the updated version of the app can open a Site Map on their phone. The feature has provided some additional peace of mind to anxious travelers and those who might be looking for a place that is less congested for faster charging speeds. It is a meaningful addition to many owners, especially for trips to unfamiliar locations.

You can now pick a Supercharger location that might be more aligned with what you are looking for or need: you can pick a site based on what stalls are open, where ADA stalls sit, how you will pull in, and more, instead of circling a crowded lot after arriving. Owners of older cars now have access to the feature without having to purchase a new vehicle altogether.

Site Mpas will not reserve a stall, nor will it change how Fast Charging works. Tesla does something simpler and more useful by giving owners a dedicated preview of the Supercharger they’re about to charge, turning an unknown parking lot into a place that may seem more familiar thanks to the preview.

Interested in ordering a Tesla? Use my referral code for three free months of Full Self-Driving (Supervised) here.

Continue Reading

Investor's Corner

Tesla Optimus Gen 3 shows off a cleaner, factory-ready design in new app discovery

Renders hidden inside Tesla’s Android app show Optimus Gen 3’s design before any official reveal.

Published

on

By

Tesla Optimus Gen 3 [Credit: Tesla]

Tesla may have accidentally given a first look at its newest Optimus Gen 3 humanoid robot when photos were found in the Tesla smartphone app.

Design files tucked inside a recent Android version of the Tesla app appear to show the third generation humanoid robot next to the older Gen 2.5 prototype. The assets were extracted from the app package by Tesla community member @wholemars, who posted the renders on X late Tuesday night before deleting them. The Tesla Newswire reshared the side by side comparison on Wednesday, and the images have circulated widely since.

Tesla Optimus Gen 2.5 vs Gen 3 comparison via @WholeMars on X

Tesla Optimus Gen 2.5 vs Gen 3 comparison via @WholeMars on X

The files are labeled “gen3” and were built as models for Tesla app’s own interface, as validated directly by Grok to be official.

The comparison shows a robot that looks built for a factory line rather than a lab bench. Gen 2.5’s exposed mechanical linkages and gold plating on the knees and shins are gone. In their place, Gen 3 uses matte black fairings on the lower legs, paired with a more contoured champagne gold body. Flexible covers now seal the joint where the torso meets the upper thighs, keeping bearings and moving parts sealed from debris and unnecessary contact.

The body panels fit more tightly, and the hands, which Tesla has said carry 22 degrees of freedom, look far more refined than those on earlier units.

This most recent leak fills a gap Tesla has left open for most of the year. Elon Musk said on March 31 that Optimus 3 was walking around but needed “some finishing touches” before it could be shown, a delay Teslarati covered when Tesla missed its first quarter reveal target. Musk later said Tesla would hold the design back until closer to production, partly to keep competitors from copying it. No reveal date has been announced.

The app itself has been preparing for Optimus for months. In July, code in the Tesla app pointed to a dedicated robot phone key, a consent screen for collecting video and spatial data while Optimus works inside a home, and an alert system for low battery and mechanical faults. Finished 3D models of Gen 3 suggest the interface owners will eventually use is moving past placeholder code toward something Tesla intends to ship.

Manufacturing is moving in parallel. Tesla tore out the original Model S and Model X lines at Fremont this summer to make room for Optimus production, with a planned capacity of one million robots a year. At Giga Texas, the steel frame of a dedicated Optimus factory is nearing completion ahead of a targeted 2027 start, with Musk pointing to an eventual output of 10 million units annually.

Continue Reading