Connect with us

News

Tesla’s new patent shows path to Elon Musk’s pure vision FSD approach

Credit: Andres GE

Published

on

Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.

“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.

Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.

In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.

Advertisement

The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.

“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.

The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.

“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.

The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.

Advertisement

Tesla’s “Estimating object properties using visual image data” patent could be accessed below.

Vision Only Patent by Maria Merano on Scribd

The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.

Advertisement

Maria--aka "M"-- is an experienced writer and book editor. She's written about several topics including health, tech, and politics. As a book editor, she's worked with authors who write Sci-Fi, Romance, and Dark Fantasy. M loves hearing from TESLARATI readers. If you have any tips or article ideas, contact her at maria@teslarati.com or via X, @Writer_01001101.

Advertisement
Comments

Elon Musk

Tesla teases greater Grok FSD integration and ‘Banish’ feature ‘in about 3 months’

Published

on

Credit: Tesla

Tesla is going to let you guide Full Self-Driving with Grok in 3 months, CEO Elon Musk confirmed on X.

The response from Musk, which revealed Tesla plans to allow drivers to effectively control the car and its navigation more explicitly using Grok, puts the feature for about September.

A Tesla owner said that Full Self-Driving is great, but owners should be able to “converse with Grok like we can with an Uber driver.” She then used examples like, “Grok, turn right here,” and “Drop us off right here, we’ll walk due to traffic,” and finally,” Drop at entrance first, then park far away.”

Coincidentally, the final piece of dialogue would also mean features like Banish are potentially on the way soon.

Banish is also referred to as “Reverse Summon,” and would enable the car to self-park while dropping occupants off at their destination.

This would be a great way to improve the overall experience while supervising FSD. Navigation is already a major painpoint that many owners complain about. Manual overrides when a maneuver is requested or canceled (like using the turn signal stalk to override a navigation route), do not always work.

The feature could be especially useful in street parking scenarios in a city, where spots are sometimes tough to come by. Many of us who grab dinner in a more populated area will park a street or two over from wherever we’re going, because sometimes you know that’s the best you will get. If a driver using FSD could say, “Hey Grok, turn right here on Queen St. and park in that open spot on the right,” it could save a lot of confusion FSD might have on its own.

Musk teased that a similar feature was “coming” back in February:

Tesla Full Self-Driving set to get an awesome new feature, Elon Musk says

It is certainly surprising that Tesla is doing it at this point. The company’s more recent moves have been more evident of taking control and inputs away from humans and putting them in the AI’s hands more frequently. The biggest example of this was taking away Max Speed in AI4 cars, giving us Speed Profiles, and not having any input on the fastest speed the car will travel.

Of course, giving navigation preferences to Grok is availble already in Teslas, but not at the drop of a hat. Instead, you can suggest a certain route at the beginning of your drive.

Here’s an example of that from December:

Finally, the original post that Musk responded to mentioned a parking preference after dropping off the occupants, which describes the Banish feature that Tesla has teased for years.

We’re not sure if Musk was responding more to the ability to guide the car with Grok, or whether he also was including Banish in the three-month prediction timeframe.

Continue Reading

News

Tesla Cybercab has one important piece that AI4 cars might need for FSD

Published

on

Credit: @tpgoebel | X

A close-up image of a Cybercab engineering vehicle in Peabody, Massachusetts, reveals a compact triangular side repeater camera housing equipped with an integrated washer mechanism.

This seemingly small hardware addition could prove to be one of the most critical components for achieving reliable, unsupervised Full Self-Driving (FSD) — not just for the dedicated Robotaxi but potentially for existing AI4-equipped vehicles as well.

The washer system’s importance cannot be overstated in Tesla’s vision-only autonomy approach. Cameras are the sole sensory input for the neural networks powering FSD, constantly interpreting the environment for safe navigation. In real-world conditions, however, lenses quickly accumulate rain, snow, mud, dust, or road spray.

Many of us Tesla owners, especially those who deal with any sort of winter weather at all, know the all-too-common alert that pops up when cameras are obstructed:

Even brief obstructions can drop perception confidence, trigger safety disengagements, or force the vehicle to pull over, although these are relatively rare. Instead, most of the time, the camera will need a wipe from the owner next time they stop the car.

But unlike human drivers who can manually clear their view, a Robotaxi operating 24/7 without a steering wheel or mirrors must maintain pristine vision autonomously. The Cybercab’s side repeater washer delivers targeted cleaning bursts precisely where needed for merging, lane changes, and blind-spot monitoring — functions that demand uninterrupted visibility from the external cameras:

This hardware directly tackles a known pain point in current FSD deployments. Owners frequently report camera-related alerts during inclement weather, which is understandable, but needs to be solved for a true autonomous experience.

For a production Robotaxi fleet aiming for high utilization and minimal downtime, robust washer systems represent a foundational reliability upgrade; essentially, they’re a must-have. Early sightings suggest the design may extend to rear cameras as well, creating a comprehensive cleaning architecture that keeps the entire vision suite operational in harsh environments.

Without it, even the most advanced neural nets struggle when their “eyes” are compromised.

What Does This Mean for AI4 Cars?

This Cybercab detail raises timely questions for AI4 cars already on the road. While Hardware 4 delivers superior compute and camera resolution compared to earlier versions, production models typically lack dedicated side and rear washers. Tesla has included them on Model Y robotaxis that it is using in the fleet:

Tesla Robotaxi has a highly-requested hardware feature not available on typical Model Ys

As Tesla refines unsupervised FSD for broader release, the gap in environmental resilience becomes evident. Software improvements can help mitigate issues, but they cannot fully replace physical cleaning in heavy rain or muddy conditions. Analysts and owners increasingly speculate that AI4 vehicles may eventually require similar washer retrofits — or a future AI4.5 variant — to match the Cybercab’s all-weather readiness and support the same level of autonomy.

As testing progresses, the Cybercab’s washer mechanism highlights Tesla’s pragmatic focus on real-world robustness. It may well become the hardware piece that determines how quickly and reliably FSD scales from prototypes to everyday vehicles.

Continue Reading

Elon Musk

Elon Musk just upped his Tesla stake further fueling SpaceX merger conversation

Elon Musk just collected a $116 billion Tesla payday and the timing is eye-opening

Published

on

By

Elon Musk quietly collected one of the largest single-transaction paydays in corporate history on Monday. A Form 4 filed with the SEC on June 17, 2026 disclosed that Musk exercised 303,960,630 Tesla stock options from his 2018 compensation package, with the transaction dated June 16. No shares were sold on the open market.

The numbers are straightforward but striking. Musk exercised the options at a split-adjusted strike price of $23.34, with Tesla closing at $404.66 that day, putting the spread at $381.32 per share and generating roughly $115.9 billion in paper gains in a single transaction. To cover the exercise cost, Tesla withheld 17,531,857 shares through a net share settlement, meaning Musk paid nothing out of pocket.

For perspective, in 2018, Elon Musk’s award was originally approved by Tesla shareholders on March 21, 2018, and structured entirely around performance milestones that many analysts at the time called unreachable. Every tranche eventually vested. The original grant covered 20,264,042 shares at $350.02, which after Tesla’s 5-for-1 split in 2020 and 3-for-1 split in 2022 adjusted to 303,960,630 shares at $23.34. A Delaware court rescinded the award in January 2024, ruling the board was conflicted. As Teslarati reported, Tesla shareholders voted to ratify the package anyway in June 2024 by a wide margin. The Delaware Supreme Court reversed the decision in December 2025, finding full cancellation too extreme, and Tesla’s board signed an Implementation Agreement on April 21, 2026 to formally deliver the shares.

The Tesla and SpaceX merger everyone is talking about is quietly building

The timing and structure of the Form 4 filing carries more weight than a routine stock option exercise typically would. Musk exercised his 2018 Tesla award on June 16, a week into SpaceX completing its IPO and trading publicly, and giving SpaceX a public market valuation and share currency for the first time in the company’s history. A stock-for-stock merger between two companies requires the acquiring entity to have tradeable shares it can offer to the target’s shareholders, and SpaceX now has exactly that. At the same time, Musk just increased his direct Tesla voting power to approximately 20%, giving him greater influence over any shareholder vote that a merger would require. The restricted shares he received cannot be sold until 2033, which removes any near-term incentive to cash out and instead positions this stake as long-term structural collateral in a deal. Additionally, Musk’s two companies are already deeply intertwined through shared semiconductor fabrication at their joint TERAFAB facility in Austin, cross-company supply chain transactions, and Tesla’s $2 billion investment in xAI prior to the SpaceX-xAI merger.

Wedbush analyst Dan Ives has publicly placed the odds of a Tesla and SpaceX combination at 80% to 90% by early 2027. The Implementation Agreement that made Monday’s exercise possible was signed on April 21, 2026, roughly two months before the SpaceX IPO closed. That sequencing, building Musk’s Tesla ownership to its highest point ever immediately before SpaceX gains the public currency needed to acquire it, is either an extraordinary coincidence or a carefully staged foundation for the largest corporate merger in history.

Elon Musk’s TERAFAB project: Everything you need to know

Continue Reading