Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.
“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.
Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.
In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.
The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.
“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.
The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.
“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.
The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.
Tesla’s “Estimating object properties using visual image data” patent could be accessed below.
Vision Only Patent by Maria Merano on Scribd
The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.
Elon Musk
The Starship moon landing number NASA and Elon Musk can’t agree on
Musk disputes NASA estimate of 22 Starship launches for Moon landing, predicting 6 to 8.
Elon Musk is disputing a new NASA safety panel estimate of how many Starship launches it will take to put astronauts on the Moon, saying the real number will be less than half the panel’s figure.
On Thursday, NASA’s Aerospace Safety Advisory Panel held its quarterly public meeting. Panel member Charlie Precourt, a former NASA astronaut, flagged the fueling process for SpaceX’s lunar lander as a major risk for Artemis IV, the mission planned to land a crew on the Moon in 2028. “We need to keep our eyes on numerous required fuelings for the lander,” Precourt said, according to Ars Technica. “I think the last estimate is around 22 flights.”
Ars Technica’s Eric Berger posted the comment on X, and Musk replied. “That’s way too high,” Musk wrote. “Actual number will be more like 6 to 8.”
The disagreement comes down to a basic problem with sending a ship as large as Starship to the Moon. Starship burns nearly all of its propellant just reaching Earth orbit, so it cannot continue on to the Moon without stopping for a refill. SpaceX’s answer is a gas station in space. First, a Starship that works as a storage tank, called a depot, is launched into orbit. Then a series of tanker Starships launch one at a time, dock with the depot and pump their leftover propellant into it. Once the depot is full, the lunar lander version of Starship launches, docks, fills up and heads for the Moon.
Every tanker trip is its own full rocket launch, which is why the count matters. More launches mean more time, more cost and more chances for something to go wrong before astronauts ever leave Earth. Berger estimated that even if SpaceX reaches twice weekly Starship launches by the end of 2027, filling a depot at the panel’s number would still take roughly three months.
How many tankers are needed depends mostly on how much propellant each one can carry to orbit and how much is lost along the way. Starship’s fuel and oxygen are stored at extremely cold temperatures, and some of it slowly boils off while waiting in orbit. More is lost in each transfer. NASA appears to be working from what Starship can lift today, while Musk’s range assumes a more capable rocket.
Musk has pushed back on higher counts before. In 2021, after a government document suggested 16 launches, he called that “extremely unlikely” and said eight tankers would be the most required.
Much of the answer depends on hardware SpaceX has not finished flying. As Teslarati noted earlier this year, the company plans to carry out the refueling process with its upgraded V3 Starship, and Precourt described Artemis IV as carrying “a large number of firsts.” He also praised NASA Administrator Jared Isaacman’s team for working to clear obstacles for both SpaceX and Blue Origin, whose Blue Moon lander does not rely on orbital refueling for its first mission.
Elon Musk
Tesla’s secretive “Project Crystal Sun” gets a big green light in Texas
Fort Bend County approved four incentive agreements Thursday for Tesla’s proposed $10.1 billion solar factory.
Fort Bend County commissioners on Thursday approved a package of tax incentives for Tesla’s proposed $10.1 billion solar cell factory near Needville, Texas, giving the company one of the last local approvals it needs before it decides where to build. All four Tesla agreements passed 4 to 0.
The votes covered a property tax abatement inside Reinvestment Zone No. 34, a Chapter 381 economic development agreement, a foreign trade zone non-objection paired with payments in lieu of certain taxes, and a separate payment in lieu of taxes “true up” agreement, according to agenda notes from the Fort Bend Commissioners Court meeting.
The project, known internally as “Project Crystal Sun,” would make solar cells and finished modules on roughly 3,000 acres near FM 762 and FM 1994, south of the Brazos River. As Teslarati reported when the filing first surfaced in August, Tesla’s application under the state’s JETI Act splits the investment into $1.5 billion in real property and $8.6 billion in equipment, with 9,712 permanent jobs projected by 2033 and commercial operations targeted for the first quarter of 2029. The plant would handle the full chain from ingot and wafer production through cell testing.
Inside Tesla’s secretive $10 Billion “Project Crystal Sun” filing
Thursday’s approval does not lock in the site. Tesla has told the Texas Comptroller it is still weighing other locations, and site selection adviser David Dennison told Lamar Consolidated ISD trustees in September that the race had narrowed to Fort Bend and one out of state rival with a “very compelling package,” according to the Houston Chronicle. Tesla hopes to decide before the end of 2026, and the incentives still need sign off from the Comptroller and the Governor’s office.
Local officials have now done nearly everything within their control. Commissioners created the reinvestment zone in an August 24 special meeting, with Interim County Judge Daniel Wong formally withdrawing himself over his engineering firm’s past work with Tesla. Lamar CISD trustees voted 7 to 0 on September 15 to advance a JETI agreement that would tax Tesla’s qualifying property at 50 percent of its value for maintenance and operations from 2029 through 2038.
The plant lines up with a target Elon Musk set on Tesla’s Q4 2025 earnings call in January, when he said the company would “work toward getting 100 GW a year of solar cell production, integrating across the entire supply chain from raw materials all the way to finished solar panels.” In March, Tesla was reported to be negotiating a $2.9 billion purchase of Chinese solar manufacturing equipment bound for Texas. The Houston area already hosts Tesla’s Megafactory in Brookshire, where Megapack 3 production has started. Tesla said on its Q3 call that Megapack supply for 2027 is nearly sold out, and Musk wrote on X Thursday that the company is “increasing production of Megapacks as much as possible,” as demand from data centers climbs.
Tesla revealed plans to develop its own maps internally to fix Navigation issues and give owners more control over their routing.
On the company’s Q3 2026 Earnings Call, a question was asked about FSD Navigation issues, particularly speed limit recognition, parking, and routing. These are issues that surface from version to version and seem to be seriously challenging for Tesla’s AI team to resolve.
Tesla’s Head of AI, Ashok Elluswamy, said in response to the question:
“You’re totally right that we shouldn’t be depending on external people’s maps. So we are building our own maps, but not like the same way as OneMoreMap. We are building an entirely new architecture with essentially AI-based mapping and navigation.”
He continued:
“It’s going to be super awesome. It’s going to be integrated with voice. You can talk to it, ask for different routes. It’s going to learn your personalized preferences, plus the fleet preferences. The collective intelligence of all the cars is going to flow into making the maps and navigation super cool.”
Elluswamy said this issue should be confronted, and the mapping should be available for people by the time the v15 release starts deploying to customers.
“And over the next several months,” he added, “it’s just going to take over all of the navigation functions, parking, destination handling. And it will know you better than you know yourself in some regard for the driving task, and then handle it fully.”
Tesla Summon got insanely good in FSD v14.3.2 — Navigation? Not so much
Navigation is perhaps the most notable complaint with FSD, and although it has gotten better, it is still flawed. Much of the time, FSD will take people on routes that are not preferred by the driver, but Tesla tried to combat this with a routing feature in the Summer 2026 Update.
Tesla currently relies on Google for map data, but it is sort of counterintuitive to believe the company would rely on a third party for this. These improvements will be welcome, as routing and navigation have been such a pain point for so many owners for so long.
Quotes via Motley Fool
The Starship moon landing number NASA and Elon Musk can’t agree on
Tesla’s secretive “Project Crystal Sun” gets a big green light in Texas
