Connect with us
tesla fsd beta tesla fsd beta

News

Tesla patents virtualization and machine learning software to improve FSD

Credit: Drive in EV/Twitter

Published

on

Tesla has applied for a set of patents that are set to significantly improve virtualization, recognition, and Full Self Driving overall.

Tesla has worked tirelessly to improve full self-driving technology in the first two months of the year. Most recently, Tesla pushed its most significant improvement to employees, v11.3. Still, with new patented technology, the software is set to continue to improve dramatically this year. The two patents, focusing on virtualization and machine learning, appeared in the U.S. Patent Office database late last week.

The first patent, “Vision-Based Machine Learning Model for Autonomous Driving with Adjustable Virtual Camera,” is likely simply a reworking of a previous system but changed to fit Tesla’s new visual-only autonomous driving system. The second patent, “Vision-Based Machine Learning Model for Aggregation of Static Objects and Systems for Autonomous Driving,” focuses more on improving the virtualization seen on screen while in the vehicle.

The first patent’s abstract describes a system that looks similar to the one already available in Tesla vehicles but has been adapted to remove non-visual sensors. However, it does include an added “adjustable virtual camera,” potentially indicating that Tesla is working to give drivers more control of looking out of their car with the camera system or improved virtualization interaction.

Advertisement

“Systems and methods for a vision-based machine learning model for autonomous driving with adjustable virtual camera. An example method includes obtaining images from a multitude of image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a first portion of a machine learning model. The features are projected into a vector space associated with a virtual camera at a particular height. The projected features are aggregated with other projected features associated with prior images.”

The second, significantly more extensive patent is described in its abstract, focusing on the “aggregation of static objects” by the vehicle:

“Systems and methods for a vision-based machine learning model for aggregation of static objects and systems for autonomous driving. An example method includes obtaining images from image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a machine learning model. The features are projected into a vector space associated with a birds-eye view based on the machine learning model.”

If anything, the new patents from Tesla show just how dedicated it is to its visual-only system. Nowhere in either of the patents does the automaker address other sensor inputs, which seems to line up with recent discoveries showing upcoming vehicles without ultrasonic sensors.

Advertisement

Further, with Tesla’s increasing focus on making vehicles more AI capable, implementing improved machine learning also matches its design goals.

It remains unclear whether these improvements have been implemented in upcoming software versions or have already been placed in cars via recent software updates. Still, they nonetheless indicate that the company is making continuous progress in its pursuit.

As more and more automakers enter the autonomous driving competition, Tesla’s lead becomes ever more apparent. And while many have mocked the company for its dedication to AI over just vehicles, that investment is proving to be a fantastic one. Hopefully, it will result in an increasingly better Tesla driving experience in the coming years.

What do you think of the article? Do you have any comments, questions, or concerns? Shoot me an email at william@teslarati.com. You can also reach me on Twitter @WilliamWritin. If you have news tips, email us at tips@teslarati.com!

Advertisement

Will is an auto enthusiast, a gear head, and an EV enthusiast above all. From racing, to industry data, to the most advanced EV tech on earth, he now covers it at Teslarati.

Advertisement
Comments

Elon Musk

NASA’s first human outpost on the Moon starts now – SpaceX on deck

NASA named the rovers, landers, and vendors that will build America’s first Moon Base.

Published

on

By

NASA has laid out its most detailed Moon Base plan to date, describing a permanent outpost near the Moon’s south pole that the agency intends to build over the coming decade as a direct stepping stone to Mars. “The Moon Base will be America’s and humanity’s first outpost on another celestial world,” NASA Administrator Jared Isaacman said, adding that every mission crewed and uncrewed “will be a learning opportunity as we return to the lunar surface, build the infrastructure to stay, and master the skills required to live and operate in one of the most demanding and dangerous environments imaginable.”

The plan is structured in three phases involving both uncrewed and crewed missions to deliver equipment, vehicles, and infrastructure to the surface, with the first three moon base missions targeted to launch before the end of 2026.

Moon Base I, targeting fall 2026, will use Blue Origin’s Blue Moon Mark 1 lander to deliver scientific instruments to the Shackleton Connecting Ridge, the same region where Artemis astronauts will land. Moon Base II will send Astrobotic’s Griffin lander carrying more than 1,100 pounds of cargo including Astrolab’s FLIP rover to begin developing mobility systems on the surface. Moon Base III will carry the Lunar Vertex science mission on Intuitive Machines’ Nova-C Trinity lander to study lunar swirls near the south pole, with ESA and Korean science payloads aboard.

Elon Musk pivots SpaceX plans to Moon base before Mars

Advertisement

 

On the rover side, NASA awarded Astrolab $219 million and Lunar Outpost $220 million to build the first phase of Lunar Terrain Vehicles, with both rovers targeted for deployment to the lunar surface by 2028. Astrolab’s crewed rover weighs roughly 2,000 pounds and can reach over 6 mph. Lunar Outpost’s Pegasus rover can operate autonomously or via remote control at over 9 mph. Blue Origin separately received $188 million with an option worth $280.4 million to deliver cargo landers for rover transport.

NASA also confirmed that MoonFall, a mission deploying four survey drones to scout Artemis landing sites, has selected Firefly Aerospace to build the transport spacecraft, with a 2028 launch target.

SpaceX sits at the center of that commercial layer. SpaceX holds the NASA Human Landing System contract for the Starship-derived lander that will put astronauts on the surface under Artemis IV, currently targeting 2028. Before that can happen, SpaceX must demonstrate in-orbit propellant transfer at scale, a process requiring multiple Starship tanker launches to fuel a single mission. Water ice at the lunar south pole is central to the base’s long-term viability, as it can be converted into drinking water, breathable oxygen, and rocket fuel, directly reducing dependence on Earth resupply. That resource loop becomes far more practical if Starship can land and be refueled on or near the Moon itself.

Advertisement

Elon Musk has publicly stated that Starship V3, which recently completed its first flight, should be capable enough for initial Mars missions. The Moon Base plan announced Tuesday is the infrastructure layer that connects everything between those two ambitions, and SpaceX is the only American company currently contracted to build the rocket that gets humans to either destination.

Continue Reading

News

Tesla patent reveals strategy for solving major Full Self-Driving, Optimus issue

Published

on

Credit: Tesla

A new Tesla patent that has been granted to the company this week has revealed a potential strategy for solving a major issue that could impact both the Full Self-Driving suite and Optimus.

The patent, which is No. 12,636,684, describes a “Lens Cleaning System,” and was submitted by Tesla in May 2025.

The language in the patent details a lens cleaning system that can dispense fluid and wipe it away with a wiper assembly.

This would effectively clean any debris that would potentially impact the visibility of the cameras on Tesla automobiles or Optimus’s camera eyes. Perhaps the most pertinent example is through the Full Self-Driving suite, as debris that can accumulate on the vehicle’s exterior cameras can impact the suite’s ability to operate effectively.

This requires a remedy through manual cleaning, but this patent hints that Tesla could be planning to implement this new technology on its upcoming vehicles.

Advertisement

Interestingly, we have started to see it on some Robotaxi vehicles, and it will likely be included in the Cybercab, especially as that vehicle will enable full autonomy.

Back in January, the first Model Y Robotaxi units were spotted with camera washers on the side repeaters, as the video below shows fluid squirting and rinsing off any debris that is limiting visibility.

Advertisement

This hardware patent does bring up an interesting question for those of us who own Teslas with AI4 and have been told that our cars will one day be capable of full autonomy: Will this washer be available as a retrofit on already-built cars?

Perhaps the “Lens Cleaning System” patent is a good look at one way Tesla plans to combat one of the most obvious issues of autonomy that utilizes a camera-based system. For Optimus, it could be less needed as it could be manually cleaned by owners. For cars, it seems like a bigger necessity, especially as autonomy nears and Tesla gets close to launching a feature-complete FSD suite.

Continue Reading

News

SpaceX Starlink gets its latest airline adoptee, grabbing three of the ‘Big Four’

Published

on

Credit: American Airlines

SpaceX’s Starlink product has just gotten its latest airline adoptee, and the move marks the successful partnership of three of the “Big Four” U.S. airlines.

American Airlines announced on Tuesday that it would utilize Starlink in more than 500 narrowbody aircraft beginning in the first quarter of 2027. These include the Airbus aircraft in its fleet, including the new A321XLR and A321neo.

With the new partnership with American Airlines, Starlink is now present on three of the largest airlines in the country: American, United, and Southwest.

Starlink gets its latest airline adoptee for stable and reliable internet access

Advertisement

Starlink’s VP of Enterprise Sales, Jason Fritch, said:

“We are proud to bring Starlink on board American Airlines, delivering fast and reliable internet to passengers and crew. Whether traveling for leisure or business, Starlink enables a fully connected experience gate to gate, making every flight smoother and more enjoyable.”

Additionally, American Airlines Chief Customer Officer, Heather Garboden, said:

“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want. The addition of Starlink solidifies American as a leading airline in keeping passengers connected in flight.”

Advertisement

Starlink has been on a tear over the past year, as it has continued to be adopted by a wide variety of airlines as a more consistent and reliable way to provide WiFi to its passengers. It has already gained a great reputation among residential users, but its biggest commercial application appears to be how it is being used in the air.

Advertisement

The only airline of the Big Four not to adopt Starlink thus far is Delta, which chose to opt for the alternative, which is Amazon Leo. CEO Ed Bastian said to Bloomberg that Delta chose Amazon’s product over Starlink’s because “the opportunities, in terms of the improved bandwidth with a much lower price point than what we’ve ever seen from Starlink, will make a big difference.”

Delta will not start installing Amazon Leo until 2028.

“Of course, we expect Starlink will be warning people that we’re going to go with an inferior product,” Bastian said. “But I’m not too worried about partnering with Amazon.”

Advertisement
Continue Reading