Connect with us
tesla fsd beta tesla fsd beta

News

Tesla patents virtualization and machine learning software to improve FSD

Credit: Drive in EV/Twitter

Published

on

Tesla has applied for a set of patents that are set to significantly improve virtualization, recognition, and Full Self Driving overall.

Tesla has worked tirelessly to improve full self-driving technology in the first two months of the year. Most recently, Tesla pushed its most significant improvement to employees, v11.3. Still, with new patented technology, the software is set to continue to improve dramatically this year. The two patents, focusing on virtualization and machine learning, appeared in the U.S. Patent Office database late last week.

The first patent, “Vision-Based Machine Learning Model for Autonomous Driving with Adjustable Virtual Camera,” is likely simply a reworking of a previous system but changed to fit Tesla’s new visual-only autonomous driving system. The second patent, “Vision-Based Machine Learning Model for Aggregation of Static Objects and Systems for Autonomous Driving,” focuses more on improving the virtualization seen on screen while in the vehicle.

The first patent’s abstract describes a system that looks similar to the one already available in Tesla vehicles but has been adapted to remove non-visual sensors. However, it does include an added “adjustable virtual camera,” potentially indicating that Tesla is working to give drivers more control of looking out of their car with the camera system or improved virtualization interaction.

“Systems and methods for a vision-based machine learning model for autonomous driving with adjustable virtual camera. An example method includes obtaining images from a multitude of image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a first portion of a machine learning model. The features are projected into a vector space associated with a virtual camera at a particular height. The projected features are aggregated with other projected features associated with prior images.”

The second, significantly more extensive patent is described in its abstract, focusing on the “aggregation of static objects” by the vehicle:

Advertisement
-

“Systems and methods for a vision-based machine learning model for aggregation of static objects and systems for autonomous driving. An example method includes obtaining images from image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a machine learning model. The features are projected into a vector space associated with a birds-eye view based on the machine learning model.”

If anything, the new patents from Tesla show just how dedicated it is to its visual-only system. Nowhere in either of the patents does the automaker address other sensor inputs, which seems to line up with recent discoveries showing upcoming vehicles without ultrasonic sensors.

Further, with Tesla’s increasing focus on making vehicles more AI capable, implementing improved machine learning also matches its design goals.

It remains unclear whether these improvements have been implemented in upcoming software versions or have already been placed in cars via recent software updates. Still, they nonetheless indicate that the company is making continuous progress in its pursuit.

As more and more automakers enter the autonomous driving competition, Tesla’s lead becomes ever more apparent. And while many have mocked the company for its dedication to AI over just vehicles, that investment is proving to be a fantastic one. Hopefully, it will result in an increasingly better Tesla driving experience in the coming years.

What do you think of the article? Do you have any comments, questions, or concerns? Shoot me an email at william@teslarati.com. You can also reach me on Twitter @WilliamWritin. If you have news tips, email us at tips@teslarati.com!

Advertisement
-

Will is an auto enthusiast, a gear head, and an EV enthusiast above all. From racing, to industry data, to the most advanced EV tech on earth, he now covers it at Teslarati.

Advertisement
Comments

Lifestyle

Tesla FSD changed its mind mid-intersection, and it may have saved a life

Tesla shares dashcam footage of FSD Supervised stopping mid intersection to avoid a T-bone crash.

Published

on

By

Credit: @BLKMDL3/X

Tesla is putting another Full Self-Driving save in front of its 24.8 million followers on X.

On Tuesday morning, Tesla’s main account shared a dashcam clip with the caption “FSD Supervised preventing T-bone crash.” The footage came from an owner posting as TheNewGrid, who described what happened at a stop sign: “I looked at the car coming to the stop sign figured they would stop, my car went, then came to a stop mid intersection as they flew by. Had I been manually driving this would have resulted in a crash.”

The sequence is the notable part. FSD had already started crossing when the other driver ran the stop sign. Instead of pressing on, the car braked hard in the middle of the intersection and let the crossing vehicle pass in front of it. By the owner’s own account, they had made the same assumption the software initially made, that the other car would stop, and would not have corrected in time.

The clip is the latest in a run of safety posts Tesla has amplified over the past several days. On Saturday, the company shared a video from Selling Sunset star Jason Oppenheim, who sold his Bentley for a Model Y and said he was buying Teslas with FSD for 10 of his employees. Ashok Elluswamy, who leads Tesla AI, followed up by writing that Tesla self-driving “reacts to other people cutting into your path with super-human response times.” On Monday, a Cybertruck owner posted footage of FSD moving across three lanes from a red light to clear a path for an ambulance approaching from behind.

Advertisement
-

This recent clip also lands a few weeks after Tesla began shipping Automatic Collision Evasion with FSD v14.3.9, a feature that can activate FSD on the driver’s behalf when a frontal collision is imminent or the driver appears distracted. Elluswamy said in September that “even earlier prediction of hazards, even faster reaction time and overall significantly better safety and collision avoidance” are coming with v15, the release Tesla has tied to round the clock Robotaxi operation.

The safety messaging matters beyond social media. Tesla has said FSD Supervised was 4.1 times less likely to crash than manual driving across 100 million kilometers on European roads, and it has been putting those figures in front of regulators. Eight EU countries have now approved FSD Supervised, with Croatia the most recent, but the EU’s bloc-wide vote originally set for October 6 has been pushed to December at the earliest.

FSD Supervised is still a Level 2 system, and the driver remains responsible at all times. Even heavy users find reasons to step in. Teslarati’s Joey Klender, who uses FSD for about 76 percent of his driving, laid out five recurring issues on Tuesday that still prompt him to intervene. Clips like this one show the other column of that ledger: moments where the software caught a mistake a human was about to make.

Continue Reading

Energy

Tesla Model 3 and Model Y can now do what only Cybertruck could

Tesla Model 3 and Model Y can power your home with Powerwall 3 during outages.

Published

on

By

Tesla has turned its two top sellers into backup batteries for the house.

Tesla Energy announced on Tuesday that Powershare Home Backup is now available for new Model 3 and Model Y vehicles paired with a Powerwall 3, saying the car can “extend your home backup by over 2 days.” Minutes later, Tesla’s main account quoted the post with a broader pitch: “With Powerwall 3, every Tesla can now serve as your home’s backup battery.”

Until this week, the Cybertruck was the only Tesla that could send power back into a home, and that capability only began working alongside Powerwall 3 last month, after years of ambitious targets.

Tesla’s updated Powershare page says every Model 3 and Model Y ordered in the U.S. or Puerto Rico on or after October 1, 2026 can use the feature. Some, but not all, earlier cars also qualify. Owners can check on the touchscreen under Software, then Additional Vehicle Information, where a capable car shows “Powershare Support: Enabled.” As Electrek reported, bidirectional power on the two cars runs through an inverter Tesla calls PCS2 Lite, and the company has not said when that part entered production on each trim.

The home side is simpler. A house that already has a Powerwall 3 and either a Wall Connector 3 or Universal Wall Connector needs no additional equipment, and Tesla says compatibility is enabled through a software update. When the grid drops, the Powerwall and the car work together, with up to 11.52 kW of continuous power available. Tesla’s “over two days” estimate assumes a home using 30 kWh per day and a car starting at a 90 percent charge. Standard trims are rated for up to two days, while the Cybertruck adds more than three.

There are limits. Powerwall 2 and Powerwall+ support is listed as “coming soon.” Model S and Model X are not included, and Grid Support, the program that lets Cybertruck owners in Texas send power back to the grid during demand spikes for bill credits, is not available for Model 3 or Model Y.

Advertisement
-

The rollout also lines up with something Elon Musk said more than three years ago. At Tesla’s March 2023 Investor Day, Musk said, “I don’t think very many people are going to want to use bidirectional charging, unless you have a Powerwall.” Tesla has now shipped the feature for its volume cars with exactly that requirement attached.

The Powerwall pairing was the hard part on Cybertruck. Tesla told owners in December 2025 that Powershare with Powerwall had been pushed to mid 2026, and lead engineer Wes Morrill explained that two devices capable of forming a home’s grid have to negotiate which one leads during an outage, across multiple generations of hardware. With that work done for the truck, Tesla was able to extend it to the Model 3 and Model Y within a month.

Ford and GM have offered home backup from their EVs for several years, but both require a separate inverter and backup hardware. Tesla’s version leans on equipment many Powerwall 3 owners already have on the wall. Powershare for the two cars also ships as part of software update 2026.38.3, the same release that began delivering Halloween Mode on Tuesday.

Continue Reading

News

Tesla ships ‘spooky’ Halloween Mode with creepy and fun features

Published

on

Credit: Tesla

Tesla is now starting to ship a “Halloween Mode” that is filled with some creepy and fun features; the company says, “This spooky update turns your Tesla into a haunted house on wheels.”

The update is just the latest in a series of updates that Tesla typically ships out in a seasonal fashion. The Spring and Summer Updates provided some fun novelty items while also packing some cool features that are actually useful for the ownership experience.

This one seems to be more fun-forward, and there are not any updates to the Full Self-Driving suite or overall operation of the vehicle. Instead, these novelty features are geared toward getting you in the mood for the Fall and Halloween.

Advertisement
-

New Ghost Costume on Car Avatar

Driver Visualization will now show your vehicle as a ghost, as an all-white sheet is draped over the vehicle. Pedestrians are turned into mummies or skeletons, and other vehicles are all a spooky green:

Credit: Tesla

Additionally, the Park Scene with your Tesla now displays that ghost costume draped over your vehicle in the foreground of a scary backdrop with Jack-o-Lanterns and a haunted house:

Credit: Tesla

Trick or Treat Mode

Trick or Treat Mode will enable the vehicle to play spooky sounds and flicker the lights as visitors approach. This might be a nice touch for when you’re handing out candy to kids on Halloween Night.

Other Features

Tesla is also adding a new Light Show, new Wrap Options, and a new Lock Sound with this update.

Credit: Tesla

Additionally, Photobooth has a new Halloween option:

Credit: Tesla

You will also be able to speak remotely through the app and transmit your voice to people outside, which is not a new feature, but the car will say it in a voice of its own, which is a new feature with that bullhorn-like feature.

Continue Reading