News
Tesla patents virtualization and machine learning software to improve FSD
Tesla has applied for a set of patents that are set to significantly improve virtualization, recognition, and Full Self Driving overall.
Tesla has worked tirelessly to improve full self-driving technology in the first two months of the year. Most recently, Tesla pushed its most significant improvement to employees, v11.3. Still, with new patented technology, the software is set to continue to improve dramatically this year. The two patents, focusing on virtualization and machine learning, appeared in the U.S. Patent Office database late last week.
The first patent, “Vision-Based Machine Learning Model for Autonomous Driving with Adjustable Virtual Camera,” is likely simply a reworking of a previous system but changed to fit Tesla’s new visual-only autonomous driving system. The second patent, “Vision-Based Machine Learning Model for Aggregation of Static Objects and Systems for Autonomous Driving,” focuses more on improving the virtualization seen on screen while in the vehicle.
The first patent’s abstract describes a system that looks similar to the one already available in Tesla vehicles but has been adapted to remove non-visual sensors. However, it does include an added “adjustable virtual camera,” potentially indicating that Tesla is working to give drivers more control of looking out of their car with the camera system or improved virtualization interaction.
“Systems and methods for a vision-based machine learning model for autonomous driving with adjustable virtual camera. An example method includes obtaining images from a multitude of image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a first portion of a machine learning model. The features are projected into a vector space associated with a virtual camera at a particular height. The projected features are aggregated with other projected features associated with prior images.”
The second, significantly more extensive patent is described in its abstract, focusing on the “aggregation of static objects” by the vehicle:
“Systems and methods for a vision-based machine learning model for aggregation of static objects and systems for autonomous driving. An example method includes obtaining images from image sensors positioned about a vehicle. Features associated with the images are determined, with the features being output based on a forward pass through a machine learning model. The features are projected into a vector space associated with a birds-eye view based on the machine learning model.”
If anything, the new patents from Tesla show just how dedicated it is to its visual-only system. Nowhere in either of the patents does the automaker address other sensor inputs, which seems to line up with recent discoveries showing upcoming vehicles without ultrasonic sensors.
Further, with Tesla’s increasing focus on making vehicles more AI capable, implementing improved machine learning also matches its design goals.
It remains unclear whether these improvements have been implemented in upcoming software versions or have already been placed in cars via recent software updates. Still, they nonetheless indicate that the company is making continuous progress in its pursuit.
As more and more automakers enter the autonomous driving competition, Tesla’s lead becomes ever more apparent. And while many have mocked the company for its dedication to AI over just vehicles, that investment is proving to be a fantastic one. Hopefully, it will result in an increasingly better Tesla driving experience in the coming years.
What do you think of the article? Do you have any comments, questions, or concerns? Shoot me an email at william@teslarati.com. You can also reach me on Twitter @WilliamWritin. If you have news tips, email us at tips@teslarati.com!
The Tesla Semi is entering a new Pilot Program with Paper Transport, LLC (PTI), a Wisconsin-based transportation provider. The company will test the Semi’s Long Range configuration through “dedicated operations within the Chicago market.”
Chicago presents an interesting challenge for the Semi, as it will be a colder-weather climate that will test the Semi’s ability to operate in lower temperatures and in potentially large accumulations of snow. This is something Tesla has been testing with the Semi in Alaska and even in Northern California during the colder months, but Chicago will present a truly tough midwestern winter.
Tesla Semi spotted on journey home after winter performance testing
PTI says it is using the Semi to evaluate its strategy of reducing transportation emissions while maintaining performance, reliability, and cost efficiency. These are major arguments for the Semi being introduced into new fleets.
CEO of PTI Tyler Ellison said:
“PTI has been a leader in sustainable transportation solutions for over 15 years. We take a consultative approach to helping customers identify and implement the right transportation solution for their network. Our partnership with Tesla expands our portfolio alongside renewable natural gas and intermodal, giving customers more ways to reduce Scope 3 emissions without compromising service or economics.”
PTI is far from the first company to adopt the Semi within a fleet, as Tesla entered strategic agreements with PepsiCo. and its subsidiary Frito-Lay for a Pilot Program that extended throughout the California region.
Tesla has let companies like those utilize the Semi to determine whether it would be suitable for their operations. Additionally, Tesla gets valuable information regarding the Semi’s performance, knowing what to improve and what is ideal for companies that will utilize the all-electric truck for regional and nationwide logistics.
PTI plans to utilize the Long Range configuration, which is priced at $290,000 and features a range of approximately 500 miles, a three-motor powertrain, up to 800 kW of drive power, and consumption of just 1.7 kWh per mile.
Tesla Semi pricing revealed after company uncovers trim levels
VP of Maintenance at PTI, Bryan Ellen, added:
“We are excited to partner with Tesla, leveraging their ever-evolving technology. We are bullish in our estimation of the parallels available between our dedicated model and the efficiency of their fully electric Class 8 tractor. We anticipate a growing synergy between our businesses as we work to facilitate this sustainable solution for our customers.”
PTI has logged more than 87 million miles using sources like compressed and renewable gas, but now is looking to take it a step further with fully electric operations.
Tesla revealed on Monday that it is building a new autonomous vehicle at Gigafactory Texas, its plant just outside of the City of Austin. This particular vehicle will be geared toward those who are in need of a wheelchair-accessible car that would require no human driver for operation.
According to a new report from Wired, Tesla’s Senior Policy Advisor, India Herdman, told members of the Washington D.C. City Council on Monday:
“We are in development for a purpose-built, wheelchair-accessible autonomous vehicle. We know that paratransit can be very difficult, and people who are confined to wheelchairs permanently should still be able to move around freely, so that is an active product being built by Tesla in Texas.”
This builds upon what CEO Elon Musk said last year on X, which confirmed the company was working on accessible rides within its Robotaxi platform, which currently is confined to the Model Y.
Absolutely
— Elon Musk (@elonmusk) September 19, 2025
Tesla is also developing the Cybercab, which started employee rides last week. However, this vehicle is not necessarily geared toward wheelchair accessibility.
That leaves a major gap in the autonomous ride-sharing program that Tesla is attempting to build; the company has been pretty clear that it does not want to complicate its manufacturing lines by bringing in a wide array of body styles.
However, it seems necessary to have something larger that could help transport people to appointments when they cannot drive. For wheelchair accessibility, the Robovan, which was unveiled at the “We, Robot” event in October 2024, seems to be the most ideal solution:
Herdman did not indicate whether she was referring to the Robovan or if Tesla is building yet another body style that is geared toward full autonomy but also caters to the handicapped.
Tesla might need to develop something specifically for the handicapped in order to align with the Americans with Disabilities Act, which prevents discrimination against people with disabilities in transportation services. Uber was hit with a lawsuit late last year for “refusing to reasonably modify its policies, practices, or procedures where necessary to avoid discriminating against riders with disabilities.”
Tesla would obviously like to avoid this.
It will be interesting to see what Tesla will do with this project, and whether it will introduce something new to the market or just continue with the Robovan.
Tesla weirdly confirmed that its steering wheel-less and pedal-less Cybercab vehicle is now in the process of giving employees rides, a huge milestone for the vehicle program.
But the entire thing was super strange. On Friday, Tesla released a video stating that there was “Cool news from Giga Texas” and that employees were now taking rides in Cybercabs that have no manual controls. The units seen on public roads are engineering vehicles that have manual controls inside, a necessity as Tesla moved through the testing phase.
However, Tesla removed the video and reposted it shortly after with a more vague title. It seems like the employee rides are still going, but the video was adjusted slightly. The initial upload showed employees doing things like watching movies and adjusting the climate, but these snippets were removed in the second upload.
Cool news from Giga Texas pic.twitter.com/gvbG456Tzw
— Tesla Robotaxi (@robotaxi) July 11, 2026
Both images below were uploaded with the first video, but were removed after Tesla re-uploaded the announcement. These are not available in the second upload
Credit: Tesla
Credit: Tesla
Nevertheless, the announcement from Tesla is that the Cybercab is operating with employees inside who can control the vehicle’s audio, video, climate, and destination settings through their smartphone app.
Tesla has already been testing Cybercab engineering units, but last month, it was able to self-certify for SAE Level 4, which would enable unsupervised self-driving in Texas. The company is moving toward that, and the plans have always been to launch Cybercab rides this year.
The Cybercab is potentially looked at as the next generation of Tesla’s mobility leg. For the past 15 years, the company has been known as somewhat of an automaker, among many other things. However, these passenger vehicles that Tesla has manufactured are now moving into a new realm, as they will eventually drive themselves with no supervision thanks to the Full Self-Driving suite.
The Cybercab is just the next step of that: a true vehicle developed for the sole purpose of ride-hailing. It has no human controls, it has only two seats, and it will get passengers from Point A to Point B with no awkward driver, no need for manual inputs, and with no stress.
Tesla is moving forward with other developments related to the Cybercab project as well. However, the big announcement will come when Tesla finally announces that it is launching Cybercab rides to the general public, something that it plans to launch either late this year or early 2027.
Tesla Semi enters new Pilot Program with interesting challenge
Tesla is building a wheelchair-accessible Robotaxi
