News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
A new Tesla patent that has been granted to the company this week has revealed a potential strategy for solving a major issue that could impact both the Full Self-Driving suite and Optimus.
The patent, which is No. 12,636,684, describes a “Lens Cleaning System,” and was submitted by Tesla in May 2025.
The language in the patent details a lens cleaning system that can dispense fluid and wipe it away with a wiper assembly.
Optimus can see you now… 🤖👁️
The patent for @Tesla_Optimus‘s eye structure just dropped. $TSLA pic.twitter.com/Jac4VhDmKH
— SETI Park (@seti_park) May 26, 2026
This would effectively clean any debris that would potentially impact the visibility of the cameras on Tesla automobiles or Optimus’s camera eyes. Perhaps the most pertinent example is through the Full Self-Driving suite, as debris that can accumulate on the vehicle’s exterior cameras can impact the suite’s ability to operate effectively.
This requires a remedy through manual cleaning, but this patent hints that Tesla could be planning to implement this new technology on its upcoming vehicles.
Interestingly, we have started to see it on some Robotaxi vehicles, and it will likely be included in the Cybercab, especially as that vehicle will enable full autonomy.
Back in January, the first Model Y Robotaxi units were spotted with camera washers on the side repeaters, as the video below shows fluid squirting and rinsing off any debris that is limiting visibility.
🚨 Tesla looks to have installed Camera Washers on the side repeater cameras on Robotaxis in Austin
pic.twitter.com/xemRtDtlRR— TESLARATI (@Teslarati) January 23, 2026
This hardware patent does bring up an interesting question for those of us who own Teslas with AI4 and have been told that our cars will one day be capable of full autonomy: Will this washer be available as a retrofit on already-built cars?
Perhaps the “Lens Cleaning System” patent is a good look at one way Tesla plans to combat one of the most obvious issues of autonomy that utilizes a camera-based system. For Optimus, it could be less needed as it could be manually cleaned by owners. For cars, it seems like a bigger necessity, especially as autonomy nears and Tesla gets close to launching a feature-complete FSD suite.
SpaceX’s Starlink product has just gotten its latest airline adoptee, and the move marks the successful partnership of three of the “Big Four” U.S. airlines.
American Airlines announced on Tuesday that it would utilize Starlink in more than 500 narrowbody aircraft beginning in the first quarter of 2027. These include the Airbus aircraft in its fleet, including the new A321XLR and A321neo.
With the new partnership with American Airlines, Starlink is now present on three of the largest airlines in the country: American, United, and Southwest.
Starlink gets its latest airline adoptee for stable and reliable internet access
Starlink’s VP of Enterprise Sales, Jason Fritch, said:
“We are proud to bring Starlink on board American Airlines, delivering fast and reliable internet to passengers and crew. Whether traveling for leisure or business, Starlink enables a fully connected experience gate to gate, making every flight smoother and more enjoyable.”
Additionally, American Airlines Chief Customer Officer, Heather Garboden, said:
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want. The addition of Starlink solidifies American as a leading airline in keeping passengers connected in flight.”
Starlink has been on a tear over the past year, as it has continued to be adopted by a wide variety of airlines as a more consistent and reliable way to provide WiFi to its passengers. It has already gained a great reputation among residential users, but its biggest commercial application appears to be how it is being used in the air.
American Airlines will adopt Starlink on more than 500 of its narrowbody aircraft beginning in Q1 2027
“As a premium global airline, we are continuously seeking out world-class partners like Starlink to deliver what our customers need and want,” said American Airlines Chief… pic.twitter.com/XY2wflycc0
— TESLARATI (@Teslarati) May 26, 2026
The only airline of the Big Four not to adopt Starlink thus far is Delta, which chose to opt for the alternative, which is Amazon Leo. CEO Ed Bastian said to Bloomberg that Delta chose Amazon’s product over Starlink’s because “the opportunities, in terms of the improved bandwidth with a much lower price point than what we’ve ever seen from Starlink, will make a big difference.”
Delta will not start installing Amazon Leo until 2028.
“Of course, we expect Starlink will be warning people that we’re going to go with an inferior product,” Bastian said. “But I’m not too worried about partnering with Amazon.”
Tesla Cybertruck’s newest trim level is nearing its first deliveries just a few months after being offered for an incredible deal.
Back in February, Tesla officially launched a new trim of the Cybertruck, the All-Wheel-Drive, starting at just $59,990. It was a lot of truck for the money, especially considering what it offered the Rear-Wheel-Drive variant for last year, which was a total flop.
The $59,990 price that was offered initially was a deal due to its 325-mile range rating, powered tonneau, three bed outlets, Powershare capability, coil springs with adaptive damping for a refined suspension feel, Steer-by-Wire and four-wheel steering, a 6′ x 4′ composite bed, towing capacity of 7,500 pounds, and a powered frunk.
Tesla is now nearing deliveries of this trim, according to watcher Sawyer Merritt, as Tesla has officially started assigning VINs to people who ordered the vehicle initially:
I can confirm that Tesla has officially started assigning VINs to people who initially ordered the $59,990 Cybertruck Dual-Motor AWD, which means first deliveries should start in the coming weeks!
• 325 mile range
• 7,500 lb towing capacity
• 0-60mph: 4.1s
• Bed with… pic.twitter.com/PQwVYbZf6j— Sawyer Merritt (@SawyerMerritt) May 24, 2026
Earlier this month, we reported on units of the trim being spotted outside Gigafactory Texas by Joe Tegtmeyer.
Tesla Giga Texas buzzing as new Cybertruck appears to enter production
This Cybertruck trim was interesting because it was released basically out of nowhere, priced incredibly well, and gathered many orders in a small amount of time. However, CEO Elon Musk noted just days afterward that the vehicle would only be priced at this bargain level for ten days.
Tesla fans were not happy.
Awful way to treat customers – particularly when they already sent out a marketing email announcing the $59,990 truck…with zero mention of it being a limited-time offer.
— Ryan McCaffrey (@DMC_Ryan) February 24, 2026
However, the issues with the pricing strategy have blown over since the February unveiling event, and now that deliveries are near, Tesla fans are anticipating the truck making its way to their driveways soon.
The truck is currently priced at $69,990, and deliveries for new orders are slated for between August and September 2026.
Tesla patent reveals strategy for solving major Full Self-Driving, Optimus issue
SpaceX Starlink gets its latest airline adoptee, grabbing three of the ‘Big Four’
