News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Tesla is rolling out a new version of its Full Self-Driving suite to some owners that comes with the massive addition of a safety feature.
Tesla is rolling out Automatic Collision Evasion with the 2026.27.6 Software Update, which started rolling out to some vehicles last night. We received the update, along with Full Self-Driving v14.3.9, as well as v14.2 Lite, which has identical release notes as the previous version and seems to have some refinements and improvements in behavior and performance.
🚨 Tesla FSD v14.3.9 is rolling out as well as 2026.27.6 which includes Automatic Collision Evasion
Brand new safety features from a software update. My Tesla gets better everytime I get one of these pic.twitter.com/ctrMiQXWhM
— TESLARATI (@Teslarati) September 8, 2026
However, most of the attention has fallen on the Automatic Collision Evasion feature, which we covered in an article last week.
The function will activate Full Self-Driving to “try to keep your vehicle safe and then continue driving. It can engage in the following situations while you are driving manually:
- Scenario 1: A frontal collision is imminent and braking alone may not avoid it.
- Scenario 2: Your vehicle detects that you are not sufficiently attentive to the road (for example, reaching toward the back seat), or that Full Self-Driving (Supervised) may have been unintentionally disengaged.”
Essentially, FSD will take over when the vehicle determines you are not paying sufficient attention or are heading toward a potential collision. The addition of this feature is incredibly useful as distracted driving is a major issue in today’s world.
Along with the new safety feature is Tesla FSD v14.3.9, which has no additional release notes compared to the previous version, but in my first drives, my first impression is that operation is great, and parking is still sort of a pain point.
Just took a 15-mile round trip to the gym and back
Pretty on par with what FSD is nowadays – really good. Not enough time to see what’s good and what’s bad, but these first rides on any version feel shockingly good. They’re all pretty identical https://t.co/WN1qTg4bhE
— TESLARATI (@Teslarati) September 9, 2026
Additionally, Tesla v14.2. Lite has arrived. A great review of that is available here:
— Zack (@BLKMDL3) September 9, 2026
The addition of an Automatic Collision Evasion feature is similar to that of other collision avoidance systems that are used by companies like Hyundai, Kia, and Genesis. These programs typically utilize radar and camera sensors to apply emergency brakes autonomously, though evasive steering in a manual driving mode is pioneered primarily by Tesla’s newest addition.
Elon Musk
Tesla primes Cybercabs for 4K streaming and high bandwidth gaming with Starlink integration
Tesla is now shipping Cybercabs from Giga Texas with Starlink hardware built in as standard.
Tesla’s Cybercabs are now leaving Gigafactory Texas with Starlink hardware on the rear hatch in significant numbers, according to drone footage captured Tuesday by longtime Austin drone observer Joe Tegtmeyer. Production at the factory ramped back up after the Labor Day weekend, and his flyover of the outbound lot showed rows of gold Cybercabs alongside Model Y Long Wheelbase units, many carrying the satellite module for the first time as standard equipment rather than a one off retrofit.
Giga Texas today is busy with production coming back up following the long weekend. Of interest today in the outbound lot is the appearance of hundreds of Mode; YL’s and many more Cybercabs and for the 1st time equipped with the Starlink module one the hatch in big numbers.
At… pic.twitter.com/G9yl6s51m4
— Joe Tegtmeyer 🚀 🤠🛸😎 (@JoeTegtmeyer) September 8, 2026
Tesla first showed Starlink built into an actual Cybercab on August 10, when the Robotaxi account posted images of a single gold unit with the antenna integrated into the roofline above the taillights and called it the first Cybercab with Starlink integration. That followed a July reveal where Tesla and Starlink jointly posted a cutaway diagram of the antenna placement without a working vehicle to back it up. Ashok Elluswamy, Tesla’s VP of AI software, said at the time that the connection isn’t required for the car to drive itself. It exists mainly for navigation, customer service and keeping tabs on the fleet.
Musk has made a different case in public. During Tesla’s Q2 earnings call, he said the company can’t afford robotaxis stranded in what he called “Bermuda Triangles of lack of cellular connectivity,” and he separately claimed on X that Starlink will eventually reach every Tesla built, calling it the only way to deliver high bandwidth to billions of vehicles. He has also pitched the antenna as an entertainment upgrade, telling riders they would be able to stream 4K video or play games during a trip.
The rollout has moved fast since. Robotaxi service opened to the public in Austin on September 3, and Cybercabs had already been spotted with Starlink hardware in Houston and near Miami International Airport in the weeks before Tuesday’s factory footage showed the module shipping at volume rather than on scattered test units. Whether the satellite link earns its keep is still an open question. Tesla’s unsupervised service currently runs in dense metro geofences in Texas and Florida, markets where cellular coverage is already strong, which is not where the rural dead zones Musk describes tend to show up.
After launching in Austin, Texas, last week, Tesla is looking to expand the Cybercab to new parts of the United States in an effort that will see the driverless, steering wheel-less, and pedal-less vehicle chauffeur people around as part of the Robotaxi ride-hailing service.
However, the expansion will go far beyond the United States, and CEO Elon Musk revealed he hopes Europe will be the next market where Cybercab will be operational.
Musk has publicly expressed hope that Tesla’s Cybercab robotaxi will reach Europe in the near future.
On September 8, Tesla’s Chief Executive quoted a German rider who had just completed a trip in Austin, Texas, and wrote that he hoped the vehicle would not take years to arrive in Germany. Musk replied with a short but notable message: “Hopefully soon in Europe too.”
Hopefully soon in Europe too https://t.co/vqQ69bLJuN
— Elon Musk (@elonmusk) September 8, 2026
The comment arrived only days after Tesla opened Cybercab ride-hailing to the public in Austin. The two-seat vehicle has no steering wheel or pedals and relies entirely on Tesla’s Full Self-Driving software. Early passengers have described the rides as quiet, smooth, and more stylish than competing robotaxis such as Waymo.
Austin is currently the only city where members of the public can hail a Cybercab through Tesla’s Robotaxi app. The initial fleet is small; Texas registration records show only a few dozen of the purpose-built vehicles on the road.
Tesla set to open Cybercab rides to the public, with no steering wheel or pedals
Tesla has also been operating a larger number of conventional Model Y robotaxis in the same area, but the Cybercab itself represents the company’s first dedicated, controls-free taxi design.
Europe presents a different regulatory picture. The European Union does not permit manufacturers to self-certify vehicles the way Tesla did in the United States.
Type-approval rules and a small-series limit of 1,500 automated vehicles per type per year apply across the bloc.
Supervised Full Self-Driving has gained provisional approval in several member states through national recognition of Dutch certification, yet unsupervised robotaxi operation remains a separate and more distant step. Tesla has not announced a European launch city, date, or approval pathway for the Cybercab.
Musk himself has previously cautioned that the company does not control European regulators. In an earnings call earlier in 2026, he noted that even supervised FSD took an “immense amount of time” to clear and that unsupervised service would be “somewhat at the mercy of the governments in Europe and the EU.”
The latest social-media remark therefore functions more as an expression of intent than a timetable.
If the Cybercab eventually reaches European streets, it would mark a significant expansion of Tesla’s robotaxi ambitions beyond the United States. For now, the vehicle remains an Austin-only experience, and the gap between Musk’s hope and actual deployment will be decided by regulators rather than by engineering alone.
Tesla is rolling out a new FSD version with a massive safety addition
Tesla primes Cybercabs for 4K streaming and high bandwidth gaming with Starlink integration
