News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Tesla Cybercab is set to launch in Austin, Texas, on September 3, as the company has officially started sending out invitations to a dedicated event it will hold in the city where its headquarters is located.
The Cybercab is Tesla’s dedicated ride-sharing vehicle: it features just two seats and has no steering wheel or pedals. It is aimed at fully autonomous passenger transport, and will operate in the Robotaxi fleet alongside the Tesla Model Y, which has been performing driverless rides for real-world passengers for more than a year.
Thank you so much @Tesla for inviting us to the Cybercab launch in Austin! 🤠 pic.twitter.com/F1rAR8zd5O
— TESLARATI (@Teslarati) August 22, 2026
The launch of the Cybercab marks the next chapter in Tesla’s autonomy story. The company has been developing autonomous transport for years with its Full Self-Driving (Supervised) platform, which is available in any vehicle the company has built with the proper hardware and software capabilities.
Its capabilities vary by hardware and software version, but Tesla says its latest hardware version, known as AI4, can deliver full autonomy. However, future vehicles will operate with even more robust hardware packages, as Tesla will develop AI4.5 and AI5 for even more capability in its vehicles.
Following a report from The Information that surfaced earlier this week, the writing was on the wall that Tesla was set to launch Cybercab in the near term. The report stated Tesla could launch Cybercab as soon as the end of August. Tesla came close and has booked it for September 3.
The big thing with this event being scheduled is not necessarily that Tesla is launching a new vehicle, but instead that it is launching a vehicle that has no steering wheel or pedals and will operate exclusively on a self-driving program that is evidently nearing full autonomy. If the event allows vehicles to take passengers on public roads and drop them off wherever they please within the City of Austin, it will be a drastic advancement in the company’s self-driving story.
People have ridden in Cybercab previously: Tesla had the “We, Robot” event in October 2024, which allowed people to experience fully autonomous rides in a closed circuit at Warner Bros. Studios in Burbank.
🚨 Ride in a Tesla Cybercab with us
— TESLARATI (@Teslarati) May 11, 2025
Additionally, Tesla launched employee rides in Cybercab in July.
It’s a drastic step forward for Tesla, whose CEO, Elon Musk, has promised for years that the company would release a fully autonomous vehicle and platform capable of allowing drivers to relinquish any responsibility behind the wheel.
Elon Musk put a number on where he thinks SpaceX’s Starship program is headed by 2030, replying on X a day after President Trump signed a memo pushing the country toward 1,000 space launches and reentries a year.
The exchange started when Aaron Burnett, co-founder of propulsion startup Mach 33, posted that “1,000 launches/reentries is the goal,” quoting White House science adviser Michael Kratsios on the newly signed National Space Transportation Policy. Burnett noted that the FAA’s own bull-case forecast reached only 385 annual launches by 2030, while his firm’s conservative model already put SpaceX alone near 940. Musk responded, “We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized. Still tiny numbers compared to airplane flights!”
We’re aiming to reach 30+ Starship launches/day in 2030, which is ~10k annualized.
Still tiny numbers compared to airplane flights!
— Elon Musk (@elonmusk) August 21, 2026
That figure is specific to Starship, the rocket SpaceX is still developing for orbital and lunar missions, not the Falcon 9 fleet that carries most of the company’s current launch volume. Starship has flown twice this year, a slower pace than the four and five flights SpaceX managed in 2024 and 2025. Getting from two flights a year to 30 a day is the scale of jump the new federal policy is meant to clear regulatory room for.
Trump’s memo, signed Thursday, directs agencies to identify new launch and reentry sites on federal land, including a new reentry site within 90 days, and to speed up the permitting and environmental reviews that have long slowed cadence growth. It also sets a goal of returning American astronauts to the moon by 2028 and placing initial lunar base elements by 2030, tying the launch buildout directly to NASA’s Artemis program.
SpaceX has already been pushing the FAA toward higher numbers on its own. The agency approved up to 44 annual Starship launches from Kennedy Space Center in February, on top of a 2024 review that raised the cap at Starbase in Texas to 25 a year. Those approvals cover a fraction of the 10,000 annual flights Musk is now describing, which shows how far current permitting still sits from the administration’s stated target.
The near-term test of all this is more modest. SpaceX cleared a full-duration, six-engine static fire on its next Starship vehicle this week, the last major hardware checkpoint before Flight 14, which is targeting no earlier than August 28 and is expected to attempt the vehicle’s first full orbital mission. Musk said last week that a tower catch of the upper stage is still probably months away, a reminder that the immediate roadmap remains far more incremental than the daily launch numbers he just posted.
Tesla will resolve its massive recall of nearly three million vehicles in China with stickers and a software update.
On Friday, Chinese regulators filed recall plans against Tesla, Xiaomi, Leapmotor, Xpeng, Chery, Geely, Dongfeng, Arcfox, and FAW to resolve what is essentially a carbon-copy issue throughout each of the companies’ vehicle models: emergency door release latches are simply not visible enough.
Tesla door handle saga gets its latest chapter and a big change is coming
The companies will be required to add things that will make these latches, which will open the door in the event of an emergency, more visible. Of the 7 million vehicles impacted, Tesla accounts for 2,975,910 units. More than 1.9 million of those are Model Y vehicles, with the rest, just over 970,000, being Model 3s.
To resolve the issue, Tesla is going to add warning labels to the emergency latches free of charge, and then utilize an Over-the-Air update to add a post-crash window-lowering strategy, according to CNEVpost.
This massive effort to fix the all-electric Model Y and Model 3’s emergency latch system comes just months after several probes across various markets identified the trouble some had identifying this latch. Those who had gotten involved in car accidents that stripped the vehicle of its power were not aware that every Tesla has emergency door latches.
China’s State Administration for Market Regulation (SAMR) said that severe crashes that disable a vehicle’s low-voltage system could not only hinder occupants from getting out, but also make it more difficult for emergency response workers to gain entry.
SAMR is starting to tighten the regulations it has on door handles on vehicles. A new mandatory national standard will take effect for all models starting January 1, 2027, and will require all doors to be equipped with mechanical release mechanisms. This will effectively end purely electronic door handles. Models already on sale with type approval have been granted a two-year transition period, which will enable things to change until January 2029.
Tesla will launch Cybercab on September 3
SpaceX and a new Trump order that could rewrite the next decade of launches
