News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
-
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Tesla CEO Elon Musk said that flying cars will be coming to the market, something that his own company has hinted at previously.
Musk said on X, in response to a post that read, “We were promised flying cars and all we got is infinite superintelligence for everyone,” “You will get flying cars.”
You will get flying cars
— Elon Musk (@elonmusk) August 12, 2026
The post rang back to when Musk teased flying and hovering capabilities for the Tesla Roadster, the company’s supercar that has been delayed more times than anyone cares to count. It was set for an unveiling earlier this year, but it was then pushed back to August. There is still no sign of it coming.
However, that does not mean it won’t. But one of the biggest features of the Roadster that was teased was a SpaceX package that featured cold gas thrusters on the rear end that would help with white-knuckle acceleration. Another set would face the ground and would help the Roadster gain small bits of altitude, potentially helpful to jump over obstacles.
Elon Musk hints at Tesla Roadster’s “hovering” abilities in SpaceX package
-
But it is not a straightforward thing for Musk. As a serial entrepreneur, he tends to spend his time on major disruptors; currently, his largest projects are artificial intelligence and compute power, as well as SpaceX’s launches that will eventually make life multiplanetary.
In the past, he has been critical of flying cars and has been in favor of tunnels, one of the big reasons he started the Boring Company. In 2017 at a TED talk, he said:
“There is a challenge with flying cars in that they’ll be quite noisy. The wind force generated will be very high. Let’s just say that if something’s flying over your head, if there are a whole bunch of flying cars all over the place, that is not an anxiety-reducing situation…You’re thinking, ‘Did they service their hubcap? Or is it going to come off and guillotine me as they’re flying past?’”
However, he’s never been against them. He has also said he’s in favor of both tunnels and flying cars.
Contrary to press reports, I’m not against flying cars. Just said it was important to consider both pros and cons.
— Elon Musk (@elonmusk) March 24, 2015
Most recently, Musk said that anyone who wants a flying car should be able to get one. This was stated last October on the Joe Rogan Experience:
-
“My friend Peter Thiel once reflected that the future was supposed to have flying cars, but we don’t have flying cars… I think if Peter wants a flying car, we should be able to buy one.”
Whether the Roadster will be Tesla’s flying car or potentially another one remains in the mind of Musk. Of course, the Roadster will have to make its way to production lines before we find out.
Elon Musk
SpaceX’s next trillion dollar bet has nothing to do with rockets, Musk tells staff
Elon Musk told SpaceX staff AI revenue will soon dwarf rockets and Starlink combined entirely.
Elon Musk told SpaceX employees this week that artificial intelligence, not rockets, will soon carry the company’s revenue. In a roughly 29 minute internal address posted on SpaceX’s X account on Tuesday, Musk said AI revenue will pass every other line of business at SpaceX “probably in September” and pull further ahead by the fourth quarter.
The numbers he gave are specific. SpaceX currently runs 1.4 gigawatts of AI compute capacity. Musk wants that at 10 gigawatts by the end of 2027, a jump he tied directly to revenue: “if we bring 10GW of AI online by the end of next year, it will be $300 billion to $500 billion a year in revenue.” He called those “big numbers,” which undersells a projection larger than what most countries produce in a year.
We made rockets reusable and are rebuilding the internet in space. The next challenge: making life multiplanetary and understanding the true nature of the universe
Watch @ElonMusk deliver a company update to @SpaceX employees pic.twitter.com/5c8rxoCQfu
— SpaceX (@SpaceX) August 11, 2026
Musk went further on where AI fits into SpaceX’s future. “Probably in four or five years, AI will be 99% of the value of SpaceX,” he told staff, adding that digital intelligence would eventually run “a trillion times” ahead of biological intelligence as computing scales. He tied that growth to the company’s founding mission, telling employees “we must win on AI, because the future is overwhelmingly AI and robots,” with the payoff meant to help fund Starship and a Mars program that increasingly runs through Terafab, the joint Tesla, SpaceX and xAI chip plant.
Elon Musk launches TERAFAB: The $25B Tesla-SpaceXAI chip factory that will rewire the AI industry
-
None of this is entirely new territory. SpaceX told investors much the same story during its first earnings call as a public company on August 4, where Musk moved the company’s $1 trillion revenue target up a year to 2030 and said Starlink could someday carry a majority of the world’s internet. What the all hands video adds is a hard deadline and a specific power figure Musk had not given publicly before, along with a franker pitch to his own workforce that AI, not launch cadence, is now the thing SpaceX is betting its future on.
The AI revenue itself is not coming from SpaceX training its own models. It is largely Starlink acting as the network layer for xAI’s workloads, plus SpaceX renting out compute capacity directly, the same approach behind the roughly $16 billion the company spent on AI infrastructure in a single quarter.
Musk closed the video with a pitch aimed at recruiting and retention rather than investors, telling employees that anyone who helps SpaceX win the AI race will eventually get the chance to go to the moon or Mars themselves. Whether SpaceX can turn 1.4 gigawatts into 10 in seventeen months is the more immediate question, and one that will show up in quarterly numbers well before anyone leaves Earth.
In a new note to investors on Tuesday, Morgan Stanley analyst Andrew Percoco said that Tesla has one big financial question to answer for investors regarding its Robotaxi rollout, Full Self-Driving software, and Optimus.
Percoco said in the note that, for the most part, investors are still very positive about the direction the company is headed. However, there are some things the firm would like to see, and they have to do with financials.
Tesla (TSLA) Q2 2026 earnings results: miss on EPS, beat on revenue
Tesla bulls are more than convinced that the company’s Full Self-Driving software is proof it can develop physical AI. Financially, however, there are still some questions, especially on elevated spending, which CEO Elon Musk said would occur as the company works to roll out Robotaxi faster and continue developing its Optimus robot.
The latter two are where Tesla will have to prove progress to investors, as Percoco writes that both projects “will require clearer evidence that Robotaxi is scaling and more tangible Optimus proof points to support the ROI on elevated capex.”
Percoco said the second quarter earnings call did not change his long-term thesis of where Tesla is positioned in the AI race, which is out in front. However, there are concerns that weaker gross margins and higher R&D spend will stress financials, and that has “sharpened our (and investors’) focus on measurable progress across Robotaxi and Optimus.”
Additionally, Robotaxi still needs to be proven with more operation in existing cities while maintaining safety but improving how many rides it gives in any given time, he said. For Optimus, Percoco wrote that he is “still looking for evidence beyond commentary around SOP.”
-
Morgan Stanley put Percoco in charge of covering Tesla after long-time analyst Adam Jonas transitioned to the automotive side.
Currently, Morgan Stanley has a $415 price target on Tesla and a ‘Hold’ rating on the stock. It is trading at around $330 at the time of publication, which was 2:30 P.M. on the East Coast.
Tesla CEO Elon Musk says flying cars are coming
SpaceX’s next trillion dollar bet has nothing to do with rockets, Musk tells staff
