Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

Advertisement
-->

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Advertisement
-->

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla’s six-seat extended wheelbase Model Y L sold out for January 2026

Estimated delivery dates for new Tesla Model Y L orders now extend all the way into February 2026.

Published

on

Credit: Tesla China

The Tesla Model Y L seems to be in high demand in China, with estimated delivery dates for new orders now extending all the way into February 2026. 

This suggests that the Model Y L has been officially sold out from the rest of 2025 to January 2026. 

Model Y L estimated delivery dates

The Model Y L’s updated delivery dates mark an extension from the vehicle’s previous 4-8 week estimated wait time. A detailed chart shared by Tesla data tracker @Tslachan on X shows the progressions of the Model Y L’s estimated delivery dates since its launch earlier this year. 

Following its launch in September, the vehicle was given an initial October 2025 estimated delivery date. The wait times for the vehicle were continually updated over the years, until the middle of November, when the Model Y L had an estimated delivery date of 4-8 weeks. This remained until now, when Tesla China simply listed February 2026 as the estimated delivery date for new Model Y L orders.

Model Y demand in China

Tesla Model Y demand in China seems to be very healthy, even beyond the Model Y L. New delivery dates show the company has already sold out its allocation of the all-electric crossover for 2025. The Model Y has been the most popular vehicle in the world in both of the last two years, outpacing incredibly popular vehicles like the Toyota RAV4. In China, the EV market is substantially more saturated, with more competitors than in any other market.

Advertisement
-->

Tesla has been particularly kind to the Chinese market, as it has launched trim levels for the Model Y in the country that are not available anywhere else, such as the Model Y L. Demand has been strong for the Model Y in China, with the vehicle ranking among the country’s top 5 New Energy Vehicles. Interestingly enough, vehicles that beat the Model Y in volume like the BYD Seagull are notably more affordable. Compared to vehicles that are comparably priced, the Model Y remains a strong seller in China. 

Continue Reading

Elon Musk

NVIDIA CEO Jensen Huang commends Tesla’s Elon Musk for early belief

“And when I announced DGX-1, nobody in the world wanted it. I had no purchase orders, not one. Nobody wanted to buy it. Nobody wanted to be part of it, except for Elon.”

Published

on

Credit: NVIDIA

NVIDIA CEO Jensen Huang appeared on the Joe Rogan Experience podcast on Wednesday and commended Tesla CEO Elon Musk for his early belief in what is now the most valuable company in the world.

Huang and Musk are widely regarded as two of the greatest tech entrepreneurs of the modern era, with the two working in conjunction as NVIDIA’s chips are present in Tesla vehicles, particularly utilized for self-driving technology and data collection.

Nvidia CEO Jensen Huang regrets not investing more in Elon Musk’s xAI

Both CEOs defied all odds and created companies from virtually nothing. Musk joined Tesla in the early 2000s before the company had even established any plans to build a vehicle. Jensen created NVIDIA in the booth of a Denny’s restaurant, which has been memorialized with a plaque.

On the JRE episode, Rogan asked about Jensen’s relationship with Elon, to which the NVIDIA CEO said that Musk was there when nobody else was:

“I was lucky because I had known Elon Musk, and I helped him build the first computer for Model 3, the Model S, and when he wanted to start working on an autonomous vehicle. I helped him build the computer that went into the Model S AV system, his full self-driving system. We were basically the FSD computer version 1, and so we were already working together.

And when I announced DGX-1, nobody in the world wanted it. I had no purchase orders, not one. Nobody wanted to buy it. Nobody wanted to be part of it, except for Elon.

He goes ‘You know what, I have a company that could really use this.’ I said, Wow, my first customer. And he goes, it’s an AI company, and it’s a nonprofit and and we could really use one of these supercomputers. I boxed one up, I drove it up to San Francisco, and I delivered it to the Elon in 2016.”

The first DGX-1 AI supercomputer was delivered personally to Musk when he was with OpenAI, which provided crucial early compute power for AI research, accelerating breakthroughs in machine learning that underpin modern tools like ChatGPT.

Tesla’s Nvidia purchases could reach $4 billion this year: Musk

The long-term alliance between NVIDIA and Tesla has driven over $2 trillion in the company’s market value since 2016.

Continue Reading

Elon Musk

GM CEO Mary Barra says she told Biden to give Tesla and Musk EV credit

“He was crediting me, and I said, ‘Actually, I think a lot of that credit goes to Elon and Tesla…You know me, Andrew. I don’t want to take credit for things.”

Published

on

General Motors CEO Mary Barra said in a new interview on Wednesday that she told President Joe Biden to credit Tesla and its CEO, Elon Musk, for the widespread electric vehicle transition.

She said she told Biden this after the former President credited her and GM for leading EV efforts in the United States.

During an interview at the New York Times Dealbook Summit with Andrew Ross Sorkin, Barra said she told Biden that crediting her was essentially a mistake, and that Musk and Tesla should have been explicitly mentioned (via Business Insider):

“He was crediting me, and I said, ‘Actually, I think a lot of that credit goes to Elon and Tesla…You know me, Andrew. I don’t want to take credit for things.”

Back in 2021, President Biden visited GM’s “Factory Zero” plant in Detroit, which was the centerpiece of the company’s massive transition to EVs. The former President went on to discuss the EV industry, and claimed that GM and Barra were the true leaders who caused the change:

“In the auto industry, Detroit is leading the world in electric vehicles. You know how critical it is? Mary, I remember talking to you way back in January about the need for America to lead in electric vehicles. I can remember your dramatic announcement that by 2035, GM would be 100% electric. You changed the whole story, Mary. You did, Mary. You electrified the entire automotive industry. I’m serious. You led, and it matters.”

People were baffled by the President’s decision to highlight GM and Barra, and not Tesla and Musk, who truly started the transition to EVs. GM, Ford, and many other companies only followed in the footsteps of Tesla after it started to take market share from them.

Elon Musk and Tesla try to save legacy automakers from Déjà vu

Musk would eventually go on to talk about Biden’s words later on:

They have so much power over the White House that they can exclude Tesla from an EV Summit. And, in case the first thing, in case that wasn’t enough, then you have President Biden with Mary Barra at a subsequent event, congratulating Mary for having led the EV revolution.”

In Q4 2021, which was shortly after Biden’s comments, Tesla delivered 300,000 EVs. GM delivered just 26.

Continue Reading