News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Elon Musk
Elon Musk is now a remote DOGE worker: White House Chief of Staff
The Tesla and SpaceX CEO Elon Musk is no longer working from the West Wing.
In a conversation with the New York Post, White House Chief of Staff Susie Wiles stated that Tesla and SpaceX CEO Elon Musk is no longer working from the West Wing.
As per the Chief of Staff, Musk is still working for DOGE—as a remote worker, at least.
Remote Musk
In her conversation with the publication, Wiles stated that she still talks with Musk. And while the CEO is now working remotely, his contributions still have the same net effect.
“Instead of meeting with him in person, I’m talking to him on the phone, but it’s the same net effect,” Wiles stated, adding that “it really doesn’t matter much” that the CEO “hasn’t been here physically.” She also noted that Musk’s team will not be leaving.
“He’s not out of it altogether. He’s just not physically present as much as he was. The people that are doing this work are here doing good things and paying attention to the details. He’ll be stepping back a little, but he’s certainly not abandoning it. And his people are definitely not,” Wiles stated.
Back to Tesla
Musk has been a frequent presence in the White House during the Trump administration’s first 100 days in office. But during the Q1 2025 Tesla earnings call, Musk stated that he would be spending substantially less time with DOGE and substantially more time with Tesla. Musk did emphasize, however, that DOGE’s work is extremely valuable and critical.
“I think I’ll continue to spend a day or two per week on government matters for as long as the President would like me to do so and as long as it is useful. But starting next month, I’ll be allocating probably more of my time to Tesla and now that the major work of establishing the Department of Government Efficiency is done,” Musk stated.
Elon Musk
Tariff reprieve might be ‘Tesla-friendly,’ but it’s also an encouragement to others
Tesla stands to benefit from the tariff reprieve, but it has some work cut out for it as well.
After Secretary of Commerce Howard Lutnick made adjustments to the automotive tariff program that was initially announced, many quickly pointed to the reprieve as “Tesla-friendly.”
While that may be the case right now, it was also a nudge of encouragement to other companies, Tesla included, to source parts from the U.S. in an effort to strengthen domestic manufacturing. Many companies are close, and it will only take a handful of improvements to save themselves from tariffs on their cars as well.
Yesterday, Sec. Lutnick confirmed that cars manufactured with at least 85 percent of domestic content will face zero tariffs. Additionally, U.S. automakers would receive credit up to 15 percent of the value of vehicles to offset the cost of imported parts.
Big Tesla win? Sec Lutnick says cars with 85% domestic content will face zero tariffs
“This is ‘finish your cars in America and you win’,” Lutnick said.
Many were quick to point out that only three vehicles currently qualify for this zero-tariff threshold: all three are Teslas.
However, according to Kelley Blue Book’s most recent study that revealed who makes the most American cars, there are a lot of vehicles that are extremely close to also qualifying for these tariff reductions.
Tesla has three vehicles that are within five percent, while Ford, Honda, Jeep, Chevrolet, GMC, and Volkswagen have many within just ten percent of the threshold.
Tesla completely dominates Kogod School’s 2024 Made in America Auto Index
It is within reach for many.
Right now, it is easy to see why some people might think this is a benefit for Tesla and Tesla only.
But it’s not, because Tesla has its Cybertruck, Model S, and Model X just a few percentage points outside of that 85 percent cutoff. They, too, will feel the effects of the broader strategy that the Trump administration is using to prioritize domestic manufacturing and employment. More building in America means more jobs for Americans.
Credit: Tesla
However, other companies that are very close to the 85 percent cutoff are only a few components away from also saving themselves the hassle of the tariffs.
Ford has the following vehicles within just five percent of the 85 percent threshold:
- Ford Mustang GT automatic (80%)
- Ford Mustang GT 5.0 (80%)
- Ford Mustang GT Coupe Premium (80%)
Honda has several within ten percent:
- Honda Passport All-Wheel-Drive (76.5%)
- Honda Passport Trailsport (76.5)
Jeep has two cars:
- Jeep Wrangler Rubicon (76%)
- Jeep Wrangler Sahara (76%)
Volkswagen has one with the ID.4 AWD 82-kWh (75.5%). GMC has two at 75.5% with the Canyon AT4 Crew Cab 4WD and the Canyon Denali Crew Cab 4WD.
Chevrolet has several:
- Chevrolet Colorado 2.7-liter (75.5%)
- Chevrolet Colorado LT Crew Cab 2WD 2.7-liter (75.5%)
- Chevrolet Colorado Z71 Crew Cab 4WD 2.7-liter (75.5%)
These companies are close to reaching the 85% threshold, but adjustments need to be made to work toward that number.
Anything from seats to fabric to glass can be swapped out for American-made products, making these cars more domestically sourced and thus qualifying them for the zero-tariff boundary.
Frank DuBois of American University said that manufacturers like to see stability in their relationships with suppliers and major trade partners. He said that Trump’s tariff plan could cause “a period of real instability,” but it will only be temporary.
Now is the time to push American manufacturing forward, solidifying a future with more U.S.-made vehicles and creating more domestic jobs. Tesla will also need to scramble to make adjustments to its vehicles that are below 85%.
News
Tesla Cybertruck RWD production in full swing at Giga Texas
Videos of several freshly produced Cybertruck LR RWD units were shared on social media platform X.
It appears that Tesla is indeed ramping the production of the Cybertruck Long Range Rear Wheel Drive (LR RWD), the most affordable variant of the brutalist all-electric pickup truck.
Videos of several freshly produced Cybertruck LR RWD units were shared on social media platform X.
Giga Texas Footage
As per longtime Tesla watcher Joe Tegtmeyer, Giga, Texas, was a hotbed of activity when he conducted his recent drone flyover. Apart from what seemed to be Cybercab castings being gathered in the complex, a good number of Cybertruck LR RWD units could also be seen in the facility’s staging area. The Cybertruck LR RWD units are quite easy to spot since they are not equipped with the motorized tonneau cover that is standard on the Cybertruck AWD and Cyberbeast.
The presence of the Cybertruck LR RWD units in Giga Texas’ staging area suggests that Tesla is ramping the production of the base all-electric pickup truck. This bodes well for the vehicle, which is still premium priced despite missing a good number of features that are standard in the Cybertruck AWD and Cyberbeast.
Cybertruck Long Range RWD Specs
The Cybertruck LR RWD is priced at $69,990 before incentives, making it $10,000 more affordable than the Cybertruck AWD. For its price, the Cybertruck Long Range RWD offers a range of 350 miles per charge if equipped with its 18” standard Wheels. It can also add up to 147 miles of range in 15 minutes using a Tesla Supercharger.
Much of the cost-cutting measures taken by Tesla are evident in the cabin of the Cybertruck LR RWD. This could be seen in its textile seats, standard console, seven-speaker audio system with no active noise cancellation, and lack of a 9.4” second-row display. It is also missing the motorized tonneau cover, the 2x 120V and 1x 240V power outlets on the bed, and the 2x 120V power outlets in the cabin. It is also equipped with an adaptive coil spring suspension instead of the adaptive air suspension in the Cybertruck AWD and Cyberbeast.
Elon Musk is now a remote DOGE worker: White House Chief of Staff
Tariff reprieve might be ‘Tesla-friendly,’ but it’s also an encouragement to others
Tesla Cybertruck RWD production in full swing at Giga Texas
-
News1 week agoTesla’s Hollywood Diner is finally getting close to opening
-
Elon Musk2 weeks agoTesla doubles down on Robotaxi launch date, putting a big bet on its timeline
-
News6 days agoTesla is trying to make a statement with its Q2 delivery numbers
-
Investor's Corner1 week agoLIVE BLOG: Tesla (TSLA) Q1 2025 Company Update and earnings call
-
Elon Musk2 weeks agoTesla reportedly suspended Cybercab and Semi parts order amid tariff war: Reuters
-
SpaceX2 weeks agoSpaceX pitches subscription model for Trump’s Golden Dome
-
News2 weeks agoDriverless Teslas using FSD Unsupervised are starting to look common in Giga Texas
-
News3 days agoNY Democrats are taking aim at Tesla direct sales licenses in New York