News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Elon Musk
SpaceX Starship gets FAA nod for ninth test flight
The FAA has given the green light for Starship’s ninth test flight.
SpaceX has received FAA approval for the ninth test flight of the Starship rocket. The approval was delayed due to the federal agency finishing its comprehensive safety review of the eighth flight earlier this year.
The FAA said in a statement that it has determined that SpaceX has “satisfactorily addressed the causes of the mishap, and therefore, the Starship vehicle can return to flight.”
The eighth test flight occurred back on March 6. SpaceX completed a successful liftoff of Starship and the Super Heavy Booster, before the two entered stage separation a few minutes after launch.
Starship Flight 8: SpaceX nails Super Heavy booster catch but loses upper stage
The booster returned and was caught by the chopsticks on the launch pad, completing the second successful booster catch in the program’s history. However, SpaceX lost contact with Starship in the upper atmosphere.
The ship broke up and reentered the atmosphere over Florida and the Bahamas.
The debris situation caused the FAA to initiate a mishap investigation:
Starship Flight 8’s Ship 34 provided some beautiful fireworks in the sky during its rapid unscheduled disassembly. Beautiful but unfortunate.
Hopefully, Flight 9 would no longer have any RUD incidents. pic.twitter.com/p4qAToDXOM
— TESLARATI (@Teslarati) March 7, 2025
The FAA said it will verify that SpaceX implements all the corrective actions on Flight 9 that it discovered during the mishap investigation.
There is no current confirmed launch window, but the earliest it could take off from Starbase is Tuesday, May 27, at 6:30 p.m. local time.
To prevent any injuries and potentially limit any damage, the FAA has stayed in contact with various countries that could be impacted if another loss of vehicle occurs:
“The FAA is in close contact and collaboration with the United Kingdom, Turks & Caicos Islands, Bahamas, Mexico, and Cuba as the agency continues to monitor SpaceX’s compliance with all public safety and other regulatory requirements.”
The agency has also stated that the Aircraft Hazard Area (AHA) is approximately 1,600 nautical miles and extends eastward from the Starbase, Texas, launch site through the Straits of Florida, including the Bahamas and Turks & Caicos.
For flight 8, the AHA was just 885 nautical miles.
Hyundai announced on Thursday that it has officially launched real-world testing of its AI-powered EV charging robot, which it is referring to as the ACR.
The Korean company is partnering with both Kia and Incheon International Airport for the testing phase, which was launched with a memorandum of understanding (MOU). The pilot program is going to be used to lay the groundwork for future robot use for EV charging.
Incheon already has a reputation that aligns with the pilot program as it has the largest eco-friendly vehicle infrastructure in Korea, according to Korea JoongAng Daily, which first reported the launch of the pilot program.
Hyundai is partnering with Kia’s Robotics Lab to provide hardware and software solutions for this early rollout.
Yan Hee-won, President of Hyundai Motor’s R&D Division, said:
“This marks an important turning point in validating the practical value of future mobility technologies. With customized automatic charging solutions, we aim to deliver a more convenient and enhanced mobility experience for users.”
The testing phase will be limited in the sense that the charging robot will be deployed for a fleet of eco-friendly airport vehicles. Those who park their EVs at the airport will not be able to use it for use while they’re traveling — at least at first.
Eventually, it will become a great way to give vehicles range while the owners are off on trips.
Tesla had a similar idea several years ago, which it shared viral videos of back in 2015.
Tesla “snake charger” wasn’t just a creepy one-off, suggests Elon Musk
Musk said in 2020 that Tesla still had the intention of making it. However, it has shifted to wireless induction charging, which seems to be a better option simply because of fewer moving parts and better compatibility with the upcoming Robotaxi fleet.
Tesla flexes Robotaxi wireless charging — autonomy from top to bottom
Tesla displayed its wireless charging idea at the “We, Robot” event last year:
Robotaxi wireless charging
No hands required pic.twitter.com/XL746DkGhb
— Tesla (@Tesla) October 18, 2024
Elon Musk
How Tesla could benefit from the ‘Big Beautiful Bill’ that axes EV subsidies
Tesla has a few paths to limit damage from the elimination of tax credits.
The United States House of Representatives passed President Trump’s “Big Beautiful Bill” by a vote of 215 to 214 on Thursday, effectively bringing an end to many EV subsidy programs, like the $7,500 tax credit, by the end of this year.
The bill will not only eliminate the $7,500 credit on new EV purchases, but also the $4,000 credit given on the purchase of used electric vehicles, and a $1,000 credit on the installation of Level 2 chargers. It will also impact solar subsidies that help generate clean energy in a residential setting.
EVs would also be subject to a $250 road use fee.
🚨 The “Big Beautiful Bill” has been passed in the House, meaning:
1) The EV tax credit is in serious jeopardy. It will likely be eliminated for 2026.
2) EVs will likely have a $250 road use fee
3) $1,000 Level 2 charger credit will also be eliminated pic.twitter.com/Aad41say43— TESLARATI (@Teslarati) May 22, 2025
All of these things sound like negatives — truly because they are. Those who are not in a financial position to buy an EV this year, even with the tax credit, might not be able to afford them in the coming years either, unless manufacturers are able to bring pricing to a level that is more accessible to consumers.
In theory, President Trump’s focus on bringing manufacturing back to America would bring prices down, but it won’t happen overnight. Companies will take many years to completely bring manufacturing and part sourcing to the United States.
However, Tesla could feel some positives from this bill, and it all comes down to timing. Of course, in the long term, it wouldn’t be great for the company, especially if it did not have two things going on right now: a slightly lagging delivery pace and the introduction of affordable models.
Tax Credit Sunsetting Advantage
Sunsetting the $7,500 tax credit means one thing: those who have been in limbo over buying an EV from Tesla are going to have to make a decision on whether they want to buy this year and still have access to the credit, or test their luck and hope for price reductions.
More than likely, those who have been on the fence will be willing to pull the trigger this year, and Tesla will definitely gain some sales from this fact alone. Other automakers will, too.
This could help offset Tesla’s slow start to the year, which has been caused by the changeover of production lines of the Model Y across each of its factories globally.
Affordable Models
Tesla said earlier this year that it will roll out affordable models in the first half of 2025. These cars are expected to be around the $30,000 mark, but the company has not shed any true information on what they will cost.
Potential affordable Tesla “Model 2/Model Q” test car spotted anew in Giga Texas
Ideally, the cars would cost under $30,000 without the EV tax credit, which would be more than accessible for many car buyers in the United States.
The introduction of models that are not in need of a tax credit to be affordable to the masses. This would help offset some of the losses Tesla might feel from cars losing the tax credit.
SpaceX Starship gets FAA nod for ninth test flight
Hyundai begins real-world testing of AI-powered EV charging robot
How Tesla could benefit from the ‘Big Beautiful Bill’ that axes EV subsidies
-
News2 weeks agoTesla Cybertruck Range Extender gets canceled
-
News2 days agoTesla posts Optimus’ most impressive video demonstration yet
-
Elon Musk1 week agoTesla seems to have fixed one of Full Self-Driving’s most annoying features
-
Lifestyle2 weeks agoAnti-Elon Musk group crushes Tesla Model 3 with Sherman tank–with unexpected results
-
News2 weeks agoStarlink to launch on United Airlines planes by May 15
-
News2 weeks agoTesla Semi gets new adoptee in latest sighting
-
Elon Musk2 weeks agoBill Gates estimates DOGE cuts will cost children’s lives, Elon Musk responds
-
News2 weeks agoPotential affordable Tesla “Model 2/Model Q” test car spotted anew in Giga Texas