News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Lifestyle
Tesla teases “Halloween Mode” update with Optimus rising from a graveyard
Tesla’s Halloween teaser hides a covered vehicle and an Optimus hand rising from the ground.
Tesla has started teasing a Halloween software update for its vehicles, with a short clip on X that reads, “Halloween is coming.” The clip opens on a glowing pumpkin before pulling back to the car’s center touchscreen, where the usual parked visualization has been replaced by a graveyard scene, and the vehicle draped with a white sheet so it reads as a cartoon ghost.
Halloween is coming pic.twitter.com/lM3ASUeOqX
— Tesla (@Tesla) October 1, 2026
The second detail is a robotic hand clawing its way out of the dirt like a zombie, which looks to be the hand of Tesla’s latest Optimus V3 humanoid robot. While Tesla still has not formally shown Optimus Gen 3 walking around in service, renders pulled from Tesla’s Android app last month gave the clearest look yet, including far more refined hands that Tesla has said carry 22 degrees of freedom. The hand has been the hardest part of the program. Musk has called it the majority of the robot’s engineering difficulty, and Tesla’s patents describe a design driven by tendons with the actuators moved into the forearm.
Tesla Optimus V3 hand and arm details revealed in new patents
Optimus also has a Halloween track record. Last October the robot handed out candy in Times Square, and a costumed “zombie” Optimus shuffled around the Tesla Diner in Los Angeles on Halloween night.
On the software side, Tesla’s 2025 Holiday Update expanded Santa Mode with a Santa sleigh, snowmen, snow effects, and a festive lock chime, so it wouldn’t be too far fetched if we saw something similar but themed for a Halloween Mode.
Tesla Full Self-Driving is set to receive improvements to address its two biggest issues, according to a company engineer.
Director of Engineering at Tesla AI, Phil Duan, revealed in a post on X that improvements to both pothole avoidance and navigation “are coming,’ something we have heard many times in the past. However, there are a few things that seem to hint that things might be different this time around.
Improvements on both are coming.
— Phil Duan (@pduan) October 1, 2026
Pothole avoidance, navigation, speed control, and left lane camping are some of the most prevalent and frequently mentioned shortcomings of the Full Self-Driving suite. These are a few of the biggest issues that have kept Tesla Full Self-Driving as a Supervised suite, meaning drivers must remain attentive during operation.
Pothole Avoidance
Pothole avoidance was first mentioned as an “Upcoming Improvement” with the Tesla Full Self-Driving v14.3 update back in early April of this year. It was listed alongside “Expand reasoning to all behaviors beyond destination handling.”
It’s been six months since we first saw pothole avoidance explicitly mentioned, and it has not moved beyond that and joined the main release notes yet.
Tesla has not shed any light on why pothole avoidance has been such an issue for it to solve, but it also has issues identifying large bumps much of the time, so its modeling of sudden changes in road conditions is likely pretty weak at this particular point. I’ve had more issues with large bumps than potholes, personally, but both are issues that need to be resolved.
This is that big bounce that I mentioned in the quoted post.
It’s just a tad too drastic to take at the speed FSD wants to go over it. You can see me quickly swipe down into Sloth, but I intervened. https://t.co/K20PK9ysBg pic.twitter.com/81Oc82ZJcZ
— TESLARATI (@Teslarati) August 2, 2026
It makes sense that things might be pretty close to being released to the public, as we are going on such an extensive period of time between it being mentioned and it actually being deployed.
Navigation
Navigation is likely the most painful part of using Full Self-Driving, as it routinely takes strange routes, has trouble with local rules (like Except Right Turn Stop Signs in Pennsylvania), and sometimes does not realize that maneuvers it is suggesting are against the law. Turning out of my neighborhood, you cannot turn left, yet my Model Y still suggests it roughly 70 percent of the time when I’m leaving.
However, Tesla might be close to a breakthrough on this. With the Summer Update, Tesla added “Preferred Routes” alongside “Automatic Navigation.”
Preferred Routes prioritized roads that the driver had actually taken before, instead of always defaulting to what the vehicle believes is the most efficient path. This has already solved many of my issues. Formerly, I would turn off the Online Routing setting, and that would eliminate most of my complaints with routing, but then you lose out later on the Live Traffic Visualization.
Tesla’s Navigation has improved tremendously thanks to the Preferred Routes release with the Summer Update, but it still could use some polishing, as it still suggests strange routes from time to time, and it also has a lot of issues getting out of a parking lot. I find that those truly confuse FSD sometimes.
News
SpaceX’s midnight spy satellite launch quietly set a new record
Falcon Heavy launched its first NRO mission while SpaceX landed four boosters in one day.
SpaceX closed out one of its busiest days ever with a midnight Falcon Heavy launch from Florida, and the rocket’s two side boosters came home to finish off a landing record the company had never set before.
Falcon Heavy lifted off from Launch Complex 39A at NASA’s Kennedy Space Center at 11:54 p.m. ET Thursday carrying NROL-97, a classified payload for the National Reconnaissance Office. It was the first time the NRO has flown on Falcon Heavy after 22 missions on Falcon 9, and the first NRO mission bought through the National Security Space Launch Phase 3 Lane 2 contract awarded in 2025, according to Spaceflight Now.
Falcon Heavy lifts off from pad 39A in Florida for the 14th time! pic.twitter.com/uuZLKNTdD7
— SpaceX (@SpaceX) October 2, 2026
Roughly eight minutes after liftoff, side boosters B1104 and B1072 touched down at Landing Zones 1 and 2 at Cape Canaveral Space Force Station, setting off double sonic booms across Brevard County. B1104 was flying for the second time and B1072 for the fourth. Both last flew on August 30 on NASA’s Nancy Grace Roman Space Telescope, making NROL-97 the quickest turnaround between Falcon Heavy missions to date. The brand new center core, B1106, was expended in the Atlantic so the payload could reach its high energy orbit, and SpaceX’s mission page noted the fairing had previously flown on the NROL-95 mission in July.
The two landings capped a record for SpaceX. Earlier Thursday, Falcon 9 booster B1101 returned to Landing Zone 40 after sending the Crew-13 astronauts to the International Space Station, and another Falcon 9 launched the Transporter-18 rideshare with 130 payloads from Vandenberg Space Force Base in California. Spaceflight Now reported it was the first time SpaceX has landed four boosters in a single day, wrapping up the triple header Teslarati previewed on Wednesday.
Falcon Heavy’s side boosters land on LZ-1 and LZ-2 pic.twitter.com/dBPcNeggFx
— SpaceX (@SpaceX) October 2, 2026
The mission also brought Landing Zone 1 back for what may be its final landing. SpaceX first landed an orbital class booster there in December 2015, but its lease on the former Launch Complex 13 site ended in 2025 as the company moved Florida landings to new pads at its own launch complexes. With LZ-40 already holding the Crew-13 booster, SpaceX brought LZ-1 back into service for one more night. Launch tracker Next Spaceflight listed NROL-97 as the final expected landing at the site.
NROL-97 adds to a fast growing stack of national security work for SpaceX. The company has flown four Space Force missions from Vandenberg since mid August, several believed to carry Starshield satellites, pushing its Pentagon contract total for 2026 past $8 billion. Elon Musk was also named this week to help lead the Pentagon’s Project Meridian study on the future of warfare.
The Florida doubleheader stood out for another reason. The Space Coast saw only one launch in all of September as SpaceX shifts more of its East Coast infrastructure toward Starship, which reached orbit for the first time on Flight 14 just three days earlier.
Tesla teases “Halloween Mode” update with Optimus rising from a graveyard
Tesla says fixes on Full Self-Driving’s two biggest issues are on the way
