News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Elon Musk
Elon Musk’s next Uranium in Uranus merch is Boring Company’s weirdest tease yet
Elon Musk teased a glowing new Boring Company merch idea, complete with a Geiger counter.
Elon Musk teased the next piece of Boring Company merchandise on X Saturday, and it is exactly as unserious as fans of the company’s product history have come to expect. “The next @boringcompany merch will put Uranium in Uranus,” Musk wrote in a thread posted early Saturday morning. He followed up by explaining that the item would glow in the dark, “because otherwise how could you find it,” and that a Geiger counter would be sold separately as “an optional strap-on.”
Musk closed the thread with a line that doubles as a mission statement for the tunneling company’s merchandise arm: “It’s not easy coming up with something that is both outrageously unsellable and yet extremely popular.”
The Boring Company has built a small but consistent side business out of novelty items that start as jokes and end up selling out. The company’s Not-a-Flamethrower raised roughly $10 million in a few days back in 2018, moving all 20,000 units it produced. Its Burnt Hair perfume, priced around $100 a bottle, sold out fast enough that scalpers were flipping units on eBay for ten times the retail price. Boring Bricks, made from tunneling spoil, followed the same playbook of teasing a product on X months before it became real.
Musk has not said what the actual item will be, only that it involves uranium and glows in the dark. Given the pattern, that vagueness is probably intentional. Past merch announcements have started as one-line jokes and taken weeks or months to turn into an actual product listing on the company’s site, and there is no guarantee this one follows through at all.
The timing lines up with a period of real momentum for the Boring Company outside of the joke merchandise. The company said last week it plans to double the number of operational stations on its Vegas Loop by the end of the year, a target tied to a hiring push for drivers and operations managers. Prufrock-5, one of the company’s tunnel boring machines, also just wrapped a test tunnel in Bastrop, Texas, and is expected to relaunch on its next assignment in November.
Whether the uranium joke turns into an actual product remains to be seen. Musk’s post did not include a price, a shipping date, or even a name for the item, which has historically meant a Boring Company website page goes up quietly, password protected, sometime before an announcement.
News
NASA taps SpaceX for more astronaut missions as Boeing Starliner remains grounded
NASA just gave SpaceX a $946 million contract for three more astronaut missions through 2030.
NASA has awarded SpaceX a $946 million contract modification covering three more astronaut missions to the International Space Station, according to an announcement the agency published Friday. The award adds Crew-15, Crew-16, and Crew-17 to SpaceX’s existing Commercial Crew Transportation Capability contract, bringing the agreement’s total value to $5.92 billion across 17 flights.
SpaceX confirmed the award on X, writing that it was excited for Falcon 9 and Dragon to launch NASA’s Crew-15, 16, and 17 missions to the Space Station from Florida. The new missions cover ground, launch, in orbit, and return operations, along with cargo transport and a lifeboat capability while docked at the station, and the period of performance runs through 2030.
We’re excited for Falcon 9 and Dragon to launch @NASA’s Crew-15, 16, and 17 missions to the @Space_Station from Florida https://t.co/Qm16vVK9F3 pic.twitter.com/drg3s7GtuM
— SpaceX (@SpaceX) September 18, 2026
The award follows a notice of intent NASA issued in May, when the agency first signaled it would purchase up to six additional post certification missions from SpaceX. Teslarati covered that filing at the time, noting NASA cited technical issues and schedule delays encountered by Boeing as a driving factor. Friday’s contract modification locks in three of those six missions, with the remaining three left open for NASA to award later, potentially to Boeing if Starliner clears certification.
Boeing’s CST-100 Starliner has still not flown an operational crew rotation mission for NASA. The spacecraft’s most recent crewed test flight in 2024 ended without the astronauts returning aboard Starliner, and the company has spent the time since working through thruster problems. SpaceX President Gwynne Shotwell said this week that SpaceX is not retiring Crew Dragon today, for sure, while stopping short of committing to fly it past 2030.
Crew-12 is currently docked at the space station, and NASA has said Crew-13 is targeting a launch in the coming weeks. The newly awarded Crew-15 through Crew-17 missions extend SpaceX’s role as NASA’s primary way of getting astronauts to and from orbit well into the back half of the decade, regardless of what happens with Starliner or Starship in the meantime.
Investor's Corner
New drone video shows Tesla’s Optimus Factory reaching a turning point
New drone footage shows Tesla’s dedicated Optimus factory steel frame nearing completion at Giga Texas.
Tesla’s dedicated Optimus factory at Gigafactory Texas is closing in on a finished steel frame, according to drone footage posted Thursday afternoon by longtime site observer Joe Tegtmeyer. In the video, Tegtmeyer said structural steel assembly is now about five column grids away from reaching the building’s north perimeter beam, putting the primary skeleton in its final stretch roughly six months after Tesla broke ground on the North Campus site in late March.
The Giga Texas Optimus Factory latest update … construction keeps moving fast!
Steel assembly is now only about 5 column grids from the north perimeter beam. Concrete is going in on the three upper floors, rebar is still being laid for more pours, and footing / grade-beam work… pic.twitter.com/qvFPvwnYzW
— Joe Tegtmeyer 🚀 🤠🛸😎 (@JoeTegtmeyer) September 17, 2026
Tegtmeyer’s footage shows concrete already going in on three upper floors while crews continue laying rebar and pouring grade beam footings at ground level. That kind of parallel work, steel rising at one end of the site while concrete sets at the other, is a scheduling approach Tesla used at the original Giga Texas building and appears to be repeating here to save time before the plant’s targeted 2027 production start.
Teslarati has tracked the building’s progress since Tesla confirmed construction was officially underway in May, when the first steel structure went up on what was then bare, reclaimed land. The facility is part of a more than 5.2 million square foot expansion of Giga Texas’s North Campus that Tesla has said will eventually run nearly the length of the existing vehicle factory, over 4,000 feet, while sitting somewhat narrower. Musk has pegged the long term output target at 10 million Optimus units a year once the line is running at full capacity, a volume that would dwarf the one million unit pilot line Tesla is standing up separately at its Fremont, California factory.
Tesla Giga Texas to feature massive Optimus V4 production line
The Texas facility sits alongside another major buildout on the same campus. Terafab, the joint Tesla and SpaceX chip fabrication plant that will eventually supply the silicon running Optimus units in the field. Housing robot assembly and chip production on the same grounds is a deliberate supply chain decision, cutting down on the shipping and lead time that would otherwise sit between the two.
Tesla has not given an updated timeline beyond its previously stated goal of bringing high volume Optimus production online at the site in the summer of 2027. Fremont’s smaller pilot line began mass producing the current Gen 3 robot in January, with that plant expected to build tens of thousands of units this year primarily to generate the real world data Tesla needs to refine the robot’s software before Giga Texas ramps up. Six months of visible construction progress, tracked almost entirely through Tegtmeyer’s recurring drone flights, gives the clearest outside look yet at how seriously Tesla is treating that 2027 deadline.
Elon Musk’s next Uranium in Uranus merch is Boring Company’s weirdest tease yet
NASA taps SpaceX for more astronaut missions as Boeing Starliner remains grounded
