News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Tesla analyst Gary Black of The Future Fund claims that the company is making a big mistake getting rid of the Model S and Model X. Instead, he believes another vehicle within the company’s lineup should be discontinued: the Cybertruck.
Black divested The Future Fund from all Tesla holdings last year, but he still covers the stock as an analyst as it falls in the technology and autonomy sectors, which he covers.
In a new comment on Thursday, Black said the Cybertruck should be the vehicle Tesla gets rid of due to the negatives it has drawn to the company.
The Cybertruck is also selling in an underwhelming fashion considering the production capacity Tesla has set aside for it. It’s worth noting it is still the best-selling electric pickup on the market, and it has outlasted other EV truck projects as other manufacturers are receding their efforts.
Black said:
“IMHO it’s a mistake to keep Tesla Cybertruck which has negative brand equity and sold 10,000 units last year, and discontinue S/X which have strong repeat brand loyalty and together sold 30K units and are highly profitable. Why not discontinue CT and covert S/X to be fully autonomous?”
IMHO it’s a mistake to keep $TSLA Cybertruck which has negative brand equity and sold 10,000 units last year, and discontinue S/X which have strong repeat brand loyalty and together sold 30K units and are highly profitable. Why not discontinue CT and covert S/X to be fully…
— Gary Black (@garyblack00) January 29, 2026
On Wednesday, CEO Elon Musk confirmed that Tesla planned to transition Model S and Model X production lines at the Fremont Factory to handle manufacturing efforts of the Optimus Gen 3 robot.
Musk said that it was time to wind down the S and X programs “with an honorable discharge,” also noting that the two cars are not major contributors to Tesla’s mission any longer, as its automotive division is more focused on autonomy, which will be handled by Model 3, Model Y, and Cybercab.
Tesla begins Cybertruck deliveries in a new region for the first time
The news has drawn conflicting perspectives, with many Tesla fans upset about the decision, especially as it ends the production of the largest car in the company’s lineup. Tesla’s focus is on smaller ride-sharing vehicles, especially as the vast majority of rides consist of two or fewer passengers.
The S and X do not fit in these plans.
Nevertheless, the Cybertruck fits in Tesla’s future plans. Musk said the pickup will be needed for the transportation of local goods. Musk also said Cybertruck would be transitioned to an autonomous line.
In a groundbreaking new report from Reuters, SpaceX is reportedly discussing merger possibilities with xAI ahead of the space exploration company’s plans to IPO later this year, in what would be a blockbuster move.
The outlet said it would combine rockets and Starlink satellites, as well as the X social media platform and AI project Grok under one roof. The report cites “a person briefed on the matter and two recent company filings seen by Reuters.”
Musk, nor SpaceX or xAI, have commented on the report, so, as of now, it is unconfirmed.
With that being said, the proposed merger would bring shares of xAI in exchange for shares of SpaceX. Both companies were registered in Nevada to expedite the transaction, according to the report.
On January 21, both entities were registered in Nevada. The report continues:
“One of them, a limited liability company, lists SpaceX and Bret Johnsen, the company’s chief financial officer, as managing members, while the other lists Johnsen as the company’s only officer, the filings show.”
The source also stated that some xAI executives could be given the option to receive cash in lieu of SpaceX stock. No agreement has been reached, nothing has been signed, and the timing and structure, as well as other important details, have not been finalized.
SpaceX is valued at $800 billion and is the most valuable privately held company, while xAI is valued at $230 billion as of November. SpaceX could be going public later this year, as Musk has said as recently as December that the company would offer its stock publicly.
The plans could help move along plans for large-scale data centers in space, something Musk has discussed on several occasions over the past few months.
At the World Economic Forum last week, Musk said:
“It’s a no-brainer for building solar-powered AI data centers in space, because as I mentioned, it’s also very cold in space. The net effect is that the lowest cost place to put AI will be space and that will be true within two to three years, three at the latest.”
He also said on X that “the most important thing in the next 3-4 years is data centers in space.”
If the report is true and the two companies end up coming together, it would not be the first time Musk’s companies have ended up coming together. He used Tesla stock to purchase SolarCity back in 2016. Last year, X became part of xAI in a share swap.
Tesla has announced it has hit a major milestone with Full Self-Driving subscriptions, shortly after it said it would exclusively offer the suite without the option to purchase it outright.
Tesla announced on Wednesday during its Q4 Earnings Call for 2025 that it had officially eclipsed the one million subscription mark for its Full Self-Driving suite. This represented a 38 percent increase year-over-year.
This is up from the roughly 800,000 active subscriptions it reported last year. The company has seen significant increases in FSD adoption over the past few years, as in 2021, it reported just 400,000. In 2022, it was up to 500,000 and, one year later, it had eclipsed 600,000.
NEWS: For the first time, Tesla has revealed how many people are subscribed or have purchased FSD (Supervised).
Active FSD Subscriptions:
• 2025: 1.1 million
• 2024: 800K
• 2023: 600K
• 2022: 500K
• 2021: 400K pic.twitter.com/KVtnyANWcs— Sawyer Merritt (@SawyerMerritt) January 28, 2026
In mid-January, CEO Elon Musk announced that the company would transition away from giving the option to purchase the Full Self-Driving suite outright, opting for the subscription program exclusively.
Musk said on X:
“Tesla will stop selling FSD after Feb 14. FSD will only be available as a monthly subscription thereafter.”
The move intends to streamline the Full Self-Driving purchase option, and gives Tesla more control over its revenue, and closes off the ability to buy it outright for a bargain when Musk has said its value could be close to $100,000 when it reaches full autonomy.
It also caters to Musk’s newest compensation package. One tranche requires Tesla to achieve 10 million active FSD subscriptions, and now that it has reached one million, it is already seeing some growth.
The strategy that Tesla will use to achieve this lofty goal is still under wraps. The most ideal solution would be to offer a less expensive version of the suite, which is not likely considering the company is increasing its capabilities, and it is becoming more robust.
Tesla is shifting FSD to a subscription-only model, confirms Elon Musk
Currently, Tesla’s FSD subscription price is $99 per month, but Musk said this price will increase, which seems counterintuitive to its goal of increasing the take rate. With that being said, it will be interesting to see what Tesla does to navigate growth while offering a robust FSD suite.
Tesla analyst claims another vehicle, not Model S and X, should be discontinued
SpaceX reportedly discussing merger with xAI ahead of blockbuster IPO
