News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
In the world of autonomous ride-hailing, there are only a handful of names. Among those few companies lies a strategy play by each to keep the opposition on their toes. Tesla, on the other hand, already tipped its hand at where it is headed next.
Tesla has signaled its next major push in the autonomous ride-hailing market by filing for an Autonomous Vehicle Network Company permit in Nevada (Docket 26-05015). Through Tesla Robotaxi, LLC, the company seeks approval to operate up to 5,000 robotaxis in Clark County, including high-traffic areas like Las Vegas and Henderson airports, within the first 12 months of launch.
This filing builds on Tesla’s earlier testing approvals from the Nevada DMV in September 2025 and preparations such as maintenance hubs in the Las Vegas area. Nevada represents a strategic expansion into a major tourist destination, where high visitor volumes could drive strong utilization and showcase the reliability of unsupervised autonomy to a broad audience.
We’d have to assume this means Tesla is targeting Las Vegas, and it’s a great move from a business perspective.
Vegas is such a melting pot of people from all around the country and the world. It will expose people from all corners of the globe to Tesla’s autonomy capabilities https://t.co/Qz3fQmhULF pic.twitter.com/Du5pj2RyWC
— TESLARATI (@Teslarati) June 6, 2026
Approval would mark a significant step toward commercial operations in a new state, following progress in Texas.
Tesla’s shareholder decks and earnings calls have clearly outlined these ambitions. In the Q4 2025 shareholder deck, the company listed planned Robotaxi coverage for the first half of 2026, explicitly naming Las Vegas alongside Phoenix, Miami, Orlando, and Tampa, with Dallas and Houston already advancing. Austin was noted as “ramping unsupervised,” while the Bay Area remained in safety-driver mode.
By Q1 2026, the deck updated statuses to reflect launches in Dallas and Houston, with “preparations underway” for the remaining cities, including Las Vegas. Paid Robotaxi miles nearly doubled sequentially in Q1, underscoring momentum even as broader timelines adjusted slightly for regulatory and operational readiness.
On earnings calls, CEO Elon Musk and executives have emphasized a phased rollout prioritizing safety. Unsupervised operations in Texas have shown strong results with no reported accidents or injuries in the program. Tesla continues groundwork in additional major U.S. metros through testing and permitting, positioning it to scale quickly once approvals clear.
This Nevada move aligns with Tesla’s vision of transforming from an EV maker into an AI and robotics leader. The forthcoming Cybercab, which started production at Giga Texas in April, is expected to eventually dominate the fleet, replacing many Model Y vehicles and driving down costs to enable affordable rides.
For investors and the industry, this signals Tesla’s intent to dominate key Sun Belt and tourist markets where weather, regulations, and demand favor rapid scaling. Success in Las Vegas could validate the model for denser urban and high-tourism environments, accelerating the shift toward a future where robotaxis generate meaningful revenue.
Las Vegas will also expand knowledge among the general public at Tesla’s capabilities, helping people experience driverless ride-hailing from several companies during their time on The Strip.
The Tesla Model 3’s cheapest trim level just got a major accolade, as Edmunds just revealed the Rear-Wheel-Drive trim of the all-electric sedan is the most efficient EV that is currently in production.
The 2026 Tesla Model 3 Rear-Wheel-Drive not only beat its EPA-estimated range by 30 miles, but it also bested its efficiency mark by 13.2 percent. The Model 3 tested by Edmunds traveled 393 miles, beating its EPA rating by 8.3 percent, while it returned 21.7 kWh per 100 miles, or 4.61 mi/kWh.
Beating those two metrics is especially pertinent when it comes to EV ownership and driving down the cost of ownership from ICE counterparts across the board. The real money savings come from driving down the cost of driving per mile, especially when it comes to high-mileage driving.
Edmunds stated in its report and review that the process it uses to test EV efficiency is aimed at giving “the most accurate representation of a car’s real-world range.” The assessment uses a strict route that features 60 percent city and 40 percent highway driving, and an average speed of 40 MPH across the trip.
It also drives each car within 5 MPH of all posted speed limits, and the climate control is set on Auto at 72 degrees to ensure even testing. In other words, Edmunds does not use methods to maximize efficiency, and instead tries to make it reasonable to achieve the same ratings yourself.
In comparison to other EVs, it beat the 2026 Mercedes-Benz CLA 350, which went 385 miles, as well as the 2026 Audi A6 Sportback E-tron Prestige AWD, which traveled 392 miles. Only the Mercedes-Benz CLA 250+ traveled farther, making it an impressive 434 miles on a charge.
However, the Tesla Model 3 RWD’s efficiency is “unmatched” because of its incredibly low energy usage per mile.
🚨 Tesla Model 3 RWD:
-At $36,990, it is $9,000 cheaper than the average transaction price for a new car ($46,023 via KBB)
-Was 13.2% more efficient than its EPA estimate
-Traveled 393 miles on a charge despite its 363-mile EPA range https://t.co/Grov2hXqpa pic.twitter.com/Zl8rnZZLIB
— TESLARATI (@Teslarati) June 8, 2026
The Model 3 Rear-Wheel-Drive might be the best bang-for-your-buck EV if you’re looking to buy new and want access to features like Full Self-Driving, while also being aware of efficiency. This trim of the Model 3 is also priced over $9,000 cheaper than what Kelley Blue Book says the average transactional price for a new car was in May 2026, which sits at $46,023.
If you’re looking for something with more speed, an All-Wheel-Drive drivetrain, or more premium features, the Premium trims of the Model 3 currently come with one year of Free Supercharging.
The Ontario Teachers’ Pension Plan (OTPP) stands to reap one of the most extraordinary returns in pension fund history thanks to a bold 2019 investment in SpaceX.
According to a recent report from The Globe and Mail, the Toronto-based fund invested roughly $300 million CAD (~$220 million USD at the time) in Elon Musk’s space company as its inaugural deal through the Teachers’ Innovation Platform.
At SpaceX’s anticipated $1.75 trillion IPO valuation, set for a mid-June debut on Nasdaq under ticker $SPCX, that stake could now be worth up to $11.6 billion USD. This would represent a roughly 50x return and easily become OTPP’s most successful single investment ever.
The fund manages $279 billion in assets for approximately 346,000 working and retired teachers in Ontario, potentially delivering an average boost of around $33,500 per member if fully realized.
SpaceX has filed its S-1 and plans to price shares at $135 each, aiming to raise a record $75 billion in what would be the largest IPO in history, surpassing Saudi Aramco. The company reported $18.67 billion in revenue for 2025, driven primarily by Starlink satellite internet growth and NASA contracts, though it continues to post significant losses tied to ambitious R&D in Starship and AI initiatives.
Important pieces moving forward include:
- Starlink Expansion: The satellite broadband service is scaling rapidly, targeting global connectivity, especially in underserved rural and remote areas. This segment offers massive recurring revenue potential as numbers climb.
- Starship and Reusability Leadership: SpaceX’s fully reusable Starship aims to slash launch costs dramatically, enabling frequent missions, Mars ambitions, and lucrative government/defense contracts. Success here could unlock exponential growth.
- AI and Diversification: Recent moves, including ties to xAI, position SpaceX in high-growth AI infrastructure, broadening beyond traditional aerospace.
- Validation Scrutiny: While the $1.75 trillion target excites investors, analysts like Morningstar value the company closer to $780 billion, citing high multiples (around 90x trailing revenue) and execution risks. A 180-day lockup period will prevent early investors like OTPP from selling immediately post-IPO.
The irony has not been lost on observers. Ontario’s government previously canceled a Starlink rural internet contract amid political tensions involving Musk, yet the pension fund’s savvy investment, made when SpaceX was valued around $33-36 billion, and Starlink was nascent, delivers outsized gains independent of politics.
For OTPP, this windfall strengthens its already solid 111 percent funding ratio and underscores the value of patient, innovation-focused capital allocation.
For SpaceX, the IPO marks a new chapter: greater transparency, access to public markets for talent retention and growth capital, and heightened pressure to deliver on its multi-planetary vision.
All eyes are fixed on whether SpaceX can justify its lofty valuation through sustained execution. For Ontario teachers, the returns are already stellar, but SpaceX, like other Musk companies in the past, has plenty of things to prove. Perhaps the most ideal person for the job is at the helm, hoping to bring the company to a massive valuation.
Tesla tipped its hand at where Robotaxi is heading next
Tesla Model 3’s cheapest trim just got a major accolade
