Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Advertisement
-

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

Elon Musk

Elon Musk’s Boring Company has big plans for Las Vegas by year’s end

Elon Musk’s Boring Company says Vegas Loop stations will double by year end once again.

Published

on

By

the boring company's vegas loop entrance

The Boring Company says the Vegas Loop’s station count will double by the end of the year, tying the target to a hiring push for drivers and operations managers in Las Vegas. “Vegas Loop is getting bigger – the station count will double by end of year!” the company wrote in a post on X, attaching listings for a Loop driver and a senior Loop operations manager.

The number checks out against what’s already public, with the Vegas Loop currently running 14 operational stations, while the Boring Company’s own project page lists 28 as the target for the end of 2026.

Much of that growth is tied to tunnels that are already built and waiting on an opening date. A roughly two-mile dual tunnel system under Paradise Road, connecting Westgate to a planned station at 4744 Paradise Road, is expected to open in stages over the coming weeks, Las Vegas Convention and Visitors Authority chief executive Steve Hill told the Review-Journal last week. New stations at 4744 Paradise, Virgin Hotels Las Vegas, and the former Gordon Biersch site would come online with it, several of them built to speed up rides to Harry Reid International Airport ahead of Formula 1’s Las Vegas Grand Prix.

Clark County entitled Vegas Loop for 123 stations after approving 19 more in August, as Teslarati reported at the time. Entitlement and construction move at different speeds on this project, so county approval alone does not guarantee a station opens on any particular schedule.

Clark County approved 18 additional stations back in 2023, part of a plan that pushed the system’s target to 69 stations across 65 miles, doubling the network on paper for the first time. The target kept climbing after that, to roughly 93 stations by the end of that year and 104 by last year, before August’s vote pushed it to 123. This week’s announcement is the first time that doubling language has been attached to stations actually running rather than stations merely approved on a county map.

Ridership gives some sense of what a denser network could carry. Boring Company executive Mike Baier said in July that the Vegas Loop already moves around 40,000 passengers on busy convention days, a total that tops most light rail systems in the country despite the system running on a fraction of its planned tunnel mileage. Company leadership has projected ridership could triple or quadruple once the airport connector tunnels fully open.

Advertisement
-

Boring Company did not say which stations beyond those already under construction would open by year end, or whether the hiring push points to a fleet expansion alongside the new stops.

Continue Reading

News

Tesla looks to expand into new Asian market, strengthening presence

Published

on

Credit: Tesla Asia | X

Tesla is looking to expand into a new Asian market, strengthening its presence in a region that has been bullish on electric vehicles as a whole.

Tesla officially filed to establish a subsidiary of its business in Vietnam, a report from Reuters suggests. Tesla named the entity “Tesla Motors Vietnam Limited Liability Company.”

The planned entrance into the Vietnamese market is a good sign and move for Tesla, as it has become one of the fastest-growing EV markets in Southeast Asia. It is already among the leaders in the region in both volume and electrification rate. In the first half of this year, Vietnam led Southeast Asia in battery-electric passenger car sales at about 116,000 units, up about 71 percent year over year.

Currently, Vietnamese EV drivers rely on VinFast’s V-Green network, which has about 150,000 ports, but these are primarily reserved for VinFast vehicles. Public third-party charging is fragmented and unreliable for those who do not own chargers that are dedicated to a certain manufacturer’s vehicles.

Tesla has had mixed results in Asia as a whole, and as China remains the core part of its story in Asia, the company is evidently working on expanding its footprint on the continent. Tesla’s domestic retail deliveries fell about 12 percent year over year through the first eight months of 2026.

Model Y remains a standout individual product, holding its position as one of, if not the, best-selling vehicles in the world. However, Model 3 has been weaker than it has been in past years.

Advertisement
-

Gigafactory Shanghai, the company’s Chinese production facility, still performs very well. Wholesale volumes in terms of exports have more than doubled and now exceed domestic retail sales; Giga Shanghai builds vehicles for Europe, South Korea, Japan, Australia, and other markets. South Korea has been an explicit bright spot, with registrations doubling year-to-date and Tesla frequently appearing as the top imported brand.

Tesla just did something in South Korea that no foreign carmaker has ever done

Tesla’s entrance into Vietnam signals a broader effort to take over the Asian market and grab more market share from rivals.

Continue Reading

Elon Musk

Elon Musk’s companies made up with Apple but OpenAI still on the hook

Elon Musk’s X Corp and SpaceXAI dropped their Apple antitrust suit, leaving OpenAI as defendant.

Published

on

By

X Corp and SpaceXAI, Elon Musk’s social platform and AI venture, have dropped Apple from the antitrust lawsuit that they filed against the iPhone maker and OpenAI last year. In a filing in the U.S. District Court for the Northern District of Texas, attorneys for X and SpaceXAI moved to dismiss the Apple portion of the case, first reported by Reuters. The filing does not explain why the companies are dropping Apple or say whether a settlement was reached.

X and SpaceXAI say they intend to keep pursuing the case against OpenAI, which remains a defendant. That resolves the dispute with one company while leaving the core allegation intact against the other, with no public accounting of what changed in between.

The lawsuit dates to August 2025, when xAI and X sued Apple and OpenAI, arguing that Apple’s decision to make ChatGPT the only generative AI chatbot built into iOS gave OpenAI an unfair structural advantage. The complaint claimed ChatGPT controlled roughly 80 percent of the chatbot market at the time, while Grok held only a few percent. It sought billions of dollars in damages and asked the court to unwind the arrangement.

Elon Musk’s xAI and X file antitrust suit against Apple and OpenAI over AI exclusivity

The filing followed weeks of Musk publicly complaining that Grok and X weren’t appearing in Apple’s “Must Have” App Store section, though Grok ranked second in the Productivity category and X ranked first in News at the time. He accused Apple of “playing politics” and warned of immediate legal action before following through days later.

Apple and OpenAI tried to get the case thrown out, but a federal judge denied both motions in November, ruling the dispute was better suited to summary judgment than an early dismissal. That decision sent the case into discovery, which is presumably what led to Monday’s filing.

Advertisement
-

The timing is notable given how Musk’s sentiment toward Apple has shifted, with Musk noting that he was open to letting Grok power a revamped Siri after a user suggested Apple replace its aging assistant with xAI’s model.

xAI, the AI venture Musk folded into X Corp last year, has since combined with SpaceX under the SpaceXAI brand. That structure now puts X, Grok and SpaceX’s rocket and satellite businesses under one roof as Musk pushes his AI ambitions beyond chatbots.

OpenAI remains the sole defendant going forward, and Musk’s companies have not said if there’s any changes to those original claims. Apple and OpenAI did not immediately respond to requests for comment on the filing.

Advertisement
-
Continue Reading