Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Advertisement
-

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla Robotaxi riders will face the best dilemma when booking a ride

Published

on

Credit: Joe Tegtmeyer | X

Tesla has updated its Robotaxi app so riders can pick which vehicle they want before they book. The latest in-app screens now show two options side by side: the two-seat Cybercab and the four-seat Model Y.

A screenshot circulating Thursday shows the change in practice. In Austin, a rider could choose a gold Cybercab for two people or a Model Y for four. Tesla’s updated description calls Cybercab “our first purpose-built autonomous vehicle,” designed for safety, accessibility, and comfort, and says the lineup is available only through the Robotaxi app.

The distinction is more than cosmetic, and it’s important to note that Robotaxi refers to the platform, while Cybercab refers to a vehicle.

Advertisement
-

Model Y Robotaxis have carried the service since it opened in Austin in mid-2025 and later expanded to Dallas, Houston, and parts of Florida. Those vehicles are converted production SUVs that still have steering wheels and pedals.

Cybercab is different. It has no driver controls, butterfly doors, a low seat height meant to work with wheelchairs, extra trunk space for assistive devices, and braille on the handles. Tesla has registered dozens of the two-seaters with Texas regulators in the days leading up to its September 3 Austin event.

Giving riders a choice lets Tesla match the vehicle to the trip. Most rides involve one or two people, which is where Cybercab is meant to be cheaper and more efficient to operate. Groups of three or four, or anyone who needs more space, can still request a Model Y.

The same app handles booking, payment, cabin settings, and, on Cybercab, features such as phone-based door opening and in-cabin voice controls.

Tesla Cybercab event gains steam ahead of massive launch

The update does not mean every city suddenly has both cars available. Cybercab support is listed for Austin first, and the purpose-built fleet is still small compared with the existing Model Y roster. Even so, the app change marks a shift from a single-vehicle pilot to a mixed fleet.

Advertisement
-

Riders can now choose between the compact, purpose-built robotaxi and the familiar SUV that launched the service.

Continue Reading

News

Tesla Cybercab sightings broaden well outside of Austin with autonomy in focus

Published

on

Credit: Tesla Robotaxi | X

Tesla Cybercab sightings are broadening far and wide, well outside of downtown Austin, Texas, with autonomy in focus as the company plans to launch the all-electric, two-seater this evening in the Lone Star State.

Tesla is set to launch Cybercab to a small group of people this evening in a dedicated event in Austin, Texas. Public details on the event are relatively slim.

However, Tesla’s focus on Cybercab falls well outside of the downtown Austin area and is expanding well across the United States as things continue to move quickly with the company’s autonomous efforts in 2026. Today, various images of Cybercab fleets in interesting locations have started to circulate.

The most notable is a fleet of at least 20 Cybercabs at Miami International Airport in Florida. Spotted last night, the fleet is expansive and is indicative of a looming release of Cybercabs once regulatory boxes are checked off.

Tesla has already been operating the Robotaxi platform in Miami for several months, but this Cybercab fleet at the airport could be joining the ride-hailing platform as approvals arrive:

Another fleet of Cybercabs was spotted at the Devon, PA showroom just outside of Philadelphia. We have seen several Cybercab units testing around the Philadelphia Metro Area, which is interesting considering Tesla does not have any active Robotaxi geofence in Pennsylvania.

Philadelphia would be an ideal location to test ride-hailing due to its dense tourist population, large, sprawling city layout, and to compete with other ride-hailing companies that operate in the city.

Expansive fleets of Cybercabs will be popping up in and around major cities throughout the rest of the year, if we were betting on it. Tesla has made it obvious that the Cybercab rollout will be aggressive and fast-paced, but within reason. Tesla is still prioritizing safety, so these testing phases will likely go on for some period of time before more members of the public are able to snag a Cybercab for a personal chariot.

Advertisement
-
Continue Reading

News

Tesla Model Y L gets suspension complaints in over odd issue China

Published

on

Credit: @TeslaNewswire/X

The Tesla Model Y L is arguably the most hyped trim of the all-electric crossover, other than the Performance configuration that comes with white-knuckle speed and sports car-level handling.

However, it is not all perfect. Tesla owners in China who took delivery of the Model Y L, denoted with an L to highlight its longer wheelbase, are experiencing what they are referring to as “collapsing” of the rear wheels, as suspension issues appear to be an issue with some of the builds.

The gap between the wheel arch and tire has narrowed to the point that “not even a single finger” could fit, according to a report from Car News China. The failures are not tied to a specific mileage, as one owner said that after just 9,000 kilometers (5,600 miles), they noticed the suspension issue when their car was fully loaded.

Advertisement
-

Another one had the issue at 30,000 kilometers (18,640 miles) and noticed that the wheel gap shrank to two fingers, so not as drastic as the person who reported a similar issue at 9,000 km.

Tesla Model Y L is gaining momentum in China’s premium segment

Along with the visual recognition of the issue, others are saying the sagging is causing abnormal wear on the inside of the tires. Extra weight and instant torque already provide additional stress on the tires in electric vehicles during normal operation, so it is no surprise that this is another complaint.

There has been no recall issued by Tesla, and the company has not yet publicly acknowledged the issue.

Some are suggesting that owners use a “finger test” to self-diagnose whether there is an issue with the suspension. There should be four fingers between the tire and the wheel well; anything less than that starts to get dicey.

Advertisement
-
Continue Reading