Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

Advertisement

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Advertisement

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla launches new color from Gigafactory Berlin

Published

on

Credit: Tesla

Tesla has launched a new color at Gigafactory Berlin in Germany, home of the company’s “world-class paint shop,” as Elon Musk once called it.

Bringing a new color to Tesla’s Model Y, there are now five available colors for those who will receive a vehicle from Gigafactory Berlin, with four of them being colors offered in other markets.

However, there is now one distinct color that is only available in Germany: Marine Blue.

Priced at €1,300, Marine Blue will cost the same as both Diamond Black and Stealth Grey, while Quicksilver and Ultra Red are available for double the price.

It is the third shade of blue Tesla offers across its lineup, as Deep Metallic Blue and Glacier Blue are also offered, but in other markets.

Tesla has routinely flexed Giga Berlin for having the most advanced paint shop throughout its factories, and it has produced some interesting colors over the past few years, some of which were truly awesome.

Tesla Giga Berlin is getting a world-class paint shop, new color ‘layers’ to come

Advertisement

In 2020, Musk said, “Giga Berlin will have the world’s most advanced paint shop, with more layers of stunning colors that subtly change with curvature.”

He also detailed the company’s plans to upgrade the Fremont and Shanghai paint shops. Gigafactory Texas was not yet unveiled. Tesla has worked to improve those facilities, especially in Fremont.

It was able to roll out the new Diamond Black color earlier this year.

However, Giga Berlin seems to remain the standard in terms of paint for Tesla. It routinely offers new colors.

For example, back in 2022, Tesla rolled out its familiar Quicksilver color for the Model Y, while also introducing Midnight Cherry Red, a color close to burgundy. However, the company chose to discontinue the color after determining internally that customers no longer wanted to buy it.

Advertisement

Midnight Cherry Red was removed as an option earlier this year, likely to make way for the development of the new Marine Blue.

Continue Reading

News

Tesla Autopilot visualization gets big upgrade with tons of new additions

The AP visualization shows up on the center touchscreen and illustrates the surroundings of the cars. It has gotten better in recent years, as it is able to outline types of vehicles, pedestrians, animals, and more.

Published

on

Credit: @greentheonly | X

Tesla’s Autopilot visualization just got a big upgrade as the company added tons of new additions to what it will be able to render in terms of a vehicle’s surroundings.

The AP visualization shows up on the center touchscreen and illustrates the surroundings of the cars. It has gotten better in recent years, as it is able to outline types of vehicles, pedestrians, animals, and more.

Tesla just fixed a four-year-old bug with Full Self-Driving visualization

However, it still does not have every single application, and acquiring them will take some time. If an object or vehicle is visible to the vehicle but an accurate render is not available, the car will instead pick whatever is closest.

For example, I passed an Amish family yesterday in Lancaster, PA, and instead of illustrating the horse and carriage, it simply showed a small box truck.

Advertisement

In an effort to make the Autopilot and Full Self-Driving suites more robust and accurate, Tesla has added a substantial amount of vehicle renders, which will become available in the coming weeks.

The visualizations were found by Tesla hacker @greentheonly, who posted them on X.

The new visualization renders are:

  • Ambulance
  • Firetruck
  • Garbage Truck
  • Schoolbus
  • European Semi Truck
  • Golf Cart
  • Person on a Scooter
  • Person on a Skateboard
  • Stroller
  • Street Sweeper
  • Three-Wheeler
  • Trailer
  • Train
  • Tram
  • Person in a Wheelchair

Here is an image with all of the Autopilot visualization renders:

Credit: Green

The visualization is a crucial part of manual operation and can be considered a distinct advantage that Tesla has over other companies.

It continues to be an effort that Tesla invests heavily in, as it keeps refining the suite and making it more robust with additional visualizations and animations.

Recently, it was revealed that Tesla is planning to utilize Unreal Engine for driver visualization to create a realistic depiction of the vehicle’s environment. Tesla has not yet confirmed this, but coding found with the Model S and Model X showed it could be coming in the near future.

Advertisement
Continue Reading

News

Tesla dominates best-selling EVs in Q3, but there’s one disappointment

Published

on

(Credit: Tesla)

Tesla dominated the sales figures for electric vehicles in the third quarter in the United States, but there was one disappointment: the Cybertruck.

As a whole, the EV industry benefitted from the loss of the $7,500 EV tax credit in Q3, which was something many expected. As the credit expired, consumers rushed to showrooms to take the credit and remove $7,500 from the purchase price of their new vehicle.

Will Tesla thrive without the EV tax credit? Five reasons why they might

It was a very interesting time for many companies as they scrambled to figure out how to push as many vehicles out the door as they could in preparation for the tax credit’s removal. In typical fashion, Tesla was able to top every manufacturer and secure a dominating portion of the overall market in Q3.

However, some other OEMs pulled out some surprises, including Chevrolet, Honda, and Ford, which managed to get two vehicles in the top 10, as many as Tesla.

Advertisement

Cox Automotive compiled the data in its Q3 Electric Vehicle Sales Report:

  1. Tesla Model Y – 114,897
  2. Tesla Model 3 – 53,857
  3. Chevrolet Equinox EV – 25,085
  4. Hyundai Ioniq 5 – 21,999
  5. Honda Prologue – 20,236
  6. Ford Mustang Mach-E – 20,177
  7. Volkswagen ID.4 – 12,470
  8. Audi Q6 e-tron – 10,299
  9. Ford F-150 Lightning – 10,005
  10. Rivian R1S – 8,184

10.5 percent of the automotive sales in the U.S. in Q3 were electric, a new record that surpasses that of Q3 2024, where the total share of sales for EVs was 8.6 percent.

Now, the disappointment that is evident from this list is the fact that there is no Tesla Cybertruck listed. That’s because it was the second-best-selling EV pickup on the market. The company sold 5,385 Cybertruck units in Q3.

The Cybertruck has been a vehicle that has confused many Tesla fans and owners, especially considering the company had such stratospheric expectations for the vehicle while it was in development. Reservation trackers had the truck sitting between one million and two million orders, but it has not lived up to that.

Pricing is the main issue with Cybertruck. Tesla introduced the pickup with Single, Dual, and Tri-motor configurations, priced at $39,990, $49,990, and $69,990. Those price points are simply a thing of the past.

Continue Reading

Trending