Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

Advertisement
A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Advertisement

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla brings Model Y L ‘Launch Series’ to the U.S. at $61,990

Published

on

Tesla has officially launched the Model Y L in the United States and Puerto Rico for $61,990. It is the longer-wheelbase version of the Model Y, and has been available in China since last year.

Tesla brings the Model Y L to the U.S. just months after it phased out the only pure SUV in its lineup, the Model X. It is slightly longer than the Model Y configurations that are already available in the U.S., and features a three-row, six-seat setup with Captain’s Chairs being among the many features that make this a truly fantastic offering.

The Model Y L is priced competitively at $61,990, and features 325 miles of range and a 0-60 MPH in just 4.4 seconds.

Tesla also added a handful of new features that are not available in even the Premium Model Y. Here’s a full list of its features:

Advertisement
  • Heated/Ventilated Front Seats with Powered Thigh Cushion
  • Heated/Ventilated Captain’s Seats in Second Row with Powered Armrests & One-Touch Fold
  • Heated Third-Row Seats with Power Recline, One-Touch Fold & Child Seat Anchors
  • Improved Airflow, Increased Efficiency, More Range
  • 89 cubic feet of trunk space
  • Upgraded Acoustic Glass and Suspension to Minimize Road Noise
  • Adaptive Damping for a Smooth, Stable Ride
  • Staggered Tires for Enhanced Grip
  • Larger Tailgate for Better Rear Visibility and Bigger Windows Overall
  • 16″ First Row and 8″ Second Row Touchscreens
  • 19-Speaker Immersive Tesla Audio
  • 50W Wireless Charging Pads with Active Cooling and Charging Ports for All Other Seats
  • FSD Supervised and Integrated Grok AI

Tesla is also delivering these first units as a “Launch Series,” which comes with additional features, such as:

  • Door Trim Puddle Lights
  • Suede Dashboard Wing
  • Exterior and Interior Badging
  • Floor Mats
  • Sill Plates

The launch of the Model Y L in the U.S. marks a huge offering from Tesla to U.S. consumers. People have been calling for Tesla to bring a larger car to the U.S., and it needed it more than ever now that the Model X is gone.

It is a huge accomplishment for Tesla to get the Model Y L to the U.S., and after reporting strong deliveries today, it will be interesting to see how this car impacts future quarterly delivery reports.

Deliveries for the Model Y L “Launch Series” are slated for September or October of this year.

Continue Reading

News

Tesla just told us twice that Model Y L is coming to the U.S.

Published

on

Credit: Tesla

Tesla just told us twice that the Model Y L is coming to the U.S., and two social media posts definitely just tipped the company’s hand, as if they wanted it to be any other way.

The two social media posts basically confirm that the slightly longer version of the Model Y will be heading to the United States soon, and many have speculated that the company could launch the vehicle as soon as this weekend.

The first post was directly from Tesla, and it showed an incredibly long Dachshund, with words above that said, “Looking forward to the long weekend.”

Anyone who knows Tesla knows the company loves to troll its fans and have fun, and this is a perfect example of that. While not a direct acknowledgement, Tesla is very involved on social media, especially CEO Elon Musk’s platform X, and the company is well aware of what is being discussed within the community.

With recent sightings of Model Y L test mules in California, peeks of the vehicle at Giga Texas, and a large call for the car to come to the U.S., Tesla is simply stoking conversation with this.

However, the company also made another move that was recognized on social media. Tesla has a large gallery that includes photos of its products so media and others can use them. This gallery applies to the U.S. market specifically, unless otherwise specified.

Advertisement

Tesla uploaded a Model Y L to the Gallery last night:

This seems to be another indication that the Model Y L is coming to the United States.

Advertisement

Musk said last year that the Model Y L could make its way to the United States late this year, but it was not something that was set in stone by Tesla. The company definitely needs to establish something in the SUV market that is larger than the Model Y, and the Model Y L might be the answer.

Even still, there are consumers out there who would love Tesla to develop something even larger, like a competitor to the Tahoe or Expedition. Tesla has not really given much of an indication that it will go in that direction.

Continue Reading

News

Tesla is using vehicle microphones to improve build quality: here’s how

Published

on

Credit: Tesla

Tesla is using the vehicles’ internal microphones to improve build quality, Vice President of Engineering Lars Moravy revealed recently.

It’s no secret that Tesla is always finding ways to make its manufacturing operations more efficient, accurate, and valuable. Constantly trying to make its cars better, the company has never placed any restrictions on what it will do to improve everything from panel gaps to paint.

As Teslas have been driving autonomously on the property of the Gigafactory Texas plant for a while now, Moravy revealed to Herbert Ong in a new interview that cars rolling off production lines now autonomously navigate themselves through a bumps, squeaks, and rattles (BSR) portion of the line. This helps to identify any loose or improperly installed internal parts.

The cabin’s microphones, which are used for a variety of things in ownership, simultaneously monitor any noises inside the vehicle while it rolls through the BSR portion of the production line. Moravy actually revealed that Tesla is trying to build “Full Self-Hearing,” an AI system that will detect minor imperfections so they can be corrected before delivery.

Advertisement

It’s no secret that build quality is something that Tesla struggled with as it scaled to a fully massive production operation that manufactures over 1.6 million vehicles per year. However, in recent years, especially, there have not been as many complaints. Tesla has truly improved upon its build quality and paint quality over the past several years, especially in the U.S.

Tesla’s ‘megacasts’ are key to massive build quality improvements

While those improvements have been evident, there are still some complaints; no automaker is perfect with this. But this step will now ensure that every single car that rolls off the production lines at Gigafactory Texas will be void of any creaks, squeaks, or squeals when it leaves the factory.

This measure is one of the most unique we’ve seen in terms of a strategy to avoid build quality issues, but it is not exclusive to Tesla.

Advertisement

Ford uses acoustic analysis AI to find abnormalities in seat motors, climate control units, and other components. Suppliers and OEMs will also use microphone arrays or particle velocity sensors in end-of-line stations.

The full interview with Lars Moravy is available below:

Advertisement
Continue Reading