Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

Advertisement
-
-

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla launches V2L Outlet Adapter for Premium Model Y in the U.S.

Published

on

Credit: Tesla

Tesla has launched a new Vehicle-to-Load (V2L) Outlet Adapter for Premium Model Y vehicles in the United States, meaning you can now power devices like laptops or light strings with your vehicle’s battery.

It appears the capability will be available for any Model Y Premium trim, including those that were purchased prior to the Adapter being launched. It will also only impact Juniper Model Y vehicles, so the first-gen owners will unfortunately not have access to this capability.

If your Model Y was purchased before Tesla renamed the trim levels to “Premium” and “Standard,” it does not seem to be compatible. My Model Y is technically a Premium build, as it is the Long Range All-Wheel-Drive. However, Tesla says it is not compatible with my vehicle.

For $80, you can now utilize your car as a portable charger for small appliances or devices. This is perfect for things like tailgates, concerts, or camping, as you can now plug in devices that you might use. Those string lights for camping? That laptop for the other games that are on at the tailgate?

Advertisement
-
-

They’ll both utilize energy from your Tesla’s battery to be powered. This is the first time Tesla has expanded the capability to vehicles outside of the Model Y Performance and Cybertruck. However, this feature has been highly requested by owners for an extended period of time.

Tesla launched the Outlet Adapter in China last year:

Tesla China rolls out Model Y L V2L adapter, and it’s free for early owners

You will need the Mobile Connector to operate the Outlet Adapter: the Outlet Adapter will plug into the main housing of the Mobile Connector, where the appropriate adapter to charge your vehicle will plug in.

It is rated for 120 volts and 20 amps, and has a max power rating of 2.4kW.

You can buy it here from Tesla for $80.

Advertisement
-
-
Continue Reading

News

Tesla Roadster unveiling nears, and it will fly: The Information

Published

on

(Credit: Dami Kolz/Twitter)

Tesla is nearing its long-awaited unveiling of the all-electric Tesla Roadster, a new report from The Information claims, as the company has said several times this year that the event would take place “soon.”

Now, it appears there is movement on Tesla’s end regarding when it will happen.

The report says that Tesla will unveil the Roadster as soon as this month with a SpaceX version that will utilize cold-gas thrusters to help the vehicle float for a short period of time. This is something CEO Elon Musk has talked about with the Roadster for years.

Additionally, due to the delays, Tesla explored “a variety of designs” for the Roadster, potentially planning to abandon the design it showed off for the first time in 2017 and adopting an entirely new aesthetic.

Advertisement
-
-

According to The Information, Tesla considered utilizing a repurposed Model S Plaid and even wanted to upgrade the look to something like a Lamborghini Countach.

Elon Musk teases Tesla Roadster unveiling once again

We’ve heard all of these things before, including teases about the date and how “soon” the Roadster will finally be ready to be shown off to the world (for the second time). Musk said that the event would occur in April, then May, then Chief Designer Franz von Holzhausen continued to say it would be coming “soon.”

We do expect to see the Roadster by the end of the year, and now with this new report swirling, it appears it could be sooner rather than later.

The wait has been incredibly long, but there is likely a good reason for it. Tesla’s desire to make the Roadster the craziest vehicle on the road was non-negotiable, and it likely took a lot of time and resources to develop and perfect into something that was safe and suitable for a vehicle like this.

Continue Reading

Featured

Tesla finally got its Nevada Robotaxi Permit but with a few catches hard to miss

Nevada granted Tesla’s robotaxi permit, but capped the fleet at just ten vehicles for now.

Published

on

By

Concept art of a Tesla Cybercab in Las Vegas Strip as rendered via Grok

Tesla has received its robotaxi permit in Nevada, more than two months after regulators closed the public comment period on the company’s application. News of the approval surfaced Wednesday night when Tesla investor and longtime company watcher Sawyer Merritt posted a copy of the interim order, and the Nevada Transportation Authority’s own carrier registry now lists the permit, AVNC Permit 002 under Docket 26-05015, as active for Tesla Robotaxi, LLC.

Tesla asked Nevada in June for authority to run up to 5,000 vehicles in Clark County within a year, however the permit the NTA issued is initially capping Tesla at ten fully autonomous vehicles and confines them to a defined geofence along the Las Vegas Strip corridor. Any expansion of that operating area, or any increase to the fleet size, requires the NTA’s approval first.

The order also sets rules that look more restrictive than what Tesla runs in Austin. Rides are barred on roads with posted speed limits above 45 miles per hour, pickups are off limits within a quarter mile of Harry Reid International Airport without separate authorization, and every vehicle has to carry visible “Robotaxi” markings while notifying riders before each trip that no one is driving. The order also requires “appropriate human supervision”, language that suggests Nevada isn’t ready to let Tesla offer the rides without a safety monitor that it has run in parts of Austin since January. As with standard protocol with robotaxi services, Tesla must report any accident, system failure, or vehicle that becomes stranded on a Nevada road within five business days.

Tesla is entering a market Nevada already knows well. Zoox, the Amazon owned robotaxi company, has run its own autonomous vehicle permit in the state since last year, building up to roughly 100 vehicles and 350,000 rides along the Strip. That history likely explains why the NTA started Tesla at ten cars rather than the fleet size the company asked for. The agency has a template for scaling a permit up once a company proves out its safety record.

Advertisement
-
-

Tesla’s Nevada application first surfaced in June, when the company filed for the permit alongside plans for a maintenance hub in southwest Las Vegas. The company has said it won’t meaningfully scale its robotaxi fleet anywhere until FSD v15 ships, expected in late 2026 or early 2027, which makes the ten vehicle cap less of a constraint today than it might look on paper. For now, Tesla has the legal right to start Nevada rides. Whether it starts before FSD v15 arrives is a separate question the permit doesn’t answer.

Continue Reading