Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

Advertisement
-
-

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

SpaceX just launched a secret payload from California

SpaceX launched a classified Space Force mission from Vandenberg, revealing almost nothing about its payload.

Published

on

By

Space Force officials say the Falcon 9 booster pictured here in SpaceX's rocket factory will have to wait a few months longer for its launch debut. (SpaceX)

SpaceX launched a classified Falcon 9 mission for the U.S. Space Force from Vandenberg Space Force Base on Saturday night, and the government released almost nothing about what was on board. The mission, designated USSF-366, lifted off from Space Launch Complex 4E with a window that opened at 9:52 p.m. ET and ran into the early hours of Sunday, according to SpaceX’s own mission page, which described the payload only as classified. SpaceX confirmed the launch on its X account and pointed viewers to a livestream that began roughly ten minutes before liftoff.


The lack of detail did not stop analysts from filling in the blanks. Independent tracking of the rocket’s stage drop zones matched the pattern SpaceX has used on previous Starlink Group 15 missions, according to reporting from Outer Space Today, which pointed to Starshield as the likely payload rather than a one off government satellite. Starshield is SpaceX’s national security product, a version of the Starlink satellite bus built to Pentagon specifications for earth observation, communications and hosted payloads. Unlike consumer Starlink, government agencies do not have to disclose what Starshield satellites are actually doing once they reach orbit.

USSF-366 is the latest entry in a steady flow of classified and semi classified work between SpaceX and the Space Force. The company picked up a $178.5 million task order in April to launch missile tracking satellites for the Space Development Agency, as Teslarati reported at the time, and followed that in July with a $1.6 billion award covering 18 more Falcon 9 missions from Vandenberg through the end of 2027, also detailed by Teslarati. Add those contracts up and SpaceX’s Pentagon business for 2026 alone tops $8 billion.

SpaceX scores another massive Pentagon deal to support military satellites

The Falcon 9 that flew Saturday landed back near the launch site, producing the sonic booms that have become routine for residents near Vandenberg. What is less routine is how little the public will likely ever learn about what the rocket carried. SpaceX and the Space Force have not confirmed the Starshield connection, and government satellite programs built on commercial buses rarely get identified beyond a mission number and a general orbit. For a company that live streams almost everything else it does, from Starship test flights to Optimus robot demos, USSF-366 is a reminder that some of SpaceX’s busiest work now happens entirely out of public view.

Advertisement
-
-
Continue Reading

News

Tesla V2L adapter for Model Y stirs up a new complaint among owners

Published

on

Credit: Tesla

On Friday, Tesla launched the Outlet Adapter that enabled Vehicle-to-Load (V2L) energy transfer, meaning owners could essentially utilize their cars as a power source for things like laptops, electric grills, or string lights.

However, even owners of some of the newest builds of the Model Y are finding out that their cars are not compatible with the new $80 accessory, stirring up a new complaint among members of the community.

Tesla launches V2L Outlet Adapter for Premium Model Y in the U.S.

Upon the release of the Outlet Adapter on Friday, I signed into my Tesla account to order the accessory. However, I was met with the dreaded “This product is not compatible with your 2026 Model Y” message at the bottom of the screen.

Some said their accounts also displayed the same message, but they ordered anyway. However, they might be surprised to find that this is no mistake; some of the newest Model Ys do not have the appropriate Power Conversion System (PCS). Mine, which was ordered on this day last year and delivered on August 31, has the old 48A, single-phase PCS.

Vehicles with the new, two-piece PCS are able to utilize V2L features on their cars:

Obviously, it’s disappointing. Many owners have taken delivery this year and still can not utilize the Outlet Adapter because their cars feature the old PCS:

It looks like if you have one of these older PCS units, you can upgrade, but the parts alone are $1,750, and that’s before Tesla adds labor for installing. It is honestly more logical to get some kind of portable power supply or power station at that point.

Advertisement
-
-

It is great that Tesla has enabled V2L for Model Y vehicles, but it is also unfortunate that vehicles that are less than one year old are not able to take advantage of this awesome new feature.

With that being said, it truly is a first-world problem; can you really complain when Full Self-Driving is available, maintenance is incredibly inexpensive, and the car has been so good through a year of ownership?

Continue Reading

News

Tesla launches V2L Outlet Adapter for Premium Model Y in the U.S.

Published

on

Credit: Tesla

Tesla has launched a new Vehicle-to-Load (V2L) Outlet Adapter for Premium Model Y vehicles in the United States, meaning you can now power devices like laptops or light strings with your vehicle’s battery.

It appears the capability will be available for any Model Y Premium trim, including those that were purchased prior to the Adapter being launched. It will also only impact Juniper Model Y vehicles, so the first-gen owners will unfortunately not have access to this capability.

If your Model Y was purchased before Tesla renamed the trim levels to “Premium” and “Standard,” it does not seem to be compatible. My Model Y is technically a Premium build, as it is the Long Range All-Wheel-Drive. However, Tesla says it is not compatible with my vehicle.

For $80, you can now utilize your car as a portable charger for small appliances or devices. This is perfect for things like tailgates, concerts, or camping, as you can now plug in devices that you might use. Those string lights for camping? That laptop for the other games that are on at the tailgate?

Advertisement
-
-

They’ll both utilize energy from your Tesla’s battery to be powered. This is the first time Tesla has expanded the capability to vehicles outside of the Model Y Performance and Cybertruck. However, this feature has been highly requested by owners for an extended period of time.

Tesla launched the Outlet Adapter in China last year:

Tesla China rolls out Model Y L V2L adapter, and it’s free for early owners

You will need the Mobile Connector to operate the Outlet Adapter: the Outlet Adapter will plug into the main housing of the Mobile Connector, where the appropriate adapter to charge your vehicle will plug in.

It is rated for 120 volts and 20 amps, and has a max power rating of 2.4kW.

You can buy it here from Tesla for $80.

Advertisement
-
-
Continue Reading