Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Advertisement
-

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

Investor's Corner

Tesla’s flying Roadster just revealed something bigger than the car

Analysts say the Roadster demo puts a Tesla and SpaceX merger back on the table.

Published

on

By

Tesla’s new Roadster, upside down and trailing cold gas thruster smoke, flips over a lineup of Tesla vehicles at the Roadster unveiling near Waco, Texas on October 15, 2026. (Image: Tesla)
Tesla’s new Roadster, upside down and trailing cold gas thruster smoke, flips over a lineup of Tesla vehicles at the Roadster unveiling near Waco, Texas on October 15, 2026. (Image: Tesla)

The Roadster unveiling near Waco ended Thursday night, and by Friday morning much of the investor reaction had less to do with the car than with who owns the rocket technology inside it.

Wedbush analyst Dan Ives said the event “puts the Tesla/SpaceX relationship on the table in a tangible way,” pointing to the propulsion, pressure vessel and control hardware sitting on a Tesla product. Gene Munster of Deepwater Asset Management called the demo “a ridiculous display of engineering” with “no commercial value” beyond embarrassing traditional automakers, though he said it showed Musk wants the two companies together.

The more specific forecast came a day earlier from Barclays. Analyst Dan Levy told clients a deal could be announced before Tesla’s annual meeting, which must happen by December 6, and that an announcement in late October or early November could make shareholder approval harder. Barclays expects SpaceX to be the buyer in an all stock deal, with Tesla holders receiving SpaceX shares at a premium, based on market values of roughly $2.1 trillion for SpaceX and $1.5 trillion for Tesla. If nothing lands around the meeting, the bank still sees an announcement within 6 to 12 months.

The Roadster demo just added more weight to merger speculations. Tesla’s demo used cold gas thrusters and pressure tanks of the kind SpaceX uses on Falcon 9, and Musk described the car as a collaboration between Tesla and SpaceX engineers, as we mentioned in our breakdown of the three Roadster configurations.


Musk has not publicly addressed a deal since the event, as far as we have seen. His most direct answer remains the one he gave at the All In Summit, when he said that with so much collaboration, “who can imagine what action one might take” without ruling anything out. Ives has held to a 2027 timeline since his March note, and Musk pushed back on the China piece of the speculation when ARK floated a year end announcement in August.

The next test is Tesla’s third quarter earnings call on October 21. However, we recall in July that Musk told analysts, “we can’t talk about combining companies and that kind of thing on an earnings call,” so a clear answer wouldn’t be expected.

Advertisement
-
Continue Reading

News

How Tesla’s Roadster fan system and thrusters are built to dominate the corners

Tesla’s Roadster uses fans, active wings and cold gas thrusters to create grip at any speed.

Published

on

By

The Roadster’s rear wing, one of the aerodynamic elements Tesla pairs with a fan-based downforce system. (Image: Tesla)
The Roadster’s rear wing, one of the aerodynamic elements Tesla pairs with a fan-based downforce system. (Image: Tesla)

Tesla’s new Roadster is best known for flipping through the air in Texas, but the technology that matters most for a race track is the stuff that keeps it on the ground. Tesla’s Roadster page describes a multi-mode fan and ground sealing system that acts as a downforce generator, pulling air out from beneath the car. Tesla says it provides enough suction to hold the vehicle upside down, even when stationary.

That is the key difference from the wings and diffusers on a normal supercar. Conventional aero only makes downforce when the car is moving, and it grows with speed, so a car has the least grip in the slow corners and under hard braking. A fan system makes downforce at any speed. Tesla’s patent, which we covered last year, describes fans and deployable skirts that create sealed or partially sealed regions under the car, with the fans extracting air to lower the pressure and increase grip and stability.


Tesla pairs that with active wings, a next generation steer by wire system and a Track Mode that lowers the car and changes the suspension, with high downforce and low drag settings for the circuit. To keep weight down, Tesla points to magnesium, titanium and carbon fiber, manual controls and a fixed seat position, which it says lets the car respond to driver inputs almost instantly.

Tesla Roadster: Three configs, one can fly, 0-60 in 0.8 seconds

The cold gas thrusters are the other half. On the Thrust version they sit at the rear and Tesla says they take the car from 0 to 60 mph in under 0.9 seconds, while the Rocket version adds perimeter thrusters for forward, upward and lateral rotational movement. Tesla says the all electric actuators make micro adjustments within a fraction of a second.

Advertisement
-


Musk has been talking about records for years. In June 2019 he said, “We’re going to do things with the new Roadster that are kind of unfair to other cars.” That September, when a follower asked whether the Roadster would beat the Nürburgring production car record, he replied with one word, “Absolutely,” as we reported at the time. In February 2024 he said Tesla had “radically increased the design goals” for the car and that its sub one second 0 to 60 time would be “the least interesting part.”

There are caveats. Tesla has not published a lap time or a verified cornering figure, so the record talk is still a promise rather than a result. Tesla also says the car is not approved for public road use, and the thruster features are limited to the Rocket trim, which is invite only. Fan cars have also been banned or withdrawn before, and getting a sealed underbody to work on a rough public road is a harder problem than on a smooth track. The first real test will be an official lap at a circuit.

Continue Reading

Featured

Tesla Roadster: Three configs, one can fly, 0-60 in 0.8 seconds

Tesla’s Roadster comes in Performance, Thrust and Rocket versions, with a claimed 0-60 under 0.59 seconds.

Published

on

By

Elon Musk addresses the crowd next to the new Tesla Roadster, which Tesla offers in Performance, Thrust and Rocket versions. (Image: Tesla/X)

Tesla finally showed the next generation Roadster on Thursday night, and the demo had more in common with a SpaceX test than a track lap. At an event outside Waco, Texas, near SpaceX’s McGregor site, the car used a mix of fans and cold gas thrusters to drive up a curved ramp until it was upside down, then flew off, flipped and landed on the pavement. “Well, it worked,” Elon Musk said. “Flying cars are real.”

The Roadster also hovered itself over a Cybercab, Cybertruck, Tesla Semi, Model Y and Model 3 while moving, and that Tesla showed it going 0 to 60 mph in one second. Musk said “this will be the actual car that’s on the roads” and that it “literally is just going to puff itself up” to perform the maneuvers whenever an owner wants. He called the result a collaboration between Tesla and SpaceX engineers that is “better than any James Bond car,” with Franz von Holzhausen and Lars Moravy on site.

Tesla published new mind-blowing stats for the car that replace the previous targets. The Performance version is road ready and seats two, with active aerodynamics and a multi-mode suction system, and Tesla lists 0 to 60 mph in under 1.6 seconds. The Thrust version is race ready, also seats two, and adds rear-mounted cold gas thrusters for a 0 to 60 time of under 0.9 seconds. The Rocket version is described as air ready, seats one, and uses perimeter-mounted thrusters for forward and upward acceleration plus lateral rotational movement.

Configuration Seats 0 to 60 mph
Performance 2 under 1.6 s
Thrust 2 under 0.9 s
Rocket 1 under 0.59 s

Tesla’s own description: “So…yes, it can fly.” It lists a 0 to 60 time of under 0.59 seconds for Rocket, a top speed of up to more than 230 mph, and range of more than 300 miles. Tesla has not yet given pricing in the information we have seen, but has reopened $50,000 reservations in the newly updated Tesla Roadster configurator. Production is planned for Giga Texas in 2027 or 2028, and Musk has said it would follow the demo by 12 to 18 months.

Tesla’s Roadster page adds more on how the car works. A multi-mode fan and ground sealing system pulls air from under the car, producing enough suction to hold it upside down even when stationary. Active wings, steer-by-wire with a yoke, and a Track Mode that lowers the car round out the driving setup. The cold gas thrusters use all-electric actuators for micro adjustments to stabilize the car in flight. Tesla says it cut weight with magnesium, titanium and carbon fiber, manual controls and a fixed seat position, and the exterior has hidden headlights, a full-length taillight and Ano White paint inspired by aerospace coatings. Inside are an Ultrawhite interior with gray microsuede, a center touchscreen and two smaller forward displays, and gold tinted glass modeled on spacesuit visors. Availability is tiered: Performance is by reservation, Thrust is a limited release, and Rocket is invite only. Tesla notes the car is not approved for public road use, and that Rocket is not available in all regions.

Tesla Roadster Highlights

  • Aero and suction: a multi-mode fan and ground sealing system pulls air from under the car and can hold it upside down even when stationary. There are also active wings and a Track Mode that lowers the car.
  • Controls and thrusters: steer-by-wire with a yoke. The cold gas thrusters use all-electric actuators for micro adjustments that stabilize the car in flight.
  • Weight: magnesium, titanium and carbon fiber, manual controls and a fixed seat position.
  • Design: hidden headlights, a full-length taillight, Ano White paint inspired by aerospace coatings, and gold tinted glass modeled on spacesuit visors.
  • Interior: an Ultrawhite interior with gray microsuede, a center touchscreen and two smaller forward displays.
  • Availability: Performance is by reservation, Thrust is a limited release, and Rocket is invite only.
  • Road use: Tesla notes the car is not approved for public road use, and that Rocket isn’t available in all regions.

Musk has described the Roadster as “the best of the last of the human-driven cars,” and he has been open that it is a halo product. He said he is “not sure it moves the needle massively from a revenue standpoint,” and has warned that anyone whose top priority is safety should not buy it. Tesla reports third quarter earnings on October 21.

Continue Reading