News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Tesla has made two big interior changes to several Model Y vehicles in its lineup, and the changes come just as the new model year begins production.
Last year, Tesla launched the Model Y Standard, which separated the previous models into the “Premium” category. The Standard vehicles lack several features, including more premium interior materials, acoustic-lined glass, and storage.
@teslarati There are some BIG differences between the Tesla Model Y Standard and Tesla Model Y Premium #tesla #teslamodely ♬ Sia – Xeptemper
The Model Y “Premium” trims are now getting several new upgrades, which come after the company launched a seven-seat configuration of the vehicle last night in the North American market for an upcharge of $2,500.
The new Model Y seven-seat configuration did not come with just an additional row of seating; it also came with a slew of other goodies that now come standard and were previously only available on the Model Y Performance, which was launched late last year.
All Black Headliner
The new Tesla Model Y Premium trims will now come standard with a black headliner, something that many owners have been requesting for some time.
The previous grey headliner and trim within the vehicle is now gone; it will be all black on all of the Premium trims from here on out, a welcome change:
Credit: Tesla
Larger and Higher Resolution Center Touchscreen
The center touchscreen in the new Model Y Premium configuration is now larger and has a higher resolution than the previous version.
In last year’s Model Y configurations (apart from the Performance), the center touchscreen was 15.4″. Now, Tesla has decided to go with the 16″ version across all Premium trims, which is a nice step up. It was nice to see this in the Performance, but it is really great to see Tesla include this in the Model Y’s more Premium trim levels.
Tesla Model Y Seven Seater
Tesla launched the latest iteration of the seven-seater for the Model Y on Monday night. Traditionally, the Model Y seats five passengers in total, but there were calls for a more spacious version several years ago.
Tesla released it, but it was extremely tight in the back, basically reserving those back seats for only small people or children.
Credit: Tesla
The new configuration looks to be slightly more spacious in the third row, but not as much space as most would require or want. Instead,
Elon Musk
Lufthansa Group to equip Starlink on its 850-aircraft fleet
Under the collaboration, Lufthansa Group will install Starlink technology on both its existing fleet and all newly delivered aircraft, as noted by the group in a press release.
Lufthansa Group has announced a partnership with Starlink that will bring high-speed internet connectivity to every aircraft across all its carriers.
This means that aircraft across the group’s brands, from Lufthansa, SWISS, and Austrian Airlines to Brussels Airlines, would be able to enjoy high-speed internet access using the industry-leading satellite internet solution.
Starlink in-flight internet
Under the collaboration, Lufthansa Group will install Starlink technology on both its existing fleet and all newly delivered aircraft, as noted by the group in a press release.
Starlink’s low-Earth orbit satellites are expected to provide significantly higher bandwidth and lower latency than traditional in-flight Wi-Fi, which should enable streaming, online work, and other data-intensive applications for passengers during flights.
Starlink-powered internet is expected to be available on the first commercial flights as early as the second half of 2026. The rollout will continue through the decade, with the entire Lufthansa Group fleet scheduled to be fully equipped with Starlink by 2029. Once complete, no other European airline group will operate more Starlink-connected aircraft.
Free high-speed access
As part of the initiative, Lufthansa Group will offer the new high-speed internet free of charge to all status customers and Travel ID users, regardless of cabin class. Chief Commercial Officer Dieter Vranckx shared his expectations for the program.
“In our anniversary year, in which we are celebrating Lufthansa’s 100th birthday, we have decided to introduce a new high-speed internet solution from Starlink for all our airlines. The Lufthansa Group is taking the next step and setting an essential milestone for the premium travel experience of our customers.
“Connectivity on board plays an important role today, and with Starlink, we are not only investing in the best product on the market, but also in the satisfaction of our passengers,” Vranckx said.
Elon Musk
Tesla locks in Elon Musk’s top problem solver as it enters its most ambitious era
The generous equity award was disclosed by the electric vehicle maker in a recent regulatory filing.
Tesla has granted Senior Vice President of Automotive Tom Zhu more than 520,000 stock options, tying a significant portion of his compensation to the company’s long-term performance.
The generous equity award was disclosed by the electric vehicle maker in a recent regulatory filing.
Tesla secures top talent
According to a Form 4 filing with the U.S. Securities and Exchange Commission, Tom Zhu received 520,021 stock options with an exercise price of $435.80 per share. Since the award will not fully vest until March 5, 2031, Zhu must remain at Tesla for more than five years to realize the award’s full benefit.
Considering that Tesla shares are currently trading at around the $445 to $450 per share level, Zhu will really only see gains in his equity award if Tesla’s stock price sees a notable rise over the years, as noted in a Sina Finance report.
Still, even at today’s prices, Zhu’s stock award is already worth over $230 million. If Tesla reaches the market cap targets set forth in Elon Musk’s 2025 CEO Performance Award, Zhu would become a billionaire from this equity award alone.
Tesla’s problem solver
Zhu joined Tesla in April 2014 and initially led the company’s Supercharger rollout in China. Later that year, he assumed the leadership of Tesla’s China business, where he played a central role in Tesla’s localization efforts, including expanding retail and service networks, and later, overseeing the development of Gigafactory Shanghai.
Zhu’s efforts helped transform China into one of Tesla’s most important markets and production hubs. In 2023, Tesla promoted Zhu to Senior Vice President of Automotive, placing him among the company’s core global executives and expanding his influence beyond China. He has since garnered a reputation as the company’s problem solver, being tapped by Elon Musk to help ramp Giga Texas’s vehicle production.
With this in mind, Tesla’s recent filing seems to suggest that the company is locking in its top talent as it enters its newest, most ambitious era to date. As could be seen in the targets of Elon Musk’s 2025 pay package, Tesla is now aiming to be the world’s largest company by market cap, and it is aiming to achieve production levels that are unheard of. Zhu’s talents would definitely be of use in this stage of the company’s growth.
Tesla makes two big interior changes to several Model Y vehicles
Lufthansa Group to equip Starlink on its 850-aircraft fleet
