News
Tesla is patenting a clever way to train Autopilot with augmented camera images
Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.
As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.
Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.
With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”
Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.
Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:
“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”
Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.
“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”
Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.
Elon Musk
Tesla analyst says Musk stock buy should send this signal to investors
“With Musk’s (Tesla stock) purchase, combined with the upward momentum for delivery expectations and robotaxi rollout, we are becoming more bullish.”
Tesla CEO Elon Musk purchased roughly $1 billion in Tesla shares on Friday, and analysts are now breaking down the move as the stock is headed upward.
One of them is William Blair analyst Jed Dorsheimer, who said in a new note to investors on Monday that Musk’s move should send a signal of confidence to stock buyers, especially considering the company’s numerous catalysts that currently exist.
Elon Musk just bought $1 billion in Tesla stock, his biggest purchase ever
Dorsheimer said in the note:
“With Musk’s (Tesla stock) purchase, combined with the upward momentum for delivery expectations and robotaxi rollout, we are becoming more bullish. This purchase is Musk’s first buy since 2020. To us, this sends a strong signal of confidence in the most important part of Tesla’s future business, robotaxi.”
Musk putting an additional $1 billion back into the company in the form of more stock ownership is obviously a huge vote of confidence.
He knows more than anyone about the progress Tesla has made and is making on the Robotaxi platform, as well as the company’s ongoing efforts to solve vehicle autonomy. If he’s buying stock, it is more than likely a good sign.
Tesla has continued to expand its Robotaxi platform in a number of ways. The project has gotten bigger in terms of service area, vehicle fleet, and testing population. Tesla has also recently received a permit to test in Nevada, unlocking the potential to expand into a brand-new state for the company.
In the note, Dorsheimer also touched on Musk’s recent pay package, revealing that William Blair recently met with Tesla’s Board of Directors, who gave the firm some more color on the situation:
“We recently participated in a meeting with Tesla’s board of directors to discuss the details of Musk’s performance package. The board is confident of its position in the Delaware case and anticipates a verdict by end of year. It does not expect a similar situation to occur under new Texas jurisdiction. Musk has the board’s full support, and we expect he’ll get more than enough shareholder support for this to pass with flying colors.”
Tesla stock is up over 6 percent so far today, trading at $421.50 at the time of publication.
News
Morgan Stanley’s Adam Jonas dubs Tesla FSD a “game changer” after marathon drive
Jonas reported that FSD handled more than 99% of the miles.
Morgan Stanley’s analyst Adam Jonas shared a notable endorsement of Tesla’s Full Self-Driving (FSD) software after completing a 1,400-mile round trip from New York to Michigan in his Model Y.
Jonas reported that FSD handled more than 99% of the miles, calling the system “a game changer” for long-distance driving.
Hands-free experience
Jonas drove his 2021 Tesla Model Y equipped with Hardware 3 and FSD Supervised v12.6.4, and he used the system nearly the entire trip. “Having your hands off the wheel and feet off the pedals for nearly 12 hours of driving is a real game changer that is hard to appreciate without experiencing it for yourself,” he noted.
He explained that outside of two heavy downpours, one on the Pennsylvania Turnpike and another in suburban Detroit, plus some light maneuvering in fast food parking lots, FSD handled the drive without any human intervention. “FSD made no mistakes or close calls that I recall. The system handles highways very safely and confidently. I cannot imagine buying another EV without FSD.”
Broader implications
Jonas added that he has used FSD consistently over the past 18 months, and the $8,000 he paid for the feature feels like a bargain considering the value. He also praised Tesla’s Supercharging network, which supported his trip without issue.
Jonas has been one of Wall Street’s most closely followed voices on Tesla, and his comments add weight to the ongoing debate about the role of autonomy in the company’s future. His current price target for Tesla stock stands at $410. During Morgan Stanley’s 13th Annual Laguna Conference, he echoed similar experiences with Tesla’s software, emphasizing that FSD “probably drove well over 99% of the miles” on his recent trips.
Elon Musk
Elon Musk just bought $1 billion in Tesla stock, his biggest purchase ever
Prior to this latest move, Musk’s most recent purchase was for about 200,000 shares worth $10 million in 2020.
Tesla (NASDAQ:TSLA) shares rose on Monday after CEO Elon Musk disclosed a rare insider purchase of company stock worth about $1 billion.
A filing with the U.S. Securities and Exchange Commission (SEC) revealed that Musk acquired 2.57 million shares last Friday at various prices. The move represents Musk’s largest TSLA purchase ever by value, as per Verity data.
Elon Musk’s TSLA purchase
The disclosure sent Tesla shares up more than 8% in premarket trading Monday, as investors read the purchase as a notable vote of confidence, as stated in a CNBC report. Tesla stock had closed slightly lower Friday but remains more than 25% higher over the past three months. It should be noted that prior to this latest move, Musk’s most recent purchase was for about 200,000 shares worth $10 million in 2020.
Market watchers say the purchase could help shore up investor sentiment amid a volatile year for TSLA stock. Shares have faced pressure from a variety of factors, from year-over-year sales challenges due to the new Model Y changeover, political controversies tied to Musk, and reduced U.S. incentives for EVs under the Trump administration. Nevertheless, analysts such as Wedbush’s Dan Ives stated that Musk’s purchase was a “huge sign of confidence for Tesla bulls and shows Musk is doubling down on his Tesla A.I. bet.”
Tesla and Elon Musk
Musk already owns about 13% of Tesla, and his latest purchase comes as the company prepares for a key shareholder vote in November. Investors will decide whether to approve a compensation package for Musk that could ultimately be worth as much as $975 billion if ambitious market value milestones are achieved. The package has a long-term target of pushing Tesla’s market capitalization to $8.5 trillion, compared with about $1.3 trillion at Friday’s close.
Wall Street’s current consensus price target still implies a roughly 20% decline from current levels, though some Tesla bulls remain optimistic that the company could shift its focus toward autonomy, AI, and robotics. Musk has also asked shareholders to approve an investment into his latest venture, xAI.
Tesla analyst says Musk stock buy should send this signal to investors
Morgan Stanley’s Adam Jonas dubs Tesla FSD a “game changer” after marathon drive
Elon Musk just bought $1 billion in Tesla stock, his biggest purchase ever
-
Elon Musk2 weeks agoTesla’s next-gen Optimus prototype with Grok revealed
-
News1 week agoTesla launches new Supercharger program that business owners will love
-
Elon Musk1 week agoTesla Board takes firm stance on Elon Musk’s political involvement in pay package proxy
-
News2 weeks agoTesla appears to be mulling a Cyber SUV design
-
News2 weeks agoTesla deploys Unsupervised FSD in Europe for the first time—with a twist
-
News2 weeks agoTesla explains why Robotaxis now have safety monitors in the driver’s seat
-
News2 weeks agoTesla is already giving Robotaxi privileges hours after opening public app
-
Elon Musk2 weeks agoElon Musk says Tesla will take Safety Drivers out of Robotaxi: here’s when