Connect with us
Tesla Autopilot construction zone lane Tesla Autopilot construction zone lane

News

Tesla is patenting a clever way to train Autopilot with augmented camera images

Tesla Autopilot construction zone lane (Credit: YouTube/Cf Tesla)

Published

on

Tesla is currently tackling what could only be described as its biggest challenge to date. In his Master Plan, Part Deux, CEO Elon Musk envisioned a fleet of zero-emissions vehicles that are capable of driving on their own. Tesla has made steps towards this goal with improvements and refinements to its Autopilot and Full Self-Driving suites, but a lot of work remains to be done.

As noted by Tesla during its Autonomy Day presentation last year, attaining Full Self-Driving is largely a matter of training the neural networks used by the company. Tesla adopts what could be described as a somewhat organic approach for autonomy, with the company using a system that is centered on cameras and artificial intelligence — the equivalent of a human primarily using the eyes and brain to drive.

Tesla’s camera-centric approach may be quite controversial due to Elon Musk’s strong stance against LiDAR, but it is gaining ground, with other autonomous vehicle companies such as MobilEye developing FSD systems that rely primarily on visual data and a trained neural network. This approach does come with its challenges, as training neural networks requires tons of data. Tesla emphasized this point as much during its Autonomy Day presentation.

With this in mind, it is pertinent for the electric car maker to train its neural networks in a way that is as efficient as possible with zero compromises. To help accomplish this, Tesla seems to be looking into the utilization of augmented data, as described in a recently published patent titled “Systems and Methods for Training Machine Models with Augmented Data.”

A block diagram of an environment for computer model training. (Credit: Patentscope.wipo.int)

Teslas are equipped with a suite of cameras that provide 360-degree visual coverage for the vehicle. In the patent’s description, Tesla noted that images used for neural network training are usually captured by various sensors, which, at times, have different characteristics. An example of this may lie in a Tesla’s three forward-facing cameras, each of which has a different field of view and range as the other two.

Tesla’s recent patent describes a system that allows the company to process these images in an optimized manner. Part of how this is done is through augmentation, which opens the doors to flexible and widespread neural network training, even when it involves vehicles equipped with differently-specced cameras. The electric car maker describes this process as such:

Advertisement

“Augmentation may provide generalization and greater robustness to the model prediction, particularly when images are clouded, occluded, or otherwise do not provide clear views of the detectable objects. These approaches may be particularly useful for object detection and in autonomous vehicles. This approach may also be beneficial for other situations in which the same camera configurations may be deployed to many devices. Since these devices may have a consistent set of sensors in a consistent orientation, the training data may be collected with a given configuration, a model may be trained with augmented data from the collected training data, and the trained model may be deployed to devices having the same configuration.”

Among the most notable aspects of Tesla’s recent patent is the use of “cutouts,” which allow Tesla’s neural networks to be trained using an optimized set of images. This was something that was discussed by former Tesla Autopilot engineer Eshak Mir in a Third Row Podcast interview, where he hinted at a system adopted in the electric car maker’s ongoing Autopilot rewrite that helped lay out “all the camera images” from a vehicle “into one view.” Such a process has the potential to help Tesla with 3D labeling, especially since the images used for neural network training are stitched together. Tesla’s patent seems to reference a system that is very similar to that described by the former Autopilot engineer.

“As a further example, the images may be augmented with a“cutout” function that removes a portion of the original image. The removed portion of the image may then be replaced with other image content, such as a specified color, blur, noise, or from another image. The number, size, region, and replacement content for cutouts may be varied and may be based on the label of the image (e.g., the region of interest in the image, or a bounding box for an object).”

Tesla is aiming to release a feature-complete version of its Full Self-Driving suite as soon as possible. Elon Musk remains optimistic about this, despite the company missing its initial timeline that was set at the end of 2019. That being said, Elon Musk did mention previously that Tesla is working on a foundational rewrite of Autopilot. In a tweet early last month, Musk stated that an essential part of the rewrite involves work on Autopilot’s core foundation code and 3D labeling. Once done, the CEO indicated that additional functionalities could be rolled out quickly. This recent patent, if any, seems to give a glimpse at how these improvements are being done.

Advertisement

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

Elon Musk

Elon Musk echoes worries over Tesla control against activist shareholders

Elon Musk has spoken on several occasions of the “activist shareholders” who threaten his role at Tesla.

Published

on

Credit: xAI | X

Elon Musk continues to raise concerns over his control of Tesla as its CEO and one of its founders, as activist shareholders seem to be a viable threat to the company in his eyes.

Musk has voiced concerns over voting control of Tesla and the possibility of him being ousted by shareholders who do not necessarily have the company’s future in mind. Instead, they could be looking to oust Musk because of his political beliefs or because of his vast wealth.

We saw an example of that as shareholders voted on two separate occasions to award Musk a 2018 compensation package that was earned as Tesla met various growth goals through the CEO’s leadership.

Despite shareholders voting to award Musk with the compensation package on two separate occasions, once in 2018 and again in 2024, Delaware Chancery Court Judge Kathaleen McCormick denied the CEO the money both times. At one time, she called it an “unfathomable sum.”

Musk’s current stake in Tesla stands at 12.8 percent, but he has an option to purchase 304 million shares, which, if exercised, after taxes, he says, would bump his voting control up about 4 percent.

Advertisement

However, this is not enough of a stake in the company, as he believes a roughly 25 percent ownership stake would be enough “to be influential, but not so much that I can’t be overturned,” he said in January 2024.

Musk’s concerns were echoed in another X post from Thursday, where he confirmed he has no current personal loans against Tesla stock, and he reiterated his concerns of being ousted from the company by those he has referred to in the past as “activist shareholders.”

Advertisement

Elon Musk explains why he wants 25% voting share at Tesla: “I just want to be an effective steward of very powerful technology”

The CEO said during the company’s earnings call in late July:

“That is a major concern for me, as I’ve mentioned in the past. I hope that is addressed at the upcoming shareholders’ meeting. But, yeah, it is a big deal. I want to find that I’ve got so little control that I can easily be ousted by activist shareholders after having built this army of humanoid robots. I think my control over Tesla, Inc. should be enough to ensure that it goes in a good direction, but not so much control that I can’t be thrown out if I go crazy.”

The X post from Thursday said:

There is a concern that Musk could eventually put his money where his mouth is, and if politicians and judges are able to limit his ownership stake as they’ve been able to do with his pay package, he could eventually leave the company.

The company’s shareholders voted overwhelmingly to approve Musk’s pay package. A vast majority of those who voted to get Musk paid still want him to be running Tesla’s day-to-day operations. Without his guidance, the company could face a major restructuring and would have a vastly new look and thesis.

Advertisement
Continue Reading

News

People are already finding value in Tesla Robotaxi services

Tesla initially launched its Robotaxi service in Austin, though the company more recently launched it in the Bay Area.

Published

on

Credit: Tesla

Tesla’s Robotaxi service is still in its earliest days, but some consumers are already finding surprising value in the autonomous ride-hailing system. 

This was hinted at in recent comments on social media platform X. 

Robotaxi Ramp

Tesla initially launched its Robotaxi service in Austin, though the company more recently launched it in the Bay Area. Tesla’s geofence for its Robotaxi service in the Bay Area is massive, covering several times the area that is currently serviced by rival Waymo. 

As noted by the EV community members on social media, going end-to-end in Tesla’s Bay Area geofence would likely take over an hour’s worth of driving. That’s an impressive launch for the Robotaxi service in California, and considering Tesla’s momentum, its California geofence will likely grow substantially in the coming months.

Secret Advantage

As noted by Tesla owner and photographer @billykyle, the Tesla Robotaxi service actually has key advantages for people who travel a lot for their work. As per the Tesla owner, using a Robotaxi service would give back so much of his time considering that he gets about 5-7 shoots per day at times. 

Advertisement

“I’ve been reflecting on how much of a game changer this is. As a photographer that runs my own business, servicing clients all around the Philadelphia area, I could ditch having a car and let an autonomous vehicle drive me between my 5-7 shoots I have per day. This would give me so much time back to work and message clients,” the photographer wrote in a post on X.

The Tesla owner also noted that the Robotaxi service could also solve issues with parking, as it could be tricky in cities. The Robotaxi service’s driverless nature also avoids the issue of rude and incompetent ride-hailing drivers, which are unfortunately prevalent in services such as Uber and Lyft. Ultimately, just like Unsupervised FSD, Tesla’s Robotaxi service has the potential to reclaim time for consumers. And as anyone in the business sphere would attest, time is ultimately money.

Continue Reading

News

Tesla Robotaxi and Supercharger Diner are killing a dreaded consumer tradition

Tesla is still just charging strictly for its services–while asking for zero tips.

Published

on

Credit: Joe Tegtmeyer/X

Tesla’s Robotaxi service and its newly launched Supercharger Diner are killing a longtime but increasingly dreaded consumer tradition in the United States. Based on videos taken of consumers using the Robotaxi service in the Bay Area, Tesla is still just charging strictly for its services–while asking for zero tips.

Tesla Services with Zero Tips

When Tesla launched the Robotaxi pilot in Austin, users quickly noticed that the company was not allowing riders to leave a tip for the service. If one were to try leaving a tip after a Robotaxi ride, the app simply flashes an image of Tesla’s meme hedgehog mascot with a “Just Kidding” message. 

At the time, this seemed like a small tongue-in-cheek joke from the electric vehicle maker. The initial Robotaxi pilot in Austin was rolled out on a small scale, after all, and some social media users speculated that tipping may eventually just be introduced to the service.

But upon the opening of the Tesla Supercharger Diner, consumers also observed that the facility does not allow tipping. Tesla’s notice is simple: “Gratuity: Tesla covers tipping for staff.” This means that employees who work at the Tesla Diner make enough to not rely on gratuities from consumers. 

And with the launch of the Robotaxi service in the Bay Area, users observed once more that Tesla is still not allowing tipping. This was highlighted by longtime Tesla owner @BLKMDL3, who shared a video of the Tesla Robotaxi app also briefly displaying the hedgehog mascot with a “Just Kidding” message when he tried leaving a tip.

Advertisement

Out of Control

As noted in a report from The Guardian, tipping has been a longstanding business practice in the United States, were service workers typically make less than the federal minimum wage. With this system in place, service workers end up relying on gratuities to make ends meet. This was understandable, but after the pandemic, tipping culture ended up going out of control.

On platforms such as Reddit, users have also complained about services like Uber asking for large tips for using their services. Consumers have also shared shocking experiences involving some services that ask for tips. These include self-checkout counters, drive-throughs, hotdog stands, drug stores, a bottled water stall at a jazz festival, an airport vending machine, a used bookstore, a cinema box office, and a children’s arcade, among others.

Continue Reading

Trending