Connect with us

News

Tesla's new data pipeline and deep learning patent paves way for quicker autonomous driving improvements

A Tesla Model 3 navigates around heavy traffic. (Credit: Scott Kubo/YouTube)

Published

on

Tesla’s Neural Net continues to improve and become more advanced on a daily basis, but it appears that the electric car maker is making sure that it will evolve at an even faster rate in the future. A recent patent, for example, would allow Tesla’s autonomous driving systems to work more efficiently, thanks to a new data pipeline focused on optimized image processing.

Tesla’s patent for “Data Pipeline and Deep Learning System for Autonomous Driving” was published on December 26. The idea behind the patent is to revolutionize and improve upon past deep learning systems that have been used for autonomous driving vehicles. In the past, these systems have used “captured sensor data” to retrieve information.

Tesla recognizes the need for new sensors when data becomes more complex. According to the electric car maker’s patent, there is “a need for a customized data pipeline that can maximize the signal information from the captured sensor data and provide a higher level of signal information to the deep learning network for deep learning analysis.”

(Credit: Tesla)

The system described in this patent would capture an image using any of the sensors or cameras on the vehicle. In this case, this would describe a high dynamic range camera, camera sensor, radar sensor, or ultrasonic sensor. The image would then be broken down through a “high-pass” or ‘lo-pass” filter and a series of processors would then decipher what the image means.

The flowchart below describes what the process of the vehicle learning the information would look like. “Receive Sensor Data” is the first portion of this process. Then, data will be broken down and pre-processed for the system to then begin its “Deep Learning Analysis.” The results will then be passed along to the vehicle’s Artificial Intelligence Processor to be utilized during vehicle control.

Advertisement
Credit: U.S. Patent Office/Tesla

In another process, the series of information that is retrieved from these images will be compared to data compiled from other Tesla users on a global scale. This will alleviate concerns that drivers may have that the system could perform the wrong process when driving autonomously. The aim of the patent is to create a safe driving experience and improve upon the already solid performance of Tesla’s autonomous driving software, and do so in a process that is more efficient than before.

By using this process, Tesla is able to maintain as much resolution as possible from the images captured by its vehicles’ cameras and sensors. This then allows the Neural Network to more efficiently learn from the data packets that it is receiving. This allows the Neural Network to work with better images in a more efficient manner as well, which opens the doors to faster autonomous driving improvements. These efficiencies would work very well with the additional horsepower offered by Tesla’s Hardware 3 computer, which is specifically designed for full self-driving with built-in redundancies.

Building upon the foundation that Tesla has already laid down in terms of its Full Self Driving suite, the recent patent suggests that the company is now attempting to narrow down on the finer points of its software’s performance. The addition of this patent will not only create a safer driving experience for owners of Tesla vehicles but will bring the quickly approaching future of fully-autonomous vehicles even closer to completion.

The full text of Tesla’s new data pipeline and deep learning patent could be viewed here.

Advertisement

Joey has been a journalist covering electric mobility at TESLARATI since August 2019. In his spare time, Joey is playing golf, watching MMA, or cheering on any of his favorite sports teams, including the Baltimore Ravens and Orioles, Miami Heat, Washington Capitals, and Penn State Nittany Lions. You can get in touch with joey at joey@teslarati.com. He is also on X @KlenderJoey. If you're looking for great Tesla accessories, check out shop.teslarati.com

Advertisement
Comments

Elon Musk

Tesla Phone? Not quite, but close: analyst

Published

on

elon musk phone
Photo: Boss Hunting.com.au

For years, there have been images and videos across social media platforms that have reminded me of when I was a 15-year-old kid teased by “Xbox 720” videos on YouTube. These videos are of the supposed “Tesla Phone” that Elon Musk was secretly developing in between leading Tesla with its electric cars and SpaceX with its reusable rockets.

Although Musk has put those rumors to bed several times, it was never completely out of the realm that he could get involved in cell phones in some capacity. Think outside the box and more macro-level, though. Instead of reinventing the computer, Musk reinvented connectivity by developing Starlink with SpaceX.

It could be something similar, TD Cowen analyst Gregory Williams said in a note last week, where he hinted SpaceX could be gathering some steam to acquire T-Mobile.

Williams said it would be the “clear choice” for SpaceX if it decided to go through with a network acquisition. He also suggested AT&T.

The move would be possible through selling more of its own stock, which would help SpaceX raise the money to purchase T-Mobile, which would cost roughly $300 billion. It could be one of the moves SpaceX makes post-IPO in terms of an acquisition: it already acquired Cursor AI for $60 billion.

Other analysts, like Dan Ives of Wedbush, believe SpaceX and Tesla will eventually merge into one anyway, and that conglomeration could come as soon as this year, some have said.

The implications of SpaceX purchasing T-Mobile are massive. A combined entity would create a truly ubiquitous network: T-Mobile’s terrestrial 5G towers and Starlink’s growing constellation of Direct-to-Cell satellites. This would essentially eliminate dead zones across the U.S. and potentially globally.

SpaceX would instantly become a full-scale facilities-based carrier with satellite differentiation; a huge advantage. This would pressure AT&T and Verizon heavily.

There are also concerns like a potential reduction in long-term competition, and of course, a deal of that size would face intense scrutiny from government agencies.

The strategic fit is compelling due to the existing Starlink–T-Mobile partnership and complementary technologies (space + terrestrial). It could create a dominant integrated communications player. However, the regulatory, financial, and execution hurdles are enormous — this remains highly speculative with no indication SpaceX is actively pursuing it right now.

Continue Reading

News

Tesla reveals huge Cybercab detail in new guide for First Responders

Published

on

Credit: Tesla

Tesla revealed a major new Cybercab detail in a guide it released for First Responders, showing new territory in its beliefs and intentions for the ride-hailing-focused vehicle that entered production in April.

The First Responders Guide is released to give fire departments, paramedics, and other emergency personnel the proper guidance on what to do in the event of an accident, entrapment, or other situation that would require immediate attention.

On one of the pages of the First Responders Guide, Tesla revealed a stark detail about the Cybercab, which could help personnel enter the vehicle more easily in case of an emergency.

Tesla Cybercab has one important piece that AI4 cars might need for FSD

It shows Tesla has no intention of releasing any Cybercab units that were initially proposed for ride-hailing services for the general public with any manual controls, meaning a steering wheel or pedals:

“A Cybercab equipped with steering wheel, brake pedal, and an acceleration pedal is typically an engineering or test vehicle, and operates at SAE Level 2 autonomy. Cybercab is not typically equipped with a steering wheel or acceleration and brake pedals.”

This is a major development for those who continue to believe Tesla planned to release the Cybercab with any sort of manual controls so that passengers could take over if needed. However, when Tesla started manufacturing production versions of the Cybercab in Giga Texas earlier this year, they were spotted without a steering wheel or pedals.

It essentially confirms the company has no intentions of bringing manual controls to the car’s production versions. Some have argued that the likelihood of Tesla having something

There still are some Cybercab units out there with a steering wheel and pedals, and as Tesla said, these cars are engineering or test vehicles, which have Safety Monitors on board to help the car out of a precarious situation or emergency.

Continue Reading

News

Tesla Full Self-Driving v14 ‘Lite’ Release Notes: new capabilities and features

Published

on

(Credit: Megan Gale/Twitter)

Tesla released the Full Self-Driving v14 ‘Lite’ suite to owners of Hardware 3 or AI3 vehicles today, adding several new features to the vehicles that were once believed to be capable of unsupervised self-driving.

Now, Tesla has released this modified suite to older Tesla vehicles, adding plenty of new features and capabilities.

Here are the full release notes for the suite:

  • Distilled the intelligence from HW4 V14 into HW3. This allows HW3 to directly learn how to handle scenarios using HW4 V14 as a guide. This process unlocks the improvements that have been made to HW4 including Reinforcement Learning (RL) and offline models for HW3.
  • Improved both proactive and reactive responsiveness across a wide variety of categories including navigation handling, merges and forks, pedestrian interactions, traffic lights, and vehicle cut-in scenarios.
  • Improved general comfort in nominal scenarios through fewer false slowdowns, smoother steering and more consistent lane centering.
  • Introduced parking, unparking, and reversing capabilities.
  • Added Arrival Options for you to select where FSD should park: in a Parking Lot, on the Street, in a Driveway, or at the Curbside.
  • Speed Profiles are now available at all times, to further customize driving style preference.

These improvements, according to Tesla’s Head of AI, Ashok Elluswamy, help distill the driving behavior from AI4’s v14 series into both the camera and compute configurations of AI3.

Tesla Full Self-Driving v14 ‘Lite’ for older cars finally gets released

He added:

“It includes destination options and speed profiles on city roads, but more importantly significantly improved safety. We hope you’ll enjoy it, once the build ships wide.”

Tesla will continue to roll out the v14 Lite suite more widely in the coming weeks, the company said.

Continue Reading