Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.
“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.
Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.
In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.
The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.
“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.
The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.
“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.
The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.
Tesla’s “Estimating object properties using visual image data” patent could be accessed below.
Vision Only Patent by Maria Merano on Scribd
The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.
News
Starlink gets its latest airline adoptee for stable and reliable internet access
The company said it plans to “rapidly integrate Starlink into its fleet,” and that the first Starlink-equipped aircraft will enter service this Summer.
SpaceX’s Starlink, the satellite internet program launched by Elon Musk’s company, has gotten its latest airline adoptee, offering stable and reliable internet to passengers.
Southwest Airlines announced on Wednesday that it would enable Starlink on its aircraft, a new strategy that will expand to more than 300 planes by the end of the year.
The company said it plans to “rapidly integrate Starlink into its fleet,” and that the first Starlink-equipped aircraft will enter service this Summer.
Tony Roach, Executive Vice President, Chief Customer and Brand Officer for the airline, said:
“Free WiFi has been a huge hit with our Rapid Rewards Members, and we know our Customers expect seamless connectivity across all their devices when they travel. Starlink delivers that at-home experience in the air, giving Customers the ability to stream their favorite shows from any platform, watch live sports, download music, play games, work, and connect with loved ones from takeoff to landing.”
Southwest also said that this is just one of the latest upgrades it is making to provide a more well-rounded experience to its aircraft. In addition to Starlink, it is updating cabin designs, offering more legroom, and installing in-seat power to all passengers.
Southwest became one of several airlines to cross over to Starlink, as reviews for the internet provider have raved about reliability and speed. Over the past year, Hawaiian Airlines, United Airlines, Alaska Airlines, airBaltic, Air France, JSX, Emirates, British Airways, and others have all decided to install Starlink on their planes.
This has been a major move away from unpredictable and commonly unreliable WiFi offerings on planes. Starlink has been more reliable and has provided more stable connections for those using their travel time for leisure or business.
Jason Fritch, VP of Starlink Enterprise Sales at SpaceX, said:
“We’re thrilled to deliver a connectivity experience to Southwest Airlines and its Customers that really is similar, if not better, than what you can experience in your own home. Starlink is the future of connected travel, making every journey faster, smoother, and infinitely more enjoyable.”
Starlink recently crossed a massive milestone of over 10 million subscribers.
Elon Musk
Tesla nears closure of Full Self-Driving purchasing option
The move to bring FSD to this type of purchasing program comes after CEO Elon Musk noted in January that Tesla would move away from the outright purchase option.
Tesla is nearing the closure of its Full Self-Driving outright purchasing option, which will be removed on February 14, meaning Saturday will be the last time it can be bought as a non-subscription.
Tesla is aiming to move its Full Self-Driving suite to a subscription-only platform, a move that will enable people to only pay monthly for the semi-autonomous driving functionality.
The move to bring FSD to this type of purchasing program comes after CEO Elon Musk noted in January that Tesla would move away from the outright purchase option.
It is currently priced at $8,000 for the outright option to use Full Self-Driving, a substantial decrease compared to the $15,000 it was priced at one time. For the monthly subscription, it is just $99 per month, but that price will change, likely increasing as things get more advanced.
Tesla is overhauling its Full Self-Driving subscription for easier access
We say it will likely increase because there is no indication of how Tesla will price FSD. There has been some speculation that Tesla could utilize a tiered system to price FSD, which would potentially allow owners to pick and choose a set of features that would be most ideal for them.
This would potentially introduce an even more affordable option for FSD use, but this is unconfirmed. The reason many say this could be an option for Tesla is the fact that if the price goes up further, the take rate, which is currently around 12 percent at its most recent estimate, could be lower.
Musk needs 10 million active Full Self-Driving subscriptions to unlock one of the tranches of his newest compensation package.
The move to a subscription-only platform has its positives and negatives, and owners have been more than vocal about these since Musk confirmed the move.
Positives
- Lower barrier to entry and higher potential adoption
- Financially better for many users
- Easier transfers and brand loyalty
- Predictable recurring revenue for Tesla
- Access to the latest features
Negatives
- Higher long-term cost for loyal/long-term owners
- No true “ownership” or permanence
- Risk of future price hikes or even deactivation
- Perceived as of less value
- Impact on resale and used market
Overall, there is a split among the Tesla community in terms of what they see as the “right” way to handle this. Tesla is likely to shed more details on what its plans for the subscription-only platform will be, including pricing, in the coming weeks.
Elon Musk
Elon Musk’s Boring Company selected for Universal Orlando tunnel project
The underground transport tunnel is designed to address the persistent gridlock surrounding International Drive.
Elon Musk’s The Boring Company has been selected for a proposed underground transit system connecting Universal Orlando Resort and the newly opened Universal Epic Universe.
The underground transport tunnel is designed to address the persistent gridlock surrounding International Drive.
As noted in a blooloop report, Universal’s Shingle Creek Transit and Utility Community Development District approved a resolution showing its intent to designate The Boring Company as the contractor for the project.
The agreement covers the full scope of the project, from the tunnel’s design, construction, and maintenance. The project has also been described in public documents as a “point-to-point innovative transportation” initiative with a 25-year agreement.
The proposed Boring Company tunnels would directly link Universal’s existing parks with Epic Universe, which sits roughly three miles away from Universal Orlando Resort. Today, buses are the only direct connection between the two destinations.
Project requirements were quite stringent. Bidders were required to demonstrate at least $75 million in bonding capacity, have a minimum of seven years of operational experience, and show prior delivery of a comparable project valued at $25 million or more within the past 15 years. The Boring Company, thanks in no small part to the Vegas Loop, meets these requirements.
The Orlando selection adds to The Boring Company’s growing portfolio of Loop-style systems. In Las Vegas, the Las Vegas Convention Center Loop has transported more than two million passengers in Tesla vehicles through underground tunnels since 2021. The greater Vegas Loop system is also under construction.
For now, residents in the area seem enthusiastic about the upcoming project. In a comment to Fox35, residents noted that the tunnels could improve traffic in the area.
“We are very congested at certain times and certain hours and that would certainly help with people not having to budget their time,” Mary Walters-Clark, a resident, stated. Another resident, Scott Heinz, echoed similar sentiments. “I think it would be a new opportunity to lessen traffic load and good for visitors as well,” he said.
The tunneling startup has started bringing its Loop projects to international locations. It recently signed a memorandum of understanding with Dubai’s Roads and Transport Authority to explore the development of a 17-kilometer underground Loop network beneath Dubai.
Starlink gets its latest airline adoptee for stable and reliable internet access
Tesla nears closure of Full Self-Driving purchasing option
