Connect with us

News

Tesla’s new patent shows path to Elon Musk’s pure vision FSD approach

Credit: Andres GE

Published

on

Tesla received a new patent last week for “estimating object properties using visual image data.” Elon Musk estimated that Tesla would release a version of FSD Beta in April. At the time, he also mentioned that Tesla was going for pure vision and suggested that it would not even use radar sensors in the future.

“According to their patent, this invention aims to address the increasing cost and complexity of vision sensors for mass-market autonomous vehicles. This method enables a vehicle to detect and interpret the distance to its surroundings using the vehicle’s image data and machine learning,” explained law firm Founders Legal to Teslarati.

Tesla’s patent describes an invention using two neural networks to gauge the distances of objects using only image data. The first neural network can determine the distance of objects from images captured by the cameras around a vehicle. The other neural network creates training material in the form of annotated images for the first neural network.

In the patent, Tesla states that there is a need to find the right amount of sensors to put on an autonomous vehicle without limiting the amount of data it can capture and process. Tesla states that vision sensors, like radar, lidar, and ultrasonic sensors, can become too costly to put in a mass market vehicle and increase the “input bandwidth requirements” for an autonomous driving system.

The patent describes a configuration with a good balance of sensors and cameras to determine the distances of objects around a vehicle. This should allow Tesla to employ a system that could perform at a level comparable to industry leaders while keeping costs as low as possible.

“As the number and types of sensors increases, so does the complexity and cost of the system. For example, emitting distance sensors such as lidar are often costly to include in a mass market vehicle. Moreover, each additional sensor increases the input bandwidth requirements for the autonomous driving system. Therefore, there exists a need to find the optimal configuration of sensors on a vehicle. The configuration should limit the total number of sensors without limiting the amount and type of data captured to accurately describe the surrounding environment and safely control the vehicle,” Tesla wrote.

Advertisement
-

The patent also provides Tesla with a way to automatically label vision data. Considering that labeling is one of the most time-consuming part of Tesla’s FSD development, such a system would likely accelerate the development and release of updates and improvements to the company’s Full Self-Driving and Autopilot suites.

“In various embodiments, the collection and association of auxiliary data with vision data is done automatically and requires little, if any, human intervention. For example, objects identified using vision techniques do not need to be manually labeled, significantly improving the efficiency of machine learning training. Instead, the training data can be automatically generated and used to train a machine learning model to predict object properties with a high degree of accuracy,” Tesla wrote.

The configuration described in Tesla’s patent should significantly improve its Full Self-Driving (FSD) technology. It may reduced Tesla’s reliance on sensors and increase the amount of data that can be extracted from images to improve FSD Beta. Tesla’s image-based approach to FSD differs considerably from its competitors like Waymo but has yielded some rather impressive results based on some FSD Beta users’ experiences thus far.

Tesla’s “Estimating object properties using visual image data” patent could be accessed below.

Vision Only Patent by Maria Merano on Scribd

The Teslarati team would appreciate hearing from you. If you have any tips, email us at tips@teslarati.com or reach out to me at maria@teslarati.com.

Advertisement
-

Maria--aka "M"-- is an experienced writer and book editor. She's written about several topics including health, tech, and politics. As a book editor, she's worked with authors who write Sci-Fi, Romance, and Dark Fantasy. M loves hearing from TESLARATI readers. If you have any tips or article ideas, contact her at maria@teslarati.com or via X, @Writer_01001101.

Advertisement
Comments

Elon Musk

Nvidia’s board meets on Jensen Huang, and Elon Musk already has an answer

Elon Musk says it would be an honor to hire Jensen Huang amid Nvidia turmoil.

Published

on

By

Elon Musk says he would welcome Jensen Huang at one of his companies if Nvidia’s board decides to push out its longtime chief executive.

On Wednesday evening, the financial account ZeroHedge posted “Elon please hire Jensen” on X. Musk replied roughly two hours later: “That would be an honor.” Neither Huang nor Nvidia had responded publicly as of Wednesday night.

Musk’s reply came as Nvidia’s board met to decide Huang’s future. The Wall Street Journal reported that directors were preparing to oust him following reports of two extramarital relationships. One involves Alice Huang, a Singapore-based businesswoman whom U.S. intelligence officials reportedly believe was working for China’s Ministry of State Security. The New York Times separately reported a relationship with Kimberly Powell, Nvidia’s vice president of health care. Huang acknowledged being unfaithful in a memo to employees on Sunday but gave no details.


Under Nvidia’s bylaws, a majority of its 11 directors can remove the CEO with or without cause. Bloomberg reported that the board has been working with an outside firm on possible replacements and may name an interim chief, with CFO Colette Kress seen as the likely pick. Nvidia shares fell more than 8 percent in extended trading, according to CNBC, and the company is scheduled to report quarterly earnings on November 17.

Musk has more riding on Nvidia’s leadership than most tech executives. In August, he told investors on SpaceX’s first earnings call as a public company that it would build its AI infrastructure exclusively on Nvidia hardware, calling Vera Rubin “the best architecture.” SpaceX is also working with Nvidia on the compute payload for Starmind, its planned orbital AI constellation. In October, SpaceX said it had a binding commitment for a roughly $40 billion lease of Vera Rubin GPUs and related equipment, with the leases expected to begin in the first half of 2027.

The scale of that dependence is already enormous. On its Q3 call, SpaceX said it was bringing roughly 200,000 to 220,000 Nvidia GB300 GPUs online each month and expects 2.5 to 3 GW of nameplate compute by the end of the year. That buildout is now reaching new sites like the proposed $24 billion power plant and supercomputer campus at Starbase.

The relationship between the two executives also goes back nearly a decade. Huang has often told the story of personally delivering Nvidia’s first DGX-1 AI supercomputer to Musk in 2016, when no other customer wanted one. “Nobody wanted to be part of it, except for Elon,” Huang said on the Joe Rogan Experience last December.

Musk did not say what role Huang might fill, and his reply stops short of a formal offer. Huang co-founded Nvidia in 1993 and still owns about 3.6 percent of its stock, so any move to a Musk company would depend on whether, and how, he leaves the chipmaker he has run for more than three decades.

Continue Reading

News

Starlink Mini 2 arrives with one feature for true off-grid connectivity

Published

on

Credit: SpaceX

SpaceX officially launched the Starlink Mini 2 on November 10, delivering the first portable Starlink terminal designed around independent power.

Invitation-only preorders for select U.S. customers are priced at $999 plus tax, a figure that includes a full year of Roam Unlimited service valued at roughly $2,100. A refundable $100 deposit reserves the kit, with the balance due at shipment, expected to begin in mid-December. Broader availability is listed as coming soon.

The headline feature is the quick-swap 71 Wh battery. Clipped to the rear of the dish without tools, it delivers up to 4.5 hours of connectivity on a single charge.

The 490-gram pack includes its own USB-C port and LED indicators, so users can charge a spare separately and swap it in seconds while staying online. Starlink notes that the terminal can continue operating while the battery charges or run directly from a 60 W USB-C source. The retail box includes one battery, a 60 W USB-C charger, and a 3-meter cable.

Beyond power, the Mini 2 is thinner at 23.1 mm (versus 38.5 mm on the original Mini) while measuring 263 × 314 mm. With the battery and kickstand attached it weighs 1.6 kg.

Built-in Wi-Fi 6 expands coverage to up to 1,800 square feet, an IP67 rating protects against dust and water, and a standard 1/4-20 tripod thread plus physical power button round out the design. Field of view remains 110 degrees, and the unit retains support for mobile use.

For travelers, campers, and remote workers, the swappable battery removes the longstanding requirement for an external power bank or vehicle outlet that defined the first Mini. Spare packs sold separately further extend runtime, turning the compact terminal into a more self-contained solution.

While the bundled $999 invitation price sits well above the original Mini’s current $149 starting point, the included year of service and genuine untethered operation mark a clear step forward in portable satellite internet.

Continue Reading

Elon Musk

SpaceX’s $24B Starbase supercomputer plan slipped past a key roadblock

SpaceX wants a Starbase tax break for a $24 billion gas plant and supercomputer campus.

Published

on

By

Concept rendering of SpaceX President Gwynne Shotwell overlooks the company’s Hawthorne, California headquarters as an American flag flies over the campus at sunset.

SpaceX is asking its own company town for a tax break on a $24 billion natural gas power plant and supercomputing facility at Starbase, Texas, and the land it picked sits just outside the reach of a data center moratorium that took effect in neighboring Brownsville last week.

A City of Starbase public hearing notice says SpaceX “proposes to construct, own, and operate a gas-fired power plant and super-compute facility” on roughly 444 acres between Boca Chica Boulevard and the Port of Brownsville. The $24 billion figure covers only the initial phases, and the notice leaves room for future expansions. The Starbase City Commission will consider a property tax abatement and a related economic development agreement at a 7 p.m. hearing on December 9. The notice does not disclose the size or length of the abatement, or how much computing capacity the site would hold.

The location has a history. Over the summer, SpaceX asked Brownsville to remove the tract from its city limits and offered $220 million for water and wastewater projects in return. Brownsville approved the move in August, and Starbase later annexed the land. Brownsville’s own 90-day pause on data center applications took effect last week, and had the tract stayed inside the city, the project likely would have needed a different home.

The power side is already in front of state regulators. SpaceX has applied to the Texas Commission on Environmental Quality for air permits covering 35 mobile gas turbines producing roughly 750 megawatts, according to Politico, which also noted that two of the three Starbase commissioners voting on the incentives are SpaceX executives.

Building its own plant lets SpaceX skip the Texas grid. Gov. Greg Abbott paused new data center grid connections in August pending an audit, but a facility that generates its own electricity does not need one. The air permit still has to clear the TCEQ, where Abbott also ordered a halt on data center permits.

Advertisement
-

The bigger test arrives in January. Governor-elect Gina Hinojosa, who unseated Abbott last week, has said she will block data center approvals until the legislature passes new protections, and she has already asked state officials to hold off on any sale of Boca Chica State Park to SpaceX until she is sworn in. Tesla and SpaceX shares both fell the day after the election, and Musk’s first reaction on X was “Data centers in space looking pretty appealing right now.”

That line points to Starmind, SpaceX’s orbital compute constellation. Musk has said terrestrial compute will be “peanuts compared to orbital compute” and expects monthly orbital deployments to pass ground deployments around the end of 2028, as Teslarati reported. Until then, SpaceX still needs gigawatts on the ground. It ended the third quarter with 1.7 GW of nameplate compute, is targeting 2.5 to 3 GW by the end of this year and wants at least 10 GW more in 2027. Its existing Colossus sites around Memphis already run on gas turbines and face a lawsuit from residents over emissions.

Local reaction is split. The South Texas Environmental Justice Network has announced a protest, citing air quality, water use and energy bills, while some Brownsville residents told the Tribune they welcome the jobs. SpaceX did not respond to the Tribune’s questions about the project.

Continue Reading