Connect with us

News

Google’s DeepMind unit develops AI that predicts 3D layouts from partial images

[Credit: Google DeepMind]

Published

on

Google’s DeepMind unit, the same division that created AlphaGo, an AI that outplayed the best Go player in the world, has created a neural network capable of rendering an accurate 3D environment from just a few still images, filling in the gaps with an AI form of perceptual intuition.

According to Google’s official DeepMind blog, the goal of its recent AI project is to make neural networks easier and simpler to train. Today’s most advanced AI-powered visual recognition systems are trained through the use of large datasets comprised of images that are human-annotated. This makes training a very tedious, lengthy, and expensive process, as every aspect of every object in each scene in the dataset has to be labeled by a person.

The DeepMind team’s new AI, dubbed the Generative Query Network (GQN) is designed to remove this dependency on human-annotated data, as the GQN is designed to infer a space’s three-dimensional layout and features despite being provided with only partial images of a space.

Similar to babies and animals, DeepMind’s GQN learns by making observations of the world around it. By doing so, DeepMind’s new AI learns about plausible scenes and their geometrical properties even without human labeling. The GQN is comprised of two parts — a representation network that produces a vector describing a scene and a generation network that “imagines” the scene from a previously unobserved viewpoint. So far, the results of DeepMind’s training for the AI have been encouraging, with the GQN being able to create representations of objects and rooms based on just a single image.

As noted by the DeepMind team, however, the training methods that have been used for the development of the GQN are still limited compared to traditional computer vision techniques. The AI creators, however, remain optimistic that as new sources of data become available and as improvements in hardware get introduced, the applications for the GQN framework could move over to higher-resolution images of real-world scenes. Ultimately, the DeepMind team believes that the GQN could be a useful system in technologies such as augmented reality and self-driving vehicles by giving them a form of perceptual intuition – extremely desirable for companies focused on autonomy, like Tesla.

Google DeepMind’s GQN AI in action. [Credit: Google DeepMind]

In a talk at Train AI 2018 last May, Tesla’s head of AI Andrej Karpathy discussed the challenges involved in training the company’s Autopilot system. Tesla trains Autopilot by feeding the system with massive data sets from the company’s fleet of vehicles. This data is collected through means such as Shadow Mode, which allows the company to gather statistical data to show false positives and false negatives of Autopilot software.

During his talk, Karpathy discussed how features such as blinker detection become challenging for Tesla’s neural network to learn, considering that vehicles on the road have their turn signals off most of the time and blinkers have a high variability from one car brand to another. Karpathy also discussed how Tesla has transitioned a huge portion of its AI team to labeling roles, doing the human annotation that Google DeepMind explicitly wants to avoid with the GQN. 

Advertisement
-

Musk also mentioned that its upcoming all-electric supercar — the next-generation Tesla Roadster — would feature an “Augmented Mode” that would enhance drivers’ capability to operate the high-performance vehicle. With Tesla’s flagship supercar seemingly set on embracing AR technology, the emergence of new techniques for training AI such as Google DeepMind’s GQN would be a perfect fit for the next generation of vehicles about to enter the automotive market.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla exec hints at a wild fix for Robotaxi’s biggest weather problem

Tesla VP Lars Moravy says focused lasers could keep robotaxi cameras clear instead of wipers.

Published

on

By

Tesla Cybercab in a rainy Austin, Texas rendering

Tesla may one day use lasers instead of wiper blades to keep its robotaxi cameras clear. Lars Moravy, Tesla’s Vice President of Vehicle Engineering, floated the idea in a new episode of Jay Leno’s Garage released Monday, where he and design chief Franz von Holzhausen walked Leno through the Model Y L.

“If you fire them in a focused area, you can clean the sheet of water and create a barrier,” Moravy said. “When you think about autonomy, it might be a good solution to only clean the area where the camera is.” He added that clearing an entire windshield would take too many lasers to be practical.

The comment brings back one of Tesla’s stranger patents. The company filed for “Pulsed Laser Cleaning of Debris Accumulated on Glass Articles in Vehicles and Photovoltaic Assemblies” in May 2019, and the U.S. Patent Office granted it in September 2021. An updated divisional version was granted on March 31, 2026. The system detects debris on the glass, identifies what it is, and pulses the laser at a calibrated rate so the beam never penetrates deeper than the glass itself. The filing names windshields, side windows, camera lenses and solar panels as possible targets.

Lasers were once rumored for the Cybertruck, which appeared at its November 2019 unveiling with no wipers at all. Tesla eventually settled on a single oversized blade, and Elon Musk admitted the wiper was the part of the truck that troubled him the most. That production line is now scheduled to shut down around mid 2027 to make room for more Cybercab output.

Advertisement
-

What has changed since then is who is in the vehicle. A privately owned car has a driver who can notice a smeared windshield and do something about it. A Cybercab heading to its next pickup has nobody on board to check. Tesla has been chipping away at that problem with conventional hardware. Model Y Robotaxis in Austin were spotted with washers on their side repeater cameras in January, and a lens cleaning patent granted in May describes a fluid and wiper assembly for vehicle cameras and Optimus’ eyes. A laser would remove the fluid and the blades, both of which need regular replacement across a fleet.

The same episode gave Leno his first ride on Full Self-Driving (Supervised). The Model Y L pulled over on its own when an ambulance approached with its sirens on. “We got it on self-driving mode! I’m not touching anything,” Leno said. Moravy and von Holzhausen also explained that owners remain responsible while using FSD (Supervised), while Tesla takes responsibility for Robotaxi rides because it acts as the operator. Tesla launched the Model Y L in the U.S. in July at $61,990.

Moravy gave no timeline, and he described the laser setup as something Tesla is considering rather than a confirmed feature. The fleet it would serve keeps getting bigger, though. Tesla launched unsupervised Robotaxi service in San Antonio on Monday, its eighth city, and expanded its Austin service area to roughly 443 square miles on the same day. Several of those markets, including Houston, Miami and Tampa, see heavy seasonal rain.

Continue Reading

News

Tesla Robotaxi enters its newest city, reaching San Antonio

Published

on

Credit: @AdanGuajardo/X

Tesla launched unsupervised Robotaxi service in San Antonio, Texas, on November 9, 2026, with the first rides beginning at 5 a.m. local time.

The company’s official Robotaxi account on X posted the announcement just after midnight, sharing a map that outlines a large operational zone covering much of the city. The geofence is roughly 274 to 275 square miles, making it Tesla’s largest day-one Robotaxi service area to date.

The zone centers on downtown, covers nearly everything inside Loop 410, and extends north to Loop 1604 between Interstate 10 and U.S. 281, with further reach west past State Highway 151, east beyond I-35, and south toward I-37. This area encompasses about one million residents and hundreds of thousands of jobs.

San Antonio International Airport lies inside the geofence, though Tesla is not currently offering airport pickups or drop-offs. This hopefully will happen soon, as ride-sharing to and from the airport can be expensive.

The launch makes San Antonio Tesla’s eighth unsupervised Robotaxi city and its fifth in Texas, joining Austin, Houston, Dallas, and Fort Worth. Florida markets in Miami, Orlando, and Tampa are also live.

Service uses modified Model Y vehicles operating without a safety driver in the vehicle, consistent with recent unsupervised expansions. Cybercab two-seaters remain limited primarily to Austin for now. It’s worth noting that Dept. of Transportation officials in Texas have already ok’d the Cybercab’s operation in Austin, and one official called it “a tangible example of how quickly our transportation system is evolving.”

San Antonio was previously listed among near-term targets in Tesla’s October 2026 Robotaxi safety materials, alongside Las Vegas, Phoenix, and Jacksonville. The rapid Texas rollout follows Fort Worth’s unsupervised debut on November 2 and builds on Austin’s original launch in June 2025.

The 274-square-mile debut remains substantially larger than Waymo’s local footprint and marks continued progress in Tesla’s unsupervised autonomy efforts after starting the year with no such rides. The company has stated ambitions for broader 24/7 operations by the end of 2026 as vehicle counts and software reliability improve.

Continue Reading

Energy

Tesla begins groundworks on $10B ‘Project Crystal Sun’ in Texas

Published

on

Elon Musk stands in profile against a clear blue sky, with a bright overhead sun shining above a vast landscape of Tesla solar panels stretching to the horizon, and a smaller Texas flag flying on a pole to his right.

Tesla has started to perform earthworks engineering on the roughly 3,000-acre site in Fort Bend County, Texas, advancing the massive $10 billion Project Crystal Sun plan to build a vertically integrated solar manufacturing complex.

Flyover drone footage from S.E. Robinson, Jr. released this morning shows the location under development. Tesla has crews on site performing large clearings, but you can also see equipment staging areas, the use of an existing homestead, and active leveling across a substantial portion of the property.

Public filings first submitted in July under Texas’s Jobs, Energy, Technology and Innovation Act describe a plant that would manufacture the full solar chain: everything from silicon ingots, wafers, coated cells, and finished modules.

Tesla projects 9,712 permanent jobs by 2033, ramping from roughly 1,900 positions in the first year of operations, plus a peak of about 1,147 construction jobs. Construction is targeted for 2026–2028, with commercial production beginning in the first quarter of 2029. An accompanying economic analysis estimates the project could add roughly $107 billion to Texas GDP over several decades.

Local incentives have cleared major hurdles. Lamar Consolidated Independent School District unanimously approved school-tax limitations in September, and Fort Bend County commissioners approved a package of abatements and related agreements in late October that could extend equipment tax breaks for as long as 35 years.

Tesla had previously indicated it was evaluating a competing out-of-state location.

The effort fits broader statements by Musk that Tesla and SpaceX are each working toward 100 gigawatts of annual U.S. solar manufacturing capacity. If built as described, Project Crystal Sun would stand as one of the largest domestic attempts to create a fully integrated solar supply chain on American soil.

While Tesla has not issued a formal groundbreaking announcement, the visible site preparation and high-profile social media activity represent a concrete step forward for a project that has moved from confidential filings to active earthworks in a matter of months.

Continue Reading