Connect with us

News

Google’s DeepMind unit develops AI that predicts 3D layouts from partial images

[Credit: Google DeepMind]

Published

8 years ago

on

Google’s DeepMind unit, the same division that created AlphaGo, an AI that outplayed the best Go player in the world, has created a neural network capable of rendering an accurate 3D environment from just a few still images, filling in the gaps with an AI form of perceptual intuition.

According to Google’s official DeepMind blog, the goal of its recent AI project is to make neural networks easier and simpler to train. Today’s most advanced AI-powered visual recognition systems are trained through the use of large datasets comprised of images that are human-annotated. This makes training a very tedious, lengthy, and expensive process, as every aspect of every object in each scene in the dataset has to be labeled by a person.

The DeepMind team’s new AI, dubbed the Generative Query Network (GQN) is designed to remove this dependency on human-annotated data, as the GQN is designed to infer a space’s three-dimensional layout and features despite being provided with only partial images of a space.

Similar to babies and animals, DeepMind’s GQN learns by making observations of the world around it. By doing so, DeepMind’s new AI learns about plausible scenes and their geometrical properties even without human labeling. The GQN is comprised of two parts — a representation network that produces a vector describing a scene and a generation network that “imagines” the scene from a previously unobserved viewpoint. So far, the results of DeepMind’s training for the AI have been encouraging, with the GQN being able to create representations of objects and rooms based on just a single image.

Advertisement

As noted by the DeepMind team, however, the training methods that have been used for the development of the GQN are still limited compared to traditional computer vision techniques. The AI creators, however, remain optimistic that as new sources of data become available and as improvements in hardware get introduced, the applications for the GQN framework could move over to higher-resolution images of real-world scenes. Ultimately, the DeepMind team believes that the GQN could be a useful system in technologies such as augmented reality and self-driving vehicles by giving them a form of perceptual intuition – extremely desirable for companies focused on autonomy, like Tesla.

Google DeepMind’s GQN AI in action. [Credit: Google DeepMind]

In a talk at Train AI 2018 last May, Tesla’s head of AI Andrej Karpathy discussed the challenges involved in training the company’s Autopilot system. Tesla trains Autopilot by feeding the system with massive data sets from the company’s fleet of vehicles. This data is collected through means such as Shadow Mode, which allows the company to gather statistical data to show false positives and false negatives of Autopilot software.

During his talk, Karpathy discussed how features such as blinker detection become challenging for Tesla’s neural network to learn, considering that vehicles on the road have their turn signals off most of the time and blinkers have a high variability from one car brand to another. Karpathy also discussed how Tesla has transitioned a huge portion of its AI team to labeling roles, doing the human annotation that Google DeepMind explicitly wants to avoid with the GQN. 

Musk also mentioned that its upcoming all-electric supercar — the next-generation Tesla Roadster — would feature an “Augmented Mode” that would enhance drivers’ capability to operate the high-performance vehicle. With Tesla’s flagship supercar seemingly set on embracing AR technology, the emergence of new techniques for training AI such as Google DeepMind’s GQN would be a perfect fit for the next generation of vehicles about to enter the automotive market.

Advertisement
Related Topics:

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Tesla improves Dashcam playback with awesome addition

Published

3 hours ago

on

June 2, 2026

By

Image Credit: The Kilowatts/Twitter

Tesla has improved Dashcam playback with an awesome new addition, as the company has launched a web-based version that is potentially easier to navigate and operate.

The tool is available at dashcam.tesla.com and will be enabled as your vehicle receives the 2026.20 Software Version. Clips that are captured by your Tesla will be available on the Online Dashcam Clip Viewer once the files on your car’s storage drive are encrypted.

Not a Tesla App first noticed the new feature, and states that once your Tesla updates to 2026.20, the car will automatically protect the clips with an encryption key that is uniquely tied to your owner account.

The web-based viewer should be easier to operate for most. All you will do is head over to dashcam.tesla.com and log in using your account credentials.

Ensure your vehicle is updated to 2026.20 in order for the web-based viewer tool to fetch your vehicle’s saved dashcam clips.

Currently, only a small percentage of owners are updated to this, so it may be a couple of weeks until a majority of owners in the fleet are able to access this feature.

Advertisement

Watching Dashcam clips on the Tesla smartphone app is quick and convenient, as they can also be easily downloaded and stored right on your smartphone.

However, the clips are sometimes tougher to navigate, and in order to get details like self-driving activation, speed, and turn signals, owners have to screen record the Tesla app and crop out the rest of the screen.

It could also be a massive storage saver as you’ll be able to download the Dashcam clips from the online viewer and save them to your laptop, desktop, a flash drive, or even an external hard drive. This will keep all your clips in one place.

Advertisement
Continue Reading

News

Tesla Full Self-Driving attempts 150-mile stress test: the good and the bad

Published

6 hours ago

on

June 2, 2026

By

Credit: TESLARATI

I recently took my Tesla Model Y running Full Self-Driving (Supervised) v14.3.3 over 150 miles on the Pennsylvania Turnpike in an effort to truly put the system under a stress test. There were a lot of good moments, and some bad, but overall, Full Self-Driving impressed me.

Last Thursday, I decided it was time to visit the Flight 93 National Memorial near Shanksville, PA. I go a few times a year, and it was a beautiful day. Others have taken some pretty lengthy drives using FSD, but I haven’t had the opportunity to really do something lengthy in quite a few months on an older version. I decided it was the perfect opportunity to try some things out.

I recorded the entire ride there on a GoPro, edited to highlight the crucial moments, and shared them on our social media accounts. If you want to watch them, I’ll share them throughout the piece, but I did not get to do a real breakdown of what I felt about its performance.

Overall Thoughts

I realize it is probably better to do a summation of its performance toward the end of the piece, but I feel like it is also reasonable to lead with this because I was overly impressed with how well it handled everything. The only moments where I felt a little bit of reason to touch the wheel, at least while traveling on the Turnpike and Rt. 30, were due to other drivers and their behaviors.

Advertisement

I have taken many drives to the Memorial over the past several years, and although it’s not incredibly long, it is a tiring drive. It’s about five hours both ways, close to 300 miles, and I think most of the exhaustion comes from the toll of sitting in the car and then visiting something that is pretty heavy to take in.

This was the first time I’ve ever taken the ride and not felt like I needed to avoid my vehicle after I got home. In the past, I could not even think about driving after I finally arrived at my house, but this was simply different.

It was nice to have something else take the drive for me, while I still had the freedom to take over if I chose to. It made the entire trip more enjoyable.

Full Self-Driving Recognizes Lane-Ending Arrows on Road

After traveling in the fast lane for a little while, FSD noticed the arrows on the road indicating the lane was coming to an end ahead. The car was also in the process of making a pass on a slower vehicle in the middle lane, but aborted this maneuver and backed off to get behind the vehicle.

Advertisement

I was really impressed by this because I thought that the car would absolutely try to make the pass, only to get in front of the other car, and then slow back down to 75 MPH:

Full Self-Driving Notices Veering Tractor Trailer, Adjusts Lane Positioning

My two rules of the road are never cruise in the fast lane and never drive next to a tractor-trailer. This clip is a perfect example as to why.

Advertisement

FSD v14.3.3 recognized this tractor-trailer attempting to change lanes while we were still next to it. The car shifted its lane positioning to the shoulder slightly to make room for the merging semi, executed the pass safely, and on we went.

I will admit this one made me a little nervous, but more so because of the 18-wheeler, and not because of the Tesla:

Advertisement

Full Self-Driving Follows the Rules of Tunnel Travel

Many people who are not familiar with Full Self-Driving and its capabilities are pretty limited in what they know about the really simple things it does well. Part of supervising FSD is being aware of things it might make mistakes with, and anticipating maneuvers it might want to make at the wrong time.

Entering the Blue Mountain Tunnel on the Turnpike, I was ready for FSD to attempt to get back into the right lane after making a pass on a tractor-trailer, but I was pleasantly surprised. Several signs outside the tunnel advise drivers to stay in the lane they’ve chosen while driving through the tunnel; this eliminates the possibility of an accident caused by lane changes, which would impede traffic on a crucial logistics route.

I was happy to see that Tesla Full Self-Driving v14.3.3 did not make this mistake:

Full Self-Driving Navigates Toll Plazas with Ease

I was interested to see how FSD would handle toll plazas, including the speed at which it would travel through them, and whether it would stop on the Turnpike at these booths, which have since been transitioned to a “Toll by Plate” system, which mails you a bill.

It was flawless:

Full Self-Driving Still Struggles with Parking from Time to Time

Since I took delivery in late August, I’ve never had a single instance of my Tesla struggling to park at a Supercharger. Other spots at the mall, market, or gym are another story.

This was the first time it did such a terrible job of backing into a spot. This required me to take over and manually park at another charger:

Full Self-Driving Gets Confused After Arriving at Its Destination

This was the first time I have ever experienced FSD getting confused and just circling the lot. The navigation continued to reroute to try to resolve the issue, but after four laps, I decided it was time to overtake the car’s controls and park manually:

This was a baffling behavior that I truly couldn’t explain. Other owners communicated that they have also experienced this issue.

Final Thoughts

I am so incredibly impressed by FSD that it has really made traveling stress-free. The two issues related to parking were not ideal, but to be fair, I usually take over when arriving at parking lots. However, this shortcoming is something Tesla has to make some serious progress with, because parking has truly stumped FSD at times.

Advertisement

Solving that will be a major breakthrough for autonomy, but Tesla has struggled with it for some time.

All in all, FSD v14.3.3 is unbelievably accurate and handles many of the more stressful maneuvers with ease, one of them being avoiding merging traffic on highways, which was shown above.

Some things that would be great to see improvements on are parking, Speed Profiles, which are relatively tough to adjust (I stayed in Standard for the duration of this drive), and, of course, navigation.

Advertisement
Continue Reading

Elon Musk

SpaceX’s amended S-1 is sparking a major Tesla merger conversation

A single line in SpaceX’s amended S-1 just sent Tesla stock down 5% in one day.

Published

19 hours ago

on

June 1, 2026

By

A single line buried in SpaceX’s amended S-1 filing is doing more to move Tesla’s stock price than anything Tesla itself has announced in months. The clause, disclosed as SpaceX prepares for what could be the largest IPO in Wall Street history, states that the company “may issue a significant amount of equity in connection with future transactions.” While this may be seen as boilerplate language in S-1 filings, the historical ties between SpaceX and Tesla, and with Elon Musk reportedly discussing a possible merger with close colleagues, investors are interpreting it as something closer to a signal.

The concern among institutional investors like Gary Black, managing director of The Future Fund, pointed directly to the amended filing on X, saying it “strongly suggests more SPCX equity will be issued,” which could potentially be used to acquire Tesla. He estimated such a deal could be 28% dilutive to Tesla shareholders since SpaceX would likely command a significantly higher valuation multiple. Black added that institutional investors he knows hate the idea of a combination because they prefer pure plays over conglomerates, which he said “nearly always gravitate to the lowest common multiple.”

The Tesla and SpaceX merger everyone is talking about is quietly building

The bull case runs the math differently. Tesla influencer and retail shareholder advocate AleXandra Merz pushed back on what she called a widespread misunderstanding of how merger-of-equals deals actually work. Rather than simply splitting the difference between two market caps, a merger exchange ratio is negotiated based on relative fair market values, meaning the lower valued company typically sees its stock reprice upward toward the deal value.

Advertisement

Under her model, SpaceX enters at a $2.5 trillion valuation and Tesla at $1.6 trillion, producing a combined entity worth $4.1 trillion split evenly between both shareholder groups. That implies Tesla’s side of the deal would be valued at $2.05 trillion, a gain of roughly $450 billion from its current market cap. She cited Dow-DuPont and CBS-Viacom as historical examples of how markets reprice both companies toward the announced exchange ratio after a deal is unveiled.


The SpaceX S-1 amendments also revealed just how much financial infrastructure already binds the two companies together. As Teslarati has reported, SpaceX purchased $697 million in Tesla Megapacks, $131 million in Cybertrucks, and the two companies have shared supply chain resources, and semiconductor fabrication plans since well before any merger conversation became public. A retail poll by Tesla influencer Sawyer Merritt is finding that 36% of respondents do not plan to buy SpaceX shares at IPO and 15.3% saying their decision depends on the valuation.


Whether the merger happens or not, the amended filing is seemingly moving markets and sharpened a debate that is no longer theoretical. SpaceX is weeks away from trading publicly, and Tesla shareholders are now watching every word of every filing for clues about what Musk plans to do next.

Advertisement
Continue Reading