Connect with us

News

Scientists use AI neural network to translate speech from brain activity

Published

7 years ago

on

Three recently published studies focused on using artificial intelligence (AI) neural networks to generate audio output from brain signals have shown promising results, namely by producing identifiable sounds up to 80% of the time. Participants in the studies first had their brain signals measured while they were either reading aloud or listening to specific words. All the data was then given to a neural network to “learn” how to interpret brain signals after which the final sounds were reconstructed for listeners to identify. These results represent hopeful prospects for the field of brain-computer interfaces (BCIs), where thought-based communication is quickly moving from the realm of science fiction to reality.

The idea of connecting human brains to computers is far from new. In fact, several relevant milestones have been made in recent years including enabling paralyzed individuals to operate tablet computers with their brain waves. Elon Musk has also famously brought attention to the field with Neuralink, his BCI company that essentially hopes to merge human consciousness with the power of the Internet. As brain-computer interface technology expands and develops new ways to foster communication between brains and machines, studies like these, originally highlighted by Science Magazine, will continue demonstrating the steady march of progress.

Functional areas of the human brain. | Credit: Blausen.com staff (2014) via CC BY 3.0.

In the first study conducted by researchers from Columbia University and Hofstra Northwell School of Medicine, both in New York, five epileptic participants had the brain signals from their auditory cortexes recorded as they listened to stories and numbers being read to them. The signal data was provided to a neural network for analysis which then reconstructed audio files that were accurately identified by participating listeners 75% of the time.

In the second study conducted by a team from the University of Bremen (Germany), Maastricht University (Netherlands), Northwestern University (Illinois), and Virginia Commonwealth University (Virginia), brain signal data was gathered from six patients’ speech planning and motor areas while undergoing tumor surgeries. Each patient read specific words aloud to target the data collected. After the brain data and audio data were given to their neural network for training, the program was given brain signals not included in the training set to recreate audio, the result producing words that were recognizable 40% of the time.

Finally, in a third study by a team at the University of California, San Francisco, three participants with epilepsy read text aloud while brain activity was captured from the speech and motor areas of their brains. The audio generated from their neural network’s analysis of the signal readings was presented to a group of 166 people who were asked to identify the sentences from a multiple choice test – some sentences were identified with 80% accuracy.

While the research presented in these studies shows serious progress towards connecting human brains to computers, there are still a few significant hurdles. For one, the way neuron signal patterns in the brain translate into sounds varies from person to person, so neural networks must be trained on each individual person. The best results require the best data possible, i.e., the most precise neuron signals possible, meaning this is something that can only be obtained by placing electrodes in the brain itself. The opportunities to collect data at this invasive level for research are limited, relying on voluntary participation and approval of experiments.

Advertisement

All three of the studies highlighted demonstrated an ability to reconstruct speech based on neural data in some significant capacity; however, also in all cases, the study participants were able to create audible sounds to use with the computer training set. In the case of patients unable to speak, the level of difficultly in interpreting the brain’s speech signals from other signals will be the biggest challenge. Also, the differences between brain signals during actual speech vs. thinking about speech will complicate matters further.

Related Topics:

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
Comments

Elon Musk

Tesla Supercharger Diner food menu gets a sneak peek as construction closes out

What are you ordering at the Tesla Diner?

Published

10 hours ago

on

July 18, 2025

By

Credit: BradGoldbergMD | X

The Tesla Supercharger Diner in Los Angeles is nearing completion as construction appears to be winding down significantly. However, the more minor details, such as what the company will serve at its 50s-style diner for food, are starting to be revealed.

Tesla’s Supercharger Diner is set to open soon, seven years after CEO Elon Musk first drafted the idea in a post on X in 2018. Musk has largely come through on most of what he envisioned for the project: the diner, the massive movie screens, and the intended vibe are all present, thanks to the aerial and ground footage shared on social media.

We already know the Diner will be open 24/7, based on decals placed on the front door of the restaurant that were shared earlier this week. We assume that Tesla Optimus will come into play for these long and uninterrupted hours.

The Tesla Diner is basically finished—here’s what it looks like

As far as the food, Tesla does have an email also printed on the front door of the Diner, but we did not receive any response back (yet) about what cuisine it will be offering. We figured it would be nothing fancy and it would be typical diner staples: burgers, fries, wings, milkshakes, etc.

Advertisement

According to pictures taken by @Tesla_lighting_, which were shared by Not a Tesla App, the food will be just that: quick and affordable meals that diners do well. It’s nothing crazy, just typical staples you’d find at any diner, just with a Tesla twist:

As the food menu is finalized, we will be sure to share any details Tesla provides, including a full list of what will be served and its prices.

Additionally, the entire property appears to be nearing its final construction stages, and it seems it may even be nearing completion. The movie screens are already up and showing videos of things like SpaceX launches.

Advertisement

There are many cars already using the Superchargers at the restaurant, and employees inside the facility look to be putting the finishing touches on the interior.

It’s almost reminiscent of a Tesla version of a Buc-ee’s, a southern staple convenience store that offers much more than a traditional gas station. Of course, Tesla’s version is futuristic and more catered to the company’s image, but the idea is the same.

Advertisement

It’s a one-stop shop for anything you’d need to recharge as a Tesla owner. Los Angeles building permits have not yet revealed the date for the restaurant’s initial operation, but Tesla may have its eye on a target date that will likely be announced during next week’s Earnings Call.

Continue Reading

News

Tesla’s longer Model Y did not scale back requests for this vehicle type from fans

Tesla fans are happy with the new Model Y, but they’re still vocal about the need for something else.

Published

1 day ago

on

July 17, 2025

By

Credit: AlwinArt/Twitter

Tesla launched a slightly longer version of the Model Y all-electric crossover in China, and with it being extremely likely that the vehicle will make its way to other markets, including the United States, fans are still looking for something more.

The new Model Y L in China boasts a slightly larger wheelbase than its original version, giving slightly more interior room with a sixth seat, thanks to a third row.

Tesla exec hints at useful and potentially killer Model Y L feature

Tesla has said throughout the past year that it would focus on developing its affordable, compact models, which were set to begin production in the first half of the year. The company has not indicated whether it met that timeline or not, but many are hoping to see unveilings of those designs potentially during the Q3 earnings call.

However, the modifications to the Model Y, which have not yet been officially announced for any markets outside of China, still don’t seem to be what owners and fans are looking forward to. Instead, they are hoping for something larger.

Advertisement

A few months ago, I reported on the overall consensus within the Tesla community that the company needs a full-size SUV, minivan, or even a cargo van that would be ideal for camping or business use.

Tesla is missing one type of vehicle in its lineup and fans want it fast

That mentality still seems very present amongst fans and owners, who state that a full-size SUV with enough seating for a larger family, more capability in terms of cargo space for camping or business operation, and something to compete with gas cars like the Chevrolet Tahoe, Ford Expedition, or electric ones like the Volkswagen ID.BUZZ.

We asked the question on X, and Tesla fans were nearly unanimously in support of a larger SUV or minivan-type vehicle for the company’s lineup:

Here’s what some of the respondents said:

Tesla is certainly aware that many of its owners would like the company to develop something larger that competes with the large SUVs on the market.

However, it has not stated that anything like that is in the current plans for future vehicles, as it has made a concerted effort to develop Robotaxi alongside the affordable, compact models that it claims are in development.

It has already unveiled the Robovan, a people-mover that can seat up to 20 passengers in a lounge-like interior.

The Robovan will be completely driverless, so it’s unlikely we will see it before the release of a fully autonomous Full Self-Driving suite from Tesla.

Advertisement
Continue Reading

Energy

Tesla launches first Virtual Power Plant in UK – get paid to use solar

Tesla has launched its first-ever Virtual Power Plant program in the United Kingdom.

Published

1 day ago

on

July 17, 2025

By

Credit: Tesla Energy | X

Tesla has launched its first-ever Virtual Power Plant program in the United Kingdom. This feature enables users of solar panels and energy storage systems to sell their excess energy back to the grid.

Tesla is utilizing Octopus Energy, a British renewable energy company that operates in multiple markets, including the UK, France, Germany, Italy, Spain, Australia, Japan, New Zealand, and the United States, as the provider for the VPP launch in the region.

The company states that those who enroll in the program can earn up to £300 per month.

Tesla has operated several VPP programs worldwide, most notably in California, Texas, Connecticut, and the U.S. territory of Puerto Rico. This is not the first time Tesla has operated a VPP outside the United States, as there are programs in Australia, Japan, and New Zealand.

This is its first in the UK:

Advertisement

Advertisement

Tesla is not the only company that is working with Octopus Energy in the UK for the VPP, as it joins SolarEdge, GivEnergy, and Enphase as other companies that utilize the Octopus platform for their project operations.

It has been six years since Tesla launched its first VPP, as it started its first in Australia back in 2019. In 2024, Tesla paid out over $10 million to those participating in the program.

Tesla VPP program in California hits new capacity milestone

Participating in the VPP program that Tesla offers not only provides enrolled individuals with the opportunity to earn money, but it also contributes to grid stabilization by supporting local energy grids.

Advertisement
Continue Reading

Trending