Connect with us

News

Scientists use AI neural network to translate speech from brain activity

Published

on

Three recently published studies focused on using artificial intelligence (AI) neural networks to generate audio output from brain signals have shown promising results, namely by producing identifiable sounds up to 80% of the time. Participants in the studies first had their brain signals measured while they were either reading aloud or listening to specific words. All the data was then given to a neural network to “learn” how to interpret brain signals after which the final sounds were reconstructed for listeners to identify. These results represent hopeful prospects for the field of brain-computer interfaces (BCIs), where thought-based communication is quickly moving from the realm of science fiction to reality.

The idea of connecting human brains to computers is far from new. In fact, several relevant milestones have been made in recent years including enabling paralyzed individuals to operate tablet computers with their brain waves. Elon Musk has also famously brought attention to the field with Neuralink, his BCI company that essentially hopes to merge human consciousness with the power of the Internet. As brain-computer interface technology expands and develops new ways to foster communication between brains and machines, studies like these, originally highlighted by Science Magazine, will continue demonstrating the steady march of progress.

Functional areas of the human brain. | Credit: Blausen.com staff (2014) via CC BY 3.0.

In the first study conducted by researchers from Columbia University and Hofstra Northwell School of Medicine, both in New York, five epileptic participants had the brain signals from their auditory cortexes recorded as they listened to stories and numbers being read to them. The signal data was provided to a neural network for analysis which then reconstructed audio files that were accurately identified by participating listeners 75% of the time.

In the second study conducted by a team from the University of Bremen (Germany), Maastricht University (Netherlands), Northwestern University (Illinois), and Virginia Commonwealth University (Virginia), brain signal data was gathered from six patients’ speech planning and motor areas while undergoing tumor surgeries. Each patient read specific words aloud to target the data collected. After the brain data and audio data were given to their neural network for training, the program was given brain signals not included in the training set to recreate audio, the result producing words that were recognizable 40% of the time.

Finally, in a third study by a team at the University of California, San Francisco, three participants with epilepsy read text aloud while brain activity was captured from the speech and motor areas of their brains. The audio generated from their neural network’s analysis of the signal readings was presented to a group of 166 people who were asked to identify the sentences from a multiple choice test – some sentences were identified with 80% accuracy.

While the research presented in these studies shows serious progress towards connecting human brains to computers, there are still a few significant hurdles. For one, the way neuron signal patterns in the brain translate into sounds varies from person to person, so neural networks must be trained on each individual person. The best results require the best data possible, i.e., the most precise neuron signals possible, meaning this is something that can only be obtained by placing electrodes in the brain itself. The opportunities to collect data at this invasive level for research are limited, relying on voluntary participation and approval of experiments.

Advertisement

All three of the studies highlighted demonstrated an ability to reconstruct speech based on neural data in some significant capacity; however, also in all cases, the study participants were able to create audible sounds to use with the computer training set. In the case of patients unable to speak, the level of difficultly in interpreting the brain’s speech signals from other signals will be the biggest challenge. Also, the differences between brain signals during actual speech vs. thinking about speech will complicate matters further.

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
Comments

Elon Musk

Tesla says it denied Musk CEO replacement report before it was published

Tesla says it responded to the WSJ’s request for comment, denying that it was in search of a new CEO to replace Elon Musk.

Published

on

tesla
(Credit: Tesla)

Tesla said that it denied seeking a replacement for CEO Elon Musk before a report was published claiming the company was considering a new frontman.

Last night, The Wall Street Journal reported that Tesla’s Board of Directors was looking for Musk’s replacement after he had devoted too much time to his role within the government. The publication revised its headline to the report no fewer than five times, initially stating the company was still seeking a replacement.

By the time the headline revisions were complete, it had outlined that Tesla had looked for a replacement a month ago, but had stopped its search following Musk’s commitment to Tesla during the company’s earnings call last month.

Shortly after the report surfaced, Board of Directors chairwoman Robyn Denholm officially issued a statement on behalf of Tesla:

“Earlier today, there was a media report erroneously claiming that the Tesla Board had contacted recruitment firms to initiate a CEO search at the company. This is absolutely false (and this was communicated to the media before the report was published). The CEO of Tesla is Elon Musk and the Board is highly confident in his ability to continue executing on the exciting growth plan ahead.  – Robyn Denholm.”

Advertisement

Tesla Board Chair slams Wall Street Journal over alleged CEO search report

Interestingly, Denholm’s statement indicates it had responded to a request for comment from the Wall Street Journal before the report was published. This is especially interesting because Tesla does not typically respond to media outreach, as it dissolved its media department several years ago.

Tesla typically makes its statements publicly on X.

Musk also responded to the report, indicating that the WSJ had committed an “extremely bad breach of ethics” by publishing a “deliberately false article” that did not include Tesla’s “unequivocal denial beforehand.”

Advertisement
Continue Reading

News

Robotaxis are already making roads safer, Waymo report reveals

Waymo Driver is already reducing severe crashes and enhancing the safety of vulnerable road users.

Published

on

Waymo hires former Tesla Executive 
(Credit: Waymo)

Industry leaders such as Elon Musk have always maintained that autonomous robotaxis will make roads safer. A recent blog post from Waymo about the safety of its self-driving cars suggests that Musk’s sentiments are on point.

Way More Safety

Waymo Driver is already reducing severe crashes and enhancing the safety of vulnerable road users. As per a new research paper set for publication in the Traffic Injury Prevention Journal, Waymo Driver had outperformed human drivers in safety, particularly for vulnerable road users (VRUs).

Over 56.7 million miles, compared to human drivers, Waymo Driver achieved a 92% reduction in pedestrian injury crashes. It also saw 82% fewer crashes with injuries with cyclists and 82% fewer crashes with injuries with motorcyclists. Waymo Driver also slashed injury-involving intersection crashes by 96%, which are a leading cause of severe road harm for human drivers. Waymo Driver saw 85% fewer crashes with suspected serious or worse injuries as well.

What They Are Saying

Mauricio Peña, Waymo’s Chief Safety Officer, was optimistic about Waymo Driver’s results so far. “It’s exciting to see the real positive impact that Waymo is making on the streets of America as we continue to expand. This research reinforces the growing evidence that the Waymo Driver is playing a crucial role in reducing serious crashes and protecting all road users,” the Chief Safety Officer noted.

Jonathan Adkins, Chief Executive Officer at Governors Highway Safety Association, also noted that Waymo’s results are very encouraging. “It’s encouraging to see real-world data showing Waymo outperforming human drivers when it comes to safety. Fewer crashes and fewer injuries — especially for people walking and biking — is exactly the kind of progress we want to see from autonomous vehicles,” Adkins stated.

Advertisement
Continue Reading

Elon Musk

Tesla hints at June 1 launch of Robotaxi platform in Austin

Tesla has hinted at a potential launch date for the Robotaxi service in Austin, Texas.

Published

on

tesla robotaxi app on phone
Credit: Tesla

Tesla just dropped its biggest hint yet about the potential launch date of its Robotaxi ride-hailing platform in Austin, Texas, shedding more light on when to expect it to take off.

In preparation for the ride-hailing service to launch, Tesla has been in talks with the City of Austin for months. It has also spent recent months bolstering its Full Self-Driving suite, aiming for it to handle initially supervised rides with the use of teleoperators to keep things safe and dependable, at least early on.

The company has also said that it expects the Robotaxi service, which will drive passengers in Tesla Model Y vehicles to start, to launch in Austin in June. However, Tesla has not given an exact date.

Now, Tesla is hinting that Robotaxi could launch on June 1, based on a very vague X post it published on May 1:

Of course, this is extremely speculative. However, it’s the first time Tesla has made any suggestions about a potential launch date, so it’s worth taking it seriously.

While the automaker has often missed timelines in the past, most notably the launch of a “feature-complete” Full Self-Driving platform, this is the first time we’ve seen Tesla be so adamant and truly reiterate a target date.

Tesla has not shied away from this June date for the Robotaxi launch yet, something that is worth noting as we move closer to June. All signs point toward Tesla being able to come through on this timeline, and it could be one of its biggest accomplishments yet on the grand scheme of things. The Robotaxi rollout will be controlled and small to start, the company noted on its most recent Earnings Call.

CEO Elon Musk said:

“The team and I are laser-focused on bringing robotaxi to Austin in June. Unsupervised autonomy will first be solved for the Model Y in Austin.”

At first, it also seems as if the first Robotaxi rides will be available to a select group, as Musk said the ability to order one will not be available to the general public until later in the month. He also said the initial fleet will be between 10 and 20 vehicles:

“Yeah. We’re still debating the exact number to start off on day one, but it’s, like, I don’t know, maybe 10 or 20 vehicles on day one. And watch it carefully. They scale it up rapidly after that. So, we want to make sure that you’re paying very close attention the first time this happens. But, yeah, you will be able to — end of end of June or July, just go to Austin and order a Tesla for autonomous drive.”

While the June 1st date of the Robotaxi launch is extremely speculative, Tesla seems convinced that its vehicles could already handle this task. It would be something to see them come through on this date, especially on the first day of the month.

Continue Reading

Trending