Scientists say they made a mind-reading AI that can turn brain scans into a readout of your thoughts
Marianne Guenot
Updated ·5 min read
Scientists say they trained AI to recreate a story from a brain scan.
Participants sat in an fMRI machine listening, watching, or imagining a story.
The AI was able to read their brainwaves and recreate the story accurately, per a study.
Scientists used AI to read people's brain scans and recreate a whole story only from their brainwaves, per a study published Monday.
Participants were asked to listen, watch, or imagine a story while sitting in a brain-scanning machine called an fMRI, per the study from experts at the University of Texas, Austin.
The AI was able to accurately predict what the story was about by reading only the participant's brainwaves, per the study.
This type of technology could one day help people who have lost the ability to communicate, the scientists on the project said.
"For a noninvasive method, this is a real leap forward compared to what's been done before, which is typically single words or short sentences," Alex Huth, an assistant professor of neuroscience and computer science at UT Austin, said in a press release.
The story doesn't come out exactly like it was toldAn annotated diagram shows how the AI can read brainwaves and generate a story.Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander Huth/Insider
The AI was able to accurately recreate stories that participants were either listening to, watching, or imagining, per the study, which was published in the peer-reviewed journal Nature Neuroscience.
The AI did not reproduce the story word for word. Instead, it picked up on the concepts being triggered in the participants' minds and produced an approximation. It also made some mistakes.
For instance, one participant was hearing this: "I didn't know whether to scream, cry or run away. Instead, I said, 'Leave me alone!'"
Their brainwaves were translated to "Started to scream and cry, and then she just said, 'I told you to leave me alone'," per the press release — muddling the context of the screaming and crying and who was speaking.
Researchers also asked participants to look at a video with no sound. They found that their AI decoder was able to capture the essence of the video from participants' thoughts, as seen in the transcript below:
The AI has to interpret the brain scans
A figure shows text being listened to compared to what the brainwaves were translated to.Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander Huth.
Some of the differences between the original story and the story decoded from the brainwaves may be due to the model itself.
Every brain is different, so to train the computer the scientists first showed it which brainwaves appeared when the participant was thinking about a particular word.
But it's not a one-to-one science. When the computer read the brainwaves, it would give a few suggestions of the words that may have been thought.
The scientists than asked AI to make sense of the words outputted by the computer using a transformer model, the same type of model that is used by ChatGPT.
"We're getting the model to decode continuous language for extended periods of time with complicated ideas," said Huth.
The technique can't break into private thoughts
Scientists used this brain scanner to collect brainwaves to feed to the AI.Nolan Zunk/University of Texas at Austin.
While the technique was able to read minds, it couldn't be used to break into private thoughts or for interrogation, the scientists said in a press release.
The machine was easily fooled. When scientists asked participants to think about another story, to count, or to think about animal names while they were listening to a story, the decoder's accuracy dropped, per the press release.
"We take very seriously the concerns that it could be used for bad purposes and have worked to avoid that," said study author Jerry Tang, a doctoral student in computer science, in the press release. "We want to make sure people only use these types of technologies when they want to and that it helps them."
Unlike other techniques, this method doesn't use brain implants
The man with locked-in syndrome, who has not been named and is referred to as K1, is shown in his bed at home.Wyss Center, Geneva
Previous studies have claimed that they could read the minds of patients with locked-in syndrome. This was the case for a 34-year-old man who was completely paralyzed and had lost even the ability to move his eyes.
Per a previous study from the Wyss Center for Bio and Neuroengineering and the University of Tübingen in Germany, the man was able to communicate and even ask for music and beer.
But these previous studies have typically relied on surgically-inserted brain implants.
The difference here is that this method only relies on brain scans, which are not invasive.
Of course, that means that for now, the technique requires a huge machine and can't be used outside of a lab. But the scientists hope the method could become more portable in the future with more compact technology, per the press release.
The Vatican on Friday informed a Donald Trump-supporting archbishop that he is being excommunicated for refusing to recognize Pope Francis' authority after years of outspoken public attacks.Carlo Maria Vigano, an ultra-conservative who served as the Vatican’s diplomat to Washington, D.C. between 2011 and 2016, was formally accused last month of schism, which is one of the most serious offenses in canon law. Schism is “the refusal of submission to the Supreme Pontiff or of communion with the memb
LONDON—The Conservatives, the world’s winningest political party, were booted out of power in dramatic style on Thursday after 14 years of chaotic and divisive rule.The Labour Party had secured a landslide victory, ending an era of Conservative rule over Britain that stretches back to 2010; the year that the iPad and Instagram were launched and Lady Gaga wore that meat dress to the MTV music awards.In that time, the Conservatives have cycled through five leaders, each of them dragging the party
A thread of bombshell text messages made public Thursday alleged that Donald Trump’s 2020 campaign settled “multiple” seedy lawsuits for a man described only as “Boris,” leading to conjecture it could be a powerful Trumpworld figure.Those messages were revealed by A.J. Delgado—a former staffer on Trump’s 2016 campaign who’s embroiled in a lawsuit against the current campaign, alleging she was taken advantage of and raped by her former superior, Jason Miller.As part of that lawsuit, Delgado, a la
WARNING: This story contains graphic images of a leg injury.Last week, George Mandl, an American vacationing in Montreal, took his eight-year-old son Max to Parc Jean-Drapeau for a swim.It was a hot afternoon, and Max played on an inflatable structure anchored in the park's man-made lake.As his legs dangled in the blue-green darkness, he felt a stabbing pain. He screamed and, when lifeguards pulled him from the water, his leg was bleeding."It felt like a kind of electrical pain, like that pain w
The adult film star, who accused the former President of giving her hush money to keep quiet about their alleged sexual encounter now owes Trump $600,000 (£470,000) in legal costs after a defamation case she brought against him was dismissed. Last month in New York, Trump was criminally convicted for defaming another sexual assault accuser, E.Jean Carroll. The 45-year-old said on the Daily Mail's podcast, Everything I Know About Me, "How is it fair that I have better, more compelling evidence than E. Jean Carroll? And I'm glad she won. They continue to hand her money like it's f**king candy.”
Corazon Dandan died after being pushed into an oncoming BART train at San Francisco’s Powell Street Station at around 11 p.m on Monday night. The suspect, 49-year-old Trevor Belmont, also known as Hoak Taing, was arrested at the scene and booked into the San Francisco County Jail on suspicion of homicide and elder abuse. Dandan, who was Filipino American, was a dedicated telephone operator at the Westin St. Francis and other hotels.
This Canadian stock stands out for its high yield, resiliency of its dividend payments, and its management’s commitment towards returning higher cash. The post 7.5% Dividend Yield! I’m Buying This TSX Stock and Holding it for Decades appeared first on The Motley Fool Canada.