The Quest to Read the Human Mind :: Mon, 08 Feb 2010 22:03:52 +0000

If a few very smart neuroscientists are right, with enough number crunching and a powerful brain scanner, science can pluck pictures-and maybe one day even thoughts- directly from your brain

It's after dark on a warm Monday night in April, and I'm lying face-up in a 13-ton tube at the Henry H. Wheeler, Jr. Brain Imaging Center at the University of California at Berkeley. The room is dimly lit, and I am alone. A white plastic cage covers my face, and a blue computer screen shines brightly into my eyes. I'm here because a neuroscientist named Jack Gallant is about to read my mind. He has given me strict instructions not to move; even the slightest twitch could affect the accuracy of what he's about to do. As I stare straight up, I notice an itch on my thigh. Don't scratch it, I tell myself. I try to keep my thoughts blank as the beeping gets faster and the fMRI machine-the scanner that will detect changes in blood flow in my brain-powers up.

Gallant assures me that the random thoughts in my head will not affect his results. Today he's just concerned with what I see and how that registers in the visual cortex, a region at the back of the brain that processes what my eyes take in. It doesn't matter that I'm thinking about what to eat for dinner, or that I'm worried about getting a parking ticket on Oxford Street. The only important thing, he says, is for me to keep as still as possible, and soon he'll have enough information to re-create the pictures I've been staring at without ever having seen the images himself.

For the past 10 years, Gallant has been running a neuroscience and psychology lab at Berkeley dedicated to brain imaging and vision research. He's one of a few neuroscientists in the world on the verge of unlocking the key to mind reading through brain-pattern analysis using magnetic resonance scans and algorithms. By showing me a series of random photographs and evaluating fMRI readings from my primary visual cortex, Gallant says his technique can reconstruct imagery stored in my brain. His current method takes hours of analysis, but his objective is to hone the technology to the point where it can deduce what people are seeing in real time.

If successful, it could influence the way we do just about everything. Mind-reading machines could help doctors understand the inner worlds of people with hallucinations, cognitive disabilities, post-traumatic stress disorder and other impairments. Judges could use them to sneak a look into suspects' brains by having them reenact the experience and reading their visions. Such machines could also determine whether someone using the insanity defense is faking it, or whether someone claiming self-defense truly feared for his life. On the flip side, the technology raises serious ethical concerns, with critics worrying that it could one day make our private thoughts vulnerable to snoops and hackers.

I ponder all this as I lie motionless in the brain scanner, staring straight ahead while Gallant and two of his lab researchers flash several dozen photographs in front of my eyes, a few seconds at a time. I see sheep grazing in a meadow, a rock formation, a pond and a profile of a guy who looks like Einstein. I'm not actually supposed to be looking at these pictures-my job is to stare at the white dot in the middle of the screen. "Seeing" doesn't happen entirely in the conscious realm, Gallant explains. The visual cortex works like a camera, automatically absorbing information through the retina and registering the imagery in the brain.

Ten minutes feels like an eternity, but finally the fMRI announces the conclusion of its program with another loud beep. The researchers remove me from my bind and escort me to the control room, where a giant monitor is displaying 30 scanned images of my brain from different angles. I see bunches of white squiggly lines and light gray V shapes inside rows of gray circles. "That's it? That's my brain?" I ask, my head foggy from having tried so hard to stay still. It surprises me that all the goings-on in my mind can be reduced to a bunch of geometric shapes. Gallant tells me that brain activity is basically just a bunch of neurons firing-an estimated 300 million in the primary visual cortex alone, according to the latest research.

To help make sense of the shapes, the brain scanner divides them up into a grid of three-dimensional cube-like structures called volume pixels, or voxels. To me, each voxel looks like a random mix of whites, grays and blacks. But to Gallant's computer model, which can see more-precise data in those shades, the voxels are a meaningful matrix of zeroes and ones. By crunching this matrix, it can transform the shapes back into a remarkably accurate rendering of the Einstein Guy or the grazing sheep. Gallant and his team didn't have time to generate enough scans of my brain to make their algorithm work, but they showed me some convincing results from other volunteers. "It's not perfect," says Shinji Nishimoto, one of Gallant's postdocs, "but we're getting pretty close."


As I leave the lab, my thoughts secure in my head, I feel a bit uneasy knowing that they may not stay that way for long. Gallant's "neural decoding"-a term he prefers to "mind reading"-is getting faster and more sophisticated all the time. In fact, last October, his lab managed to re-create entire video clips just by analyzing the brain patterns of people watching them. In one example, a reconstructed video of an elephant walking through the desert shows a blotchy Dumbo-shaped mass plodding across the screen. The fine details are lost, but the rendering is nonetheless impressive for having been pulled from someone's brain. And it's not just Gallant who's making progress. Using similar technology, other researchers are unlocking memories and dreams.

Beyond the fuzzy realm of the paranormal, mind reading could simply be a question of having the right tools. "As long as we have good measurements of brain activity and good computational models of the brain," Gallant wrote in a supplement to a paper he published in Nature in 2008, "it should be possible in principle to decode the visual content of mental processes like dreams, memory, and imagery."

What's on your Mind?

Remarkably, scientists can predict with near-perfect accuracy the last thing you saw just by analyzing your brain activity. The technique is called neural decoding. To do it, scientists must first scan your brain while you look at thousands of pictures. A computer then analyzes how your brain responds to each image, matching brain activity to various details like shape and color. Over time, the computer establishes a sort of master decoding key that it can later use to identify and reconstruct almost any object you see without the need to analyze the image beforehand.

The Magic of the MRI

Gallant is a slight, wiry man with a horseshoe mustache and a Willy Wonka-esque energy about him. He tends to use friendly, vivid analogies when he talks. "The brain is a Thanksgiving turkey," he said to me last summer during a visit to his bare-bones office at Berkeley. He was drawing furiously on the chalkboard, attempting to explain in simple terms the inner workings of the visual cortex. "The outside of the turkey is the skin, or the brain's cortex. All the giblets inside are subcortical nuclei. This"-he tapped his chalk on the giant balloon-like cavity at the rear of his "turkey" diagram-"is the primary visual cortex," the center of our vision system.

The brain employs a complex assembly line to construct the world around us. The primary visual cortex, or V1, connects to a maze of other regions known as V2, V3, and so on. ("Nobody knows exactly how many areas there are up there," Gallant says, a finger to his head.) Each region performs specific vision-related functions, like distinguishing colors, discerning shapes, gauging depth, or sensing motion. When I look at a dog, for instance, I don't just see the shape of a four-legged animal; I recognize that it's the brown-and-white dog I owned as a child, romping in a familiar way in the backyard I grew up in. It might even trigger a memory of playing with him. Each of these aspects of "seeing" would be represented by different patterns in the visual cortex.

The key function of V1 relevant to Gallant's research-registering visual stimuli-was discovered in the early 20th century, when soldiers with bullet wounds to the back of the head, presumably to their visual cortex, experienced partial blindness despite having healthy eyes. Experiments on rodents affirmed that the location and shape of things we see are replicated in V1. If I were to look at a tree, for instance, the back of the eye would register a representation of an upside-down tree onto V1. But it wasn't until the late 1990s, when neuroscientists used a process called multi-voxel pattern recognition, that scientists were able to pinpoint these representations non-invasively in humans. The technique uses fMRIs to map the visual cortex into tiny structures-voxels-that correspond to patterns of blood flow. One pattern in the area responsible for shape, for instance, might suggest that a person is looking at a dog, while another pattern in the area responsible for color could suggest that the dog is brown.

Gallant's project takes the technique to a new level, using a computer model to not only identify images but also reconstruct them. On the night of my fMRI session, I met five members of Gallant's lab who, for the past three years, have been wrestling with probability theory to come up with the best algorithms to power the model. When I asked them how exactly they devised the code, Thomas Naselaris, a tall, curly-haired postdoc, put a long equation on the blackboard called Bayes' theorem. It's a fundamental tenet of probability theory that calculates how odds change in response to new information, he explained, and it's the key to their technique.

To calculate the probability that someone's brain patterns represent a particular image, the researchers must first prime their special equation with a sizable sampling of data, plugging in 1,750 of the subject's fMRI scans. "For every possible image a person could be looking at, Bayes' theorem tells you the probability that the image is correct," Naselaris says. It's a bit like trying to predict the make of a car concealed beneath a tarp: To come up with an accurate guess, you must first analyze all the available clues-the shape of the tarp, its size, maybe the type of person who owns the car, possibly the sound of the engine. The more information you have, the better your guess. Likewise, the more data you plug into the equation, the more accurate its predictions.

Dancing Bears

The ability to pluck a picture from someone's brain is an impressive feat, but the far bigger challenge is figuring out the actual thoughts associated with that picture. Gallant would have no way to know, for instance, what I was thinking while I was lying in the scanner. That's because thoughts, unlike pictures, are not neatly recorded at the back of the brain.

So where are they recorded? Tom Mitchell, a computer scientist at Carnegie Mellon University, along with his colleague Marcel Just, is using fMRI and multi-voxel pattern recognition to answer that question. By mapping the brain's response to images, words and emotions, Mitchell believes his lab could be decoding thoughts, not just pictures, within the decade.

To pinpoint where thoughts live in the brain, during a recent study he put volunteers in an fMRI machine, showed them two objects-a hammer and a house, for example-and used software to analyze voxel patterns triggered in multiple parts of the brain, ultimately determining which object the subject was thinking about. Like Gallant, Mitchell can do this with 90 percent accuracy. "When you think about a hammer, you think about all aspects of it. You might think about swinging it, which would fire neurons in your motor cortex," he says. "You might think about what it looks like, which activates the visual cortex." His team also gathered fMRI data from the amygdala and the anterior cingulate cortex-areas that correlate with emotions like anger and love-to map out brain patterns that form when people hear words such as "love," "justice" and "anxiety."

Yukiyasu Kamitani, a computational neuroscientist at the Advanced Telecommunications Research Institute International in Japan, believes he can take the technology even further and decode dreams. This summer, he plans to put sleeping people in the fMRI to read their brain signals and, like Gallant, reconstruct them.

Meanwhile, Gallant and Nishimoto are attempting to reproduce movies stored in the brain. After I finish my fMRI scans, Gallant showed me a video clip on his computer featuring psychedelic bears floating in front of mountains. Every few seconds, a new bear zoomed into the foreground and then floated away like a beach ball tossed in the air. Occasionally a colorful cube flew past the bears. Just looking at it made me dizzy. "This is a motion-enhanced movie," Gallant says excitedly. "It makes your visual system go absolutely crazy, so you get lots of blood flow and signals."

Nishimoto, the lab's resident "motion guy," is able to reconstruct from brain scans the colors, location and movement of these bears, generating reproductions of the original video footage. In a similar experiment, he asked a volunteer to watch two hours of movie trailers inside an fMRI machine. A computer then matched the subject's brain patterns to colors and moving shapes in the movie. To build up the computer model's reference library of associations-to prime it-the researchers fed it thousands of hours of YouTube videos and asked it to predict how the person's brain would respond to watching them. Then, when the subject watched a new set of videos, the computer was able to match the new brain patterns to images in its library to piece together a reproduction of the original video clip. The reconstructed video captured the general flow of motion, as well as shapes and colors, although it missed fine details such as facial features. The resolution will improve, the researchers say, as more data is added to the computer model. "Whenever I tell anyone we can do this," Gallant says, "they say there's no way."

Thinking back to the rat's nest of lines from my own fMRI readings-all that from looking at a simple black-and-white photo-it's a little creepy to think that our mental processes can be reduced to binary code in this fashion. But then again, so is the notion of a mysterious black box of neurons controlling everything we do and think. "It's all numbers," Gallant says. "The trick is to do good bookkeeping."

[More]

By Stimulating Stem Cells, Bioactive Nanogel Regenerates Cartilage in Joints :: Mon, 08 Feb 2010 20:24:03 +0000

The body is a resilient biological structure, but there's one thing medical science, an increasing number of Baby Boomers, and the majority of professional athletes will all tell you: Take care of your joints, because once you burn up the cartilage you started with, you're not getting any more. But a breakthrough by Northwestern University scientists will now allow adult joints to naturally grow new cartilage for the very first time.

Unlike bone, muscle and other tissues in the body, cartilage that is damaged or worn away over time does not regenerate itself. The cartilage you have when you reach adulthood has to last you for life; if it doesn't, you can suffer debilitating joint pain or even osteoarthiritis, which is neither pleasant nor effectively treatable.

To stimulate the growth of type II collagen -- the main protein in the clean, smooth cartilage that caps bones where they make contact in joints -- the NU researchers created a bioactive nanogel that can be injected into the joint in a minimally invasive manner. The gel self-assmebles into a fibrous, solid extracellular matrix similar to what joint cells see in natural cartilage production. The gel also binds to one of the key growth factors for cartilage regeneration and keeps it localized in the damaged area. This stimulates the stem cells present in bone marrow that in turn activate type II collagen production naturally. The matrix slowly breaks down into nutrients as the natural cartilage builds up, eventually being replaced altogether by locally grown cartilage tissue.

The process has undergone successful animal testing, but its likely got a few more years of testing ahead of it before it could become commonplace. But the timing couldn't be better; an aging population means an increase in achy old joints. A fresh round of cartilage production could keep many of the more senior members of society in the workforce, on the golf course and out of orthopedic surgeon's office.

[Science Daily]

[More]

Home Fuel Cell Charging Station Could Help Power Hydrogen Economy :: Mon, 08 Feb 2010 19:41:52 +0000

An interesting report from CNN over the weekend: a tabletop hydrogen fuel cell recharging station could bring hydrogen power to the individual home, allowing portable devices and eventually automobiles to charge up on the universe's most abundant element cleanly from the comfort of home.

Horizon Fuel Cell Technology's HydroFILL device -- which admittedly has an ultra-futuristic look about it -- runs on regular old H2O, stripping the oxygen from the hydrogen and packing the latter into removable cartridges at high pressure. However, though the hydrogen is packed in at high pressure, the individual cartridges store it in solid state at lower pressures, making it much safer to carry around and sidestepping a major concern with fuel cell technologies.

If powered from a renewable source, the device essentially enables a carbon free process of powering numerous devices. A UK concern is already developing a Smart Car-like automobile powered by Horizon's technology. Whether or not the energy concentrations will be enough to propel the concept to success in the near-term remains to be seen, but the idea of creating home-based hydrogen power stations is enticing, as it means we wouldn't necessarily have to retool our energy infrastructures to enable a clean, efficient hydrogen economy.

[CNN]

[More]

For the First Time, Researchers Find Longevity Gene That Helps Determine Lifespan :: Mon, 08 Feb 2010 16:43:53 +0000

Come on, you apes! You wanna live forever?

Humanity's search for the secrets to immortality has inspired Ray Kurzweil's Singularity vision and DARPA's hunt for ageless synthetic beings. Now scientists have discovered a single gene that appears to control how quickly individuals will biologically age, The Telegraph reports. The discovery could not only encourage people to adopt healthier lifestyles earlier, but may eventually help people live longer if scientists can figure out how to manipulate the gene.

Each person has a genetically-programmed lifespan that depends upon telomeres, or the ends of chromosomes that serve as protective caps for the main genetic material. Biological aging is determined by how quickly the telomeres shorten each time the genetic material is copied during cell division -- a process that parallels human aging.

A newly-identified variant of the TERC gene seems to determine both the starting length of a person's telomeres and how quickly the telomeres shorten. The full findings appear in the journal Nature Genetics.

The scientists have yet to try and manipulate the gene to possibly delay biological aging, but they suggest that people could get tested for the gene early on in life. People could then take appropriate steps to avoid proven "bad" influences on those precious telomeres, such as smoking, obesity and lack of exercise.

[via The Telegraph]

[More]

This Week in the Future, February 1-5, 2010 :: Fri, 05 Feb 2010 22:11:09 +0000

Leave a comment to win this illustration on a t-shirt

This week has been the gift that keeps giving, as far as the future's concerned. What could be better than android astronauts, and turtles launched into space? Or the opportunity to wipe your last company progress report all over your you-know-what? We've rounded it all up for you in another installment of This Week in the Future.

Check out this week's future news, after the jump.

After all that good news, we've got a little reward for you. It is Friday, after all. We're giving away a t-shirt. So don't say we never show you that we care.

Leave a comment (any comment) to put your name in the pile; we'll randomly choose and announce our winner right here on Friday, February 19. And, if you just can't wait that long, you can buy the shirt for yourself here. Good Luck!

Congratulations to last week's winner, PopSci user "Beckster."

Until next time. Enjoy our past weekly illustrated roundups here.

[More]

Which Organs Can I Live Without, and How Much Cash Can I Get for Them? :: Fri, 05 Feb 2010 20:04:01 +0000

First, a disclaimer: Selling your organs is illegal in the United States. It's also very dangerous. Handing off an organ is risky enough when done in a top hospital, even more so if you're doing it for cash in a back alley. No, really: Don't do this. OK? OK.

There are many organs one can theoretically do without, or for which there's a backup. Most folks can spare a kidney, a portion of their liver, a lung, some intestines, and an eyeball, and still live a long life. That said, donating a lung, a piece of liver or a section of intestines is a very complicated surgery, so it's not done frequently on the black market. And no one's going to make much cash on an eyeball. "In the U.S., there's a fairly steady supply of donated corneas from corpses," says Sean Fitzpatrick, director of public affairs at the New England Organ Bank. "There's pretty much no market demand for eyes." Giving up a kidney, though, is a relatively simple surgery that has netted desperate people a few bucks.

Now, black-market organ dealers don't do a great job of filing taxes, but here are some prices based on rumored deals and reports from the World Heath Organization. In India, a kidney fetches around $20,000. In China, buyers will pay $40,000 or more. A good, healthy kidney from Israel goes for $160,000.

Don't expect to pocket all that dough, though. "The person giving up the organ only gets a fraction of the fee," says Sally Satel, a scholar at the American Enterprise Institute think tank who studies the prices paid by legal and illegal organ-donor operations. After the organ broker-the guy who sets up your kidney-for-cash transaction-takes his cut, he needs to pay for travel, the surgeon, medical supplies and a few "look-the-other-way" payoffs. Most people get $1,000 to $10,000 for their kidney (probably much less than you were hoping for).

The best bet is to wait until compensation for organs is legalized in the U.S.-the Organ Trafficking Prohibition Act of 2009 would allow payment to donors, but it stalled in Congress-because there's certainly a market for kidneys. Last summer, a man offering one of his for $100,000 (plus medical expenses) on Craigslist received several offers until the Web site removed his post. And you could probably hold out for even more. In 1999, before eBay delisted a kidney put up for auction, bidders drove the price up to $5.75 million.

Try to stump us. Send your questions to fyi@popsci.com

[More]

Five Reasons Henrietta Lacks is the Most Important Woman in Medical History :: Fri, 05 Feb 2010 17:11:55 +0000

In 1951, Henrietta Lacks, a poor woman with a middle-school education, made one of the greatest medical contributions ever. Her cells, taken from a cervical-cancer biopsy, became the first immortal human cell line-the cells reproduce infinitely in a lab. Although other immortal lines have since been established, Lacks's "HeLa" cells are the standard in labs around the world. Together they outweigh 100 Empire State Buildings and could circle the equator three times. This month, PopSci contributor Rebecca Skloot's book, The Immortal Life of Henrietta Lacks, tells the story behind the woman who revolutionized modern medicine. Here, five reasons we should all thank Henrietta Lacks.

1. Before HeLa cells, scientists spent more time trying to keep cells alive than performing actual research on the cells. An endless supply of HeLa cells freed up time for discovery.

2. In 1952, the worst year of the polio epidemic, HeLa cells were used to test the vaccine that protected millions.

3. Some cells in Lacks's tissue sample behaved differently than others. Scientists learned to isolate one specific cell, multiply it, and start a cell line. Isolating one cell and keeping it alive is the basic technique for cloning and in-vitro fertilization.

4. A scientist accidentally poured a chemical on a HeLa cell that spread out its tangled chromosomes. Later on, scientists used this technique to determine that humans have 46 chromosomes-23 pairs-not 48, which provided the basis for making several types of genetic diagnoses.

5. It was discovered that Lacks's cancerous cells used an enzyme called telomerase to repair their DNA, allowing them, and other types of cancer cells, to function when normal cells would have died. Anti-cancer drugs that work against this enzyme are currently in early clinical trials.

[More]

Physicists Prove Teleportation of Energy Is Possible :: Thu, 04 Feb 2010 19:16:21 +0000

Over five years ago, scientists succeeded in teleporting information. Unfortunately, the advance failed to bring us any closer to the Star Trek future we all dream of. Now, researchers in Japan have used the same principles to prove that energy can be teleported in the same fashion as information. Rather than just hastening the dawn of quantum computing, this development could lead to practical, significant changes in energy distribution.

According to the theory, developed by Masahiro Hotta of Tohoku University, Japan, a series of entangled particles could be stretched across an infinite amount of space. By inducing an energy change in one of the particles, the other entangled particles would change as well. Eventually, to preserve conservation of energy, the original particle would be destroyed, with its energy passing to the final particle in the chain. Thus, the energy has been teleported from one particle to another.

Naturally, Hotta doesn't present any blueprint for replacing power lines with teleporting energy, concentrating instead on the implications for studying quantum mechanics. However, with a concept this profound, the implications beyond theory are nearly endless. So let's hear what you've come up with! Commenters, I want to know: how would you use energy teleportation?

[Technology Review]

[More]

Brain Scan Shows Vegetative Patient Responding To Yes-or-No Questions :: Thu, 04 Feb 2010 16:54:39 +0000

In a study that challenges the diagnosis of vegetative state, doctors found that the brain of a seemingly unconscious, vegetative man responded to yes-or-no questions in the same fashion as an alert, conscious person. This discovery not only complicates the medical definition of consciousness, but seems to call into question centuries of philosophy dealing with the nature of life and the self.

The study covered 54 patients in a supposed vegetative state. Of those 54, five showed some signs of consciousness. Three of those five showed the ability to deliberately respond to stimuli at bedside. Most amazingly though, one of the patients managed to answer a series of yes-or-no questions by altering his brain activity, as measured by a MRI machine.

The questions referred to the patient's family, and included queries like "do you have any brothers?". When the patient was asked "is your father's name Alexander?" (it is), his brain assumed a configuration nearly identical to that of a conscious control subject saying "yes". Similarly, when asked "is your father's name Thomas?", the MRI read brain activity identical to a control person's "no" answer.

So far, wider communication remains impossible, although advances in brain implants may soon change that. However, as that technology enables more and more communication between the seemingly unconscious and the outside world, medicine and society will bump up against the problem of quickly defining consciousness for the sake of treatment, when any solid definition of the mind has eluded philosophers for millennia.

[The New England Journal of Medicine]

[More]

The World's First Photovoltaic Circuit That Powers Itself :: Thu, 04 Feb 2010 15:25:13 +0000

If sustainability is key to the new energy economy, a team of University of Pennsylvania researchers has just taken a big step toward the future by developing the first photovoltaic circuit that powers itself. The circuits could eventually be packed into touchscreens and other consumer devices that would run without a battery or any other source of power, as long as they have a beam of sunlight to harvest.

Like any incremental technology, these circuits aren't going to be powering the next generation of cellphones or replace silicon photovoltaic cells anytime in the immediate future. Right now researchers can only get a tiny amount of power from the circuits. But as the technology scales and becomes more efficient, it should open up some exciting possibilities for the future.

Aside from powering devices or even small robots, the circuits could power computer calculations at the speed of light or be used to model the neural pathways of the brain.

But in the nearer term, the circuits could lead to devices that function sans power source and electrical transmission pathways. Devices that don't need to carry power with them in a battery could obviously be pared way down in size, and - material hazards aside - would leave a negligible carbon footprint behind. Most practical devices would require some sort of backup power supply for the times when shade is unavoidable, but a mostly sustainable device is still a nice notion. Which makes it all the more frustrating that commercial applications of the tech are still likely years out.

[Discovery News]

[More]