Electronics Meet Animal Brains
Electronics Meet Animal Brains
Electronics Meet Animal Brains
Seminar Report 03
INTRODUCTION
Until recently, neurobiologists have used computers for simulation, data collection, and data analysis, but not to interact directly with nerve tissue in live, behaving animals. Although digital computers and nerve tissue both use voltage waveforms to transmit and process information, engineers and neurobiologists have yet to cohesively link the electronic signaling of digital computers with the electronic signaling of nerve tissue in freely behaving animals. Recent advances in microelectromechanical systems (MEMS), CMOS electronics, and embedded computer systems will finally let us link computer circuitry to neural cells in live animals and, in particular, to reidentifiable cells with specific, known neural functions. The key components of such a braincomputer system include neural probes, analog electronics, and a miniature microcomputer. Researchers developing neural probes such as sub- micron MEMS probes, microclamps, microprobe arrays, and similar structures can now penetrate and make electrical contact with nerve cells with out causing significant or long-term damage to probes or cells. Researchers developing analog electronics such as low-power amplifiers and analog-to-digital converters can now integrate these devices with microcontrollers on a single low-power CMOS die. Further, researchers developing embedded computer systems can now incorporate all the core circuitry of a modern computer on a single silicon chip that can run on miniscule power from a tiny watch battery. In short, engineers have all the pieces they need to build truly autonomous implantable computer systems.
Dept. of ECE
-1-
MESCE Kuttippuram
Seminar Report 03
Until now, high signal-to-noise recording as well as digital processing of real-time neuronal signals have been possible only in constrained laboratory experiments. By combining MEMS probes with analog electronics and modern CMOS computing into self-contained, implantable microsystems, implantable computers will free neuroscientists from the lab bench.
Dept. of ECE
-2-
MESCE Kuttippuram
Seminar Report 03
Dept. of ECE
-3-
MESCE Kuttippuram
Seminar Report 03
CONVENTIONAL TECHNIQUES
Neurobiologists examine the activities of brain cells tied to sensory inputs, integrative processes, and motor outputs to understand the neural basis of animal behavior and intelligence. They also probe the components of neuronal control circuitry to understand the plasticity and dynamics of control. They want to know more about neuronal dynamics and networks, about synaptic interactions between neurons, and about the inextricable links between environmental stimuli and neuronal signaling, behavior, and control. To explore the details of this biological circuitry, neurobiologists use two classes of electrodes to record and stimulate electrical signals in tissue intracellular micropipettes to impale or patch- clamp single cells for extracellular wires or micromachined probes for interrogating multisite interrogation of the cells internal workings, and patterns of extra- cellular neural signaling or electrical activity in muscles. Neurobiologists use amplifiers and signal generators to stimulate and record to and from neurons through these electrodes, and signal-processing systems to analyze the results. They have used these techniques for decades to accumulate a wealth of understanding about the nervous system. Unfortunately, to date, most of these experiments have been performed on slices of brain tissue or on restrained and immobilized animals, primarily because the electronic instruments required to run the experiments occupy the better part of a lab bench.
Dept. of ECE
-4-
MESCE Kuttippuram
Seminar Report 03
This situation leaves neurobiologists with a nagging question: Are they measuring the animals nor mal brain signals or something far different? Further, neurobiologists want to understand how animal brains respond and react to environmental stimuli. The only way to truly answer these questions is to measure a brains neural signaling while the animal roams freely in its natural environment.
Dept. of ECE
-5-
MESCE Kuttippuram
Seminar Report 03
SALIENT OBJECTIVES
The solution to these problems lies in making the test equipment so small that a scientist can implant it into or onto the animal, using materials and implantation techniques that hurt neither computer nor animal. Recent developments in MEMS, semi conductor electronics, embedded systems, bio compatible materials, and electronic packaging finally allow neuroscientists and engineers to begin packaging entire neurobiology experiments into hardware and firmware that occupy less space than a human fingernail. Researchers call these bioembedded systems neurochips. Scientists from the University of Washing-ton, Caltech, and Case Western Reserve University have teamed to build these miniaturized implantable experimental setups to explore the neural basis of behavior. This research effort has developed or is in the process of developing the following: miniaturized silicon MEMS probes for recording from the insides of biocompatible coatings that protect these probes from protein fouling; a stand-alone implantable microcomputer that records from and nerve cells;
stimulates neurons, sensory pathways, or motor control pathways in an intact animal, using intracellular probes, extra- cellular probes, or wire electrodes; neurophysiological preparations and techniques for implanting microchips and wire electrodes or MEMS probes into or onto animals in a way that does not damage the probes or tissue; firmware that performs real-time biology experiments with implanted computers, using analytical models of the underlying biology; and
Dept. of ECE -6MESCE Kuttippuram
Seminar Report 03
leading to reverse- engineered studies of animal behavior. As the Neuroscience Application Examples sidebar shows, the first neurochip experiments use sea slugs and moths in artificial environments, but broad interest has already arisen for using implantable computers in many other animals.
Dept. of ECE
-7-
MESCE Kuttippuram
Seminar Report 03
DESIGNER NEUROCHIPS
Like their benchtop experimental counterparts, neurochips use amplifiers to boost low-voltage biological signals, analog-to-digital converters (ADCs) to digitize these signals, microcomputers to process the signals, onboard memory to store the signals, digital-to-analog converters (DACs) to stimulate nerves, and software to control the overall experiment.
Figure1. Neurochip functional block diagram solid line show required components, dashed lines show some optional components
Figure 1 shows a neurochips basic elements. The key requirements are that the neurochip be small and lightweight enough to fit inside or onto the animal, have adequate signal fidelity for interacting with the millivolt-level signals characteristic of nerve tissue, and have sufficient processing power to perform experiments of real scientific value.
Dept. of ECE
-8-
MESCE Kuttippuram
Seminar Report 03
Dept. of ECE
-9-
MESCE Kuttippuram
Seminar Report 03
Figure 2. Prototype neurochips. (a,b) A first-generations neurochip comprising differential amplifiers and batteries on a micro PCB attached to the Manduca months thorax. The animals exoskeleton provides a simple attach point without biocompatibility issues. Manually implanted bipolar recording electrodes connect to recording sites. (c) A tethered in-flight recording from the thoracic flight musculature. (d) A second-generation neurochip prototype records from two nerver or muscle fiber sites, storing the signals in onboard nonvolatile memory.
Dept. of ECE
-10-
MESCE Kuttippuram
Seminar Report 03
The basic components of a neurochip are commercially available today. They include instrumentation amplifiers, ADCs/DACs, reconfigurable microcomputers, and high-density memory. For example, a Programmable System-on-a-Chip from Cypress MicroSystems integrates a microprocessor, variable-gain amplifiers, an ADC, a memory controller, and a DAC into a single integrated circuit. First-generation neurochips integrate one or more ICs, passive elements such as capacitors, batteries, and 110 pads on small micro-PCBs. The prototype neurochip shown in Figure 2 used packaged ICs and button cells, and occupied a 1 cm x 3 cm printed-circuit board. The production version, due out of processing in early 2003, uses die-on- board technology and thin-film batteries, and is smaller than 1 square centimeter. Future-generation neurochips will integrate all the electronics onto a single silicon chip, and will likely be smaller than 10 mm on a side.
Dept. of ECE
-11-
MESCE Kuttippuram
Seminar Report 03
PROBES
Building the probes that let a neurochip eaves drop on the electrical signaling in a nerve bundle, group of neurons, or single neuron presents a daunting task. Benchtop experiments on con strained animals typically use metallic needles often made of stainless steel or tungstento communicate with nerve bundles, micromachined silicon probes to record from groups of neurons, or glass capillaries filled with a conductive ionic solution to penetrate and record from the inside of individual neurons. In unconstrained animals, flexible metallic needles, attached to the animal with surgical superglue, and micromachined silicon probes still work. However, replicating the performance of glass capillaries in flying, swimming, wiggling animals is a different story entirely. Several centimeters long and quite fragile, the glass capillaries that neurobiologists use to probe the insides of nerve cells typically have tip diameters smaller than 0.3 microns. They impale neurons even more fragile than the probes themselves. Neuro biologists use micromanipulators to painstakingly and precisely drive single probes into single neurons. Fortunately, MEMS technology offers a possible alternative to these glass capillaries. As Figure 3 shows, University of Washington researchers are developing silicon MEMS probes and flexible inter connect structures to mimic the performance of glass capillaries in an implanted preparation. Researchers have already recorded intracellular signals with early prototypes, and development is ongoing.
Dept. of ECE
-12-
MESCE Kuttippuram
Seminar Report 03
Figure 3. Micromachined silicon probes, flexible interconnect structures, and sea slug surgery. (a) Released, flexible silicon devices ready for implantation; (b) a sharp microelectrode on a flexible polyamide support; (c) the implanation procedure places the needle on the exposed brain of a sea slug and the silicon base with the external wires tucks under the slugs skin; and (d) the postsurgery sea slug with implanted device can move freely in the water tank.
Dept. of ECE
-13-
MESCE Kuttippuram
Seminar Report 03
GLYME
Researchers seek to implant both probes and neurochips inside an animals brain. Unfortunately, an animals immune system rapidly and indiscriminately encapsulates all foreign bodies with proteins, without regard for the research value of implanted probes and neurochips. The adsorbed proteins not only attenuate the recorded electrical signals, but can also jeopardize the animals survival by causing abnormal tissue growth. Researchers at the University of Washingtons Center for Engineered Biomaterials have developed plasma-deposited ether-terminated oligoethylene glycol coatings that inhibit protein fouling, as Figure 4 shows. Preliminary research indicates that these glyme coatings can reduce the protein fouling of probes and neurochips to levels acceptable for week-long experiments.
Figure 4. A Flurescence microscope image of a patterned 1,500m x 1,500m proteinresistant plasma polymerized tetraglume (pp4G) pad on a silicon-dioxide substrate, with additional 200 micron x 200 micron gold pads on and around the PP4G pad, after incubation in a solution containing flurorescently labeled proteins. The silicondioxide and gold areas adsorb protein and appear light, while the pp4G-coated areas resist protein adsorption and appear dark. Dept. of ECE -14MESCE Kuttippuram
Seminar Report 03
POWER
Neurochips can derive power from onboard batteries, external radiofrequency sources, a wire tether, or the nerve tissue itself, The ultimate decision on the power source depends on the nature of the experiments and the animals environment. Batteries are attractive because they avoid the antennas and charge pumps required to capture RF energy, operate in all environments, do not restrict the animals movement the way a tether does, and provide much more power than tapping nerve cells for energy. Batteries have a weight disadvantage, but thin- film technologies using LiCoO2/LiPON/Li and Ni/KOHIZn promise flexible rechargeable batteries with peak current densities greater than 12 mA per square centimeter for shortduration experiments, and lifetimes measured in days or longer at low-current densities. Batteries are ideal for the two sample preparations shown in the Neuroscience Application Examples sidebar. The typical hawkmoth flight time is less than 60 seconds. The 12 mA provided by a 200 mg, one-squarecentimeter battery easily powers a neurochip for this experiments duration. The sea slug trolling methodically along the seafloor lies at the opposite end of the spectrum, needing only a few milliamps of current to power a neurochip for a week. The slug can easily accommodate a large battery in its visceral cavity, allowing extended untethered experiments.
Dept. of ECE
-15-
MESCE Kuttippuram
Seminar Report 03
MEMORY
Once implanted, an embedded neurochip must read its experimental procedure from memory, run the experiment, acquire the neural spike trains, then store the results in memory. As with all computer systems, memory size is an issue for neurochips. Fortunately, the electrical spike trains generated by nerve tissue have a stereotyped shape as shown in Figure 2c, suggesting that neurochips should com press the neural waveforms before storing them in memory. Compressing the signals has two advantages. First, it effectively increases the onboard storage capacity. Second, it decreases the frequency of memory writes, reducing power consumption. Even simple compression algorithms such as run- length encoding can achieve better than 10 to 1 compression ratios on neural signals. Custom algorithms that apply vector quantization, run-length encoding, and Huffman encoding to different parts of the neural waveform can achieve up to 1,000 to 1 compression ratios. Given the limited computing power of an implantable microcomputer, simpler is better when it comes to compression, but even simple RLE offers huge power and memory-size benefits.
Dept. of ECE
-16-
MESCE Kuttippuram
Seminar Report 03
A STIMULATING WORLD
Passive neurochips that do nothing more than record will provide neurobiologists with a wealth of data. But even now, with the first neurochips barely in production, neurobiologists are already calling for designs that stimulate nerve tissue as well as record from it. Active neurochips will allow stimulus-response experiments that test models of how nervous systems control behavior, such as how sensory inputs inform motor-circuit loops and the logic or model behind the response. Indeed, the neurochip projects long-term goal is to develop a hardware and software environment in which a neurobiologist conceives a stimulusresponse experiment, encodes that experiment in soft ware, downloads the experiment to an implanted neurochip, and recovers the data when the experiment concludes. Figure 5 shows a model of integrative biology in which neurochips play a key part.
Dept. of ECE
-17-
MESCE Kuttippuram
Seminar Report 03
CONCLUSION
With advances in integrated circuit processing will come ever more capable and power-efficient embedded computers. The simple neurochips of today will become the complex embedded systems of tomorrow, when embed ding in this ultimate sense will mean computer electronics embedded in nerve tissue. Enabling neuroscientists to better understand the neural basis of behaviour is reason enough to develop such devices. The long-term promise is much greater, however, perhaps leading one day to neural prosthetics, hardware-based human-computer interfaces, and artificial systems that incorporate principles of biological intelligence.
Dept. of ECE
-18-
MESCE Kuttippuram
Seminar Report 03
APPENDIX I
Wiring a sea slug
Beneath a research vessel anchored in the Puget Sound, two scientists clad in scuba gear hover over the bright orange sea slug shown in Figure A. From the outside, this slug looks like any other. But this particular slug has a batterypowered microcomputer implanted in its brain and minuscule silicon needles communicating with its neurons. The microcosmputer faithfully performs a biology experiment as the animal goes about its normal behavior. Meanwhile, the scientists videotape the slugs feeding, fleeing, and social behaviors while measuring water currents and geomagnetic fields. Later, these scientists will study the environmental measurements and electronic recordings in an attempt to decode how the slugs brain patterns correlate with behavior. The anticipated outcome: groundbreaking findings in behavioral neurobiology.
Figure A. Monitoring a giant sea slug. (1) Tritonia diomedea-shown with its prey, an orange seapen, in the background-is typically 20cm length, has a readily accessible brain with large and well-characterized neurons, and is extraordinarily tolerant of surgical insult. (2) Artists conception of a neural recording setup implanted inside Tritonia. Dept. of ECE -19MESCE Kuttippuram
Seminar Report 03
APPENDIX II
Monitoring a moths flight controls
In a small, dark zoology lab, a giant moth performs an aerial ballet as it feeds from a robotically controlled artificial flower, unaware that the flowers movements are programmed to test the moths flight dynamics. The ultra-highspeed infrared video recorder tapes the moth s every movement. But the special part of this experiment is neither the flower nor the videotaping. It is the tiny battery-powered microcomputer attached to the moths thorax that records electrical signals from the flight muscles and sense organs and stores this data in onboard memory. Suddenly, the moth appears to struggle to keep up with the flower. But the flowers movements havent changed. Rather, the onboard microcomputer has begun stimulating the nerves that enervate the moths wing muscles, adjusting the wing-stroke phase in subtle ways that will let scientists measure the impulse response of the moths flight-control loops. These experiments and others like them will soon be played out in biology laboratories across the country, if the multidisciplinary team of computer engineers and zoologists that is developing these implantable computers has its way.
Dept. of ECE
-20-
MESCE Kuttippuram
Seminar Report 03
Figure B. Tracking a moths movements. (1) Manduca sexta is typically 4cm in length with a wingspan of about 12cm; at 2.5gm, it is one of the largest flying insects. It can carry loads up to a gram and fly at speeds up to 30 miles per hour, flapping its wings 25 times a second. (2) Artists conception of a neurochip attached to Manducas thorax.
Figure C. High-speed infrared video captures Manduca hovering and sipping nectar from a moving flower. Visually guided flight control lets the animal compensate for rapid changes in wind direction and the flowers swaying movements.
Dept. of ECE
-21-
MESCE Kuttippuram
Seminar Report 03
APPENDIX III
Neurochip Technology Forecast
Even as the first miniature neurochips record neuronal action potentials, researchers at the University of Washington are testing stimulus paradigms to evoke controlled muscular extension and contraction. Rather than driving the muscles directly using high-resolution voltage stimulus waveforms generated by digital synthesis and a digital-to-analog converter, they tried stimulating nerve bundles instead, using simple dig ital waveforms directly. They derived pulsewidth modulated signals directly from logic gates, and drove these waveforms into the nerve bundles that enervate the muscles. Early results show great promise, not only because the technique actually worked, but because a microcontroller can easily generate digital pulses, and the drive currents needed for nerve stimulation are up to 100 times smaller than those needed to drive muscle tissue directly. This power savings will allow functional stimulation by miniature neurochips. Next on the research agenda: statistical machine learning. Researchers already plan to use smart algorithms, smart software, and smart chips to interact dynamically with nerve tissue. They suspect that machine learning can help them study the cause-and-effect relationships involved in the behavior of sensory motor circuits. Beyond that, they wont speculate, but the applications of this neurochip research to robotics, medical prosthetics, and a host of other applications seem obvious.
Dept. of ECE
-22-
MESCE Kuttippuram
Seminar Report 03
BIBLIOGRAPHY
1. 2. 3.
4.
www.sicb.org www.howstuffworks.com Y .Hanein et al., Towards MEMS Probes for Intracellular Neuronal M. Richardson, Data Compression of Neural Signaling in an Implantable
Recording, Sensors Update, Vol.10, no. 1, 2002. Mircochip, tech.report 02-08-01, Dept. Computer Science, University of Washington, 2001. 5. IEEE Computer Society, January 2003
Dept. of ECE
-23-
MESCE Kuttippuram
Seminar Report 03
CONTENTS
1. INTRODUCTION 2. INTEGRATING SILICON AND NEUROBIOLOGY 3. CONVENTIONAL TECHNIQUES 4. SALIENT OBJECTIVES 5. DESIGNER NEUROCHIPS 6. PROBES 7. GLYME 8. POWER 9. MEMORY 10.A STIMULATING WORLD 11.CONCLUSION 12.APPENDIX I
13. APPENDIX II
Dept. of ECE
-24-
MESCE Kuttippuram
Seminar Report 03
ABSTRACT
Recent advances in microelectromechanical systems, CMOS
electronics and embedded computer systems will finally let us link computer circuitary to neural cells in live animals. The key components of such a brain computer system includes neural probes, analog electronics and miniature microcomputer. These bioembedded systems are called neurochips. By enabling better study of animal behaviors neural basis, implantable computers may revolutionize field biology and eventually lead to neural prosthetics, hardware based human-computer interfaces and artificial systems that incorporate biological intelligence principles.
Dept. of ECE
-25-
MESCE Kuttippuram
Seminar Report 03
ACKNOWLEDGEMENT
I extend my sincere thanks to Prof. P.V.Abdul Hameed, Head of the Department for providing me with the guidance and facilities for the Seminar. I express my sincere gratitude to Seminar coordinator Mr. Berly C.J, Staff in charge, for their cooperation and guidance for preparing and presenting this seminar. I also extend my sincere thanks to all other faculty members of Electronics and Communication Department and my friends for their support and encouragement.
Dept. of ECE
-26-
MESCE Kuttippuram