With their working mechanisms based on ion migration, the switching dynamics and electrical behaviour of memristive devices resemble those of synapses and neurons, making these devices promising ...candidates for brain-inspired computing. Built into large-scale crossbar arrays to form neural networks, they perform efficient in-memory computing with massive parallelism by directly using physical laws. The dynamical interactions between artificial synapses and neurons equip the networks with both supervised and unsupervised learning capabilities. Moreover, their ability to interface with analogue signals from sensors without analogue/digital conversions reduces the processing time and energy overhead. Although numerous simulations have indicated the potential of these networks for brain-inspired computing, experimental implementation of large-scale memristive arrays is still in its infancy. This Review looks at the progress, challenges and possible solutions for efficient brain-inspired computation with memristive implementations, both as accelerators for deep learning and as building blocks for spiking neural networks.
Memristive devices are promising candidates to emulate biological computing. However, the typical switching voltages (0.2-2 V) in previously described devices are much higher than the amplitude in ...biological counterparts. Here we demonstrate a type of diffusive memristor, fabricated from the protein nanowires harvested from the bacterium Geobacter sulfurreducens, that functions at the biological voltages of 40-100 mV. Memristive function at biological voltages is possible because the protein nanowires catalyze metallization. Artificial neurons built from these memristors not only function at biological action potentials (e.g., 100 mV, 1 ms) but also exhibit temporal integration close to that in biological neurons. The potential of using the memristor to directly process biosensing signals is also demonstrated.
Neuromorphic computers could overcome efficiency bottlenecks inherent to conventional computing through parallel programming and readout of artificial neural network weights in a crossbar memory ...array. However, selective and linear weight updates and <10-nanoampere read currents are required for learning that surpasses conventional computing efficiency. We introduce an ionic floating-gate memory array based on a polymer redox transistor connected to a conductive-bridge memory (CBM). Selective and linear programming of a redox transistor array is executed in parallel by overcoming the bridging threshold voltage of the CBMs. Synaptic weight readout with currents <10 nanoamperes is achieved by diluting the conductive polymer with an insulator to decrease the conductance. The redox transistors endure >1 billion write-read operations and support >1-megahertz write-read frequencies.
Owing to their attractive application potentials in both non-volatile memory and unconventional computing, memristive devices have drawn substantial research attention in the last decade. However, ...major roadblocks still remain in device performance, especially concerning relatively large parameter variability and limited cycling endurance. The response of the active region in the device within and between switching cycles plays the dominating role, yet the microscopic details remain elusive. This Review summarizes recent progress in scientific understanding of the physical origins of the non-idealities and propose a synergistic approach based on in situ characterization and device modeling to investigate switching mechanism. At last, the Review offers an outlook for commercialization viability of memristive technology.
Memristor-enabled neuromorphic computing systems provide a fast and energy-efficient approach to training neural networks
. However, convolutional neural networks (CNNs)-one of the most important ...models for image recognition
-have not yet been fully hardware-implemented using memristor crossbars, which are cross-point arrays with a memristor device at each intersection. Moreover, achieving software-comparable results is highly challenging owing to the poor yield, large variation and other non-ideal characteristics of devices
. Here we report the fabrication of high-yield, high-performance and uniform memristor crossbar arrays for the implementation of CNNs, which integrate eight 2,048-cell memristor arrays to improve parallel-computing efficiency. In addition, we propose an effective hybrid-training method to adapt to device imperfections and improve the overall system performance. We built a five-layer memristor-based CNN to perform MNIST
image recognition, and achieved a high accuracy of more than 96 per cent. In addition to parallel convolutions using different kernels with shared inputs, replication of multiple identical kernels in memristor arrays was demonstrated for processing different inputs in parallel. The memristor-based CNN neuromorphic system has an energy efficiency more than two orders of magnitude greater than that of state-of-the-art graphics-processing units, and is shown to be scalable to larger networks, such as residual neural networks. Our results are expected to enable a viable memristor-based non-von Neumann hardware solution for deep neural networks and edge computing.
Neuromorphic computing based on spikes offers great potential in highly efficient computing paradigms. Recently, several hardware implementations of spiking neural networks based on traditional ...complementary metal-oxide semiconductor technology or memristors have been developed. However, an interface (called an afferent nerve in biology) with the environment, which converts the analog signal from sensors into spikes in spiking neural networks, is yet to be demonstrated. Here we propose and experimentally demonstrate an artificial spiking afferent nerve based on highly reliable NbO
Mott memristors for the first time. The spiking frequency of the afferent nerve is proportional to the stimuli intensity before encountering noxiously high stimuli, and then starts to reduce the spiking frequency at an inflection point. Using this afferent nerve, we further build a power-free spiking mechanoreceptor system with a passive piezoelectric device as the tactile sensor. The experimental results indicate that our afferent nerve is promising for constructing self-aware neurorobotics in the future.
The memristor
is a promising building block for next-generation non-volatile memory
, artificial neural networks
and bio-inspired computing systems
. Organizing small memristors into high-density ...crossbar arrays is critical to meet the ever-growing demands in high-capacity and low-energy consumption, but this is challenging because of difficulties in making highly ordered conductive nanoelectrodes. Carbon nanotubes, graphene nanoribbons and dopant nanowires have potential as electrodes for discrete nanodevices
, but unfortunately these are difficult to pack into ordered arrays. Transfer printing, on the other hand, is effective in generating dense electrode arrays
but has yet to prove suitable for making fully random accessible crossbars. All the aforementioned electrodes have dramatically increased resistance at the nanoscale
, imposing a significant barrier to their adoption in operational circuits. Here we demonstrate memristor crossbar arrays with a 2-nm feature size and a single-layer density up to 4.5 terabits per square inch, comparable to the information density achieved using three-dimensional stacking in state-of-the-art 64-layer and multilevel 3D-NAND flash memory
. Memristors in the arrays switch with tens of nanoamperes electric current with nonlinear behaviour. The densely packed crossbar arrays of individually accessible, extremely small functional memristors provide a power-efficient solution for information storage and processing.
Memristive devices for computing Yang, J Joshua; Strukov, Dmitri B; Stewart, Duncan R
Nature nanotechnology,
01/2013, Volume:
8, Issue:
1
Journal Article
Peer reviewed
Memristive devices are electrical resistance switches that can retain a state of internal resistance based on the history of applied voltage and current. These devices can store and process ...information, and offer several key performance characteristics that exceed conventional integrated circuit technology. An important class of memristive devices are two-terminal resistance switches based on ionic motion, which are built from a simple conductor/insulator/conductor thin-film stack. These devices were originally conceived in the late 1960s and recent progress has led to fast, low-energy, high-endurance devices that can be scaled down to less than 10 nm and stacked in three dimensions. However, the underlying device mechanisms remain unclear, which is a significant barrier to their widespread application. Here, we review recent progress in the development and understanding of memristive devices. We also examine the performance requirements for computing with memristive devices and detail how the outstanding challenges could be met.
Metal and semiconductor oxides are ubiquitous electronic materials. Normally insulating, oxides can change behavior under high electric fields--through 'electroforming' or 'breakdown'--critically ...affecting CMOS (complementary metal-oxide-semiconductor) logic, DRAM (dynamic random access memory) and flash memory, and tunnel barrier oxides. An initial irreversible electroforming process has been invariably required for obtaining metal oxide resistance switches, which may open urgently needed new avenues for advanced computer memory and logic circuits including ultra-dense non-volatile random access memory (NVRAM) and adaptive neuromorphic logic circuits. This electrical switching arises from the coupled motion of electrons and ions within the oxide material, as one of the first recognized examples of a memristor (memory-resistor) device, the fourth fundamental passive circuit element originally predicted in 1971 by Chua. A lack of device repeatability has limited technological implementation of oxide switches, however. Here we explain the nature of the oxide electroforming as an electro-reduction and vacancy creation process caused by high electric fields and enhanced by electrical Joule heating with direct experimental evidence. Oxygen vacancies are created and drift towards the cathode, forming localized conducting channels in the oxide. Simultaneously, O(2-) ions drift towards the anode where they evolve O(2) gas, causing physical deformation of the junction. The problematic gas eruption and physical deformation are mitigated by shrinking to the nanoscale and controlling the electroforming voltage polarity. Better yet, electroforming problems can be largely eliminated by engineering the device structure to remove 'bulk' oxide effects in favor of interface-controlled electronic switching.
As semiconductor technology enters the more than Moore era, there exists an apparent contradiction between the rapidly growing demands for data processing and the visible inefficiency rooted in ...traditional computing architecture. Neuromorphic systems hold great prospects in enabling a new generation of computing paradigm that can address this issue, which demands device components with rich dynamics and nonlinearity. Herein, the nonlinearity in memristive devices and their application in building neuromorphic dynamic systems are reviewed. The internal mechanisms that endow memristive devices with nonlinearity and rich dynamics are reviewed and subsequently the nonlinear spiking neurons that are implemented utilizing the physical processes in memristors are shown. Typical examples on neuromorphic dynamic systems based on nonlinear memristors are summarized, including memristive reservoir, memristive oscillatory neural network, and memristive chaotic computing. Finally, an outlook in the development of neuromorphic dynamic systems is given.
Herein, the internal nonlinearity and rich dynamics in memristive devices, distinguishing them from static linear circuit elements, which provide vital substrates for building neuromorphic dynamic systems capable of information processing with high efficiency, are discussed. Typical examples of neuromorphic dynamic systems based on nonlinear memristors, including memristive reservoir, memristive oscillatory neural network, and memristive chaotic computing, are highlighted.
PDF
