TY - JOUR
T1 - A Memristor-Based Optimization Framework for Artificial Intelligence Applications
AU - Liu, Sijia
AU - Wang, Yanzhi
AU - Fardad, Makan
AU - Varshney, Pramod K.
N1 - Publisher Copyright:
© 2001-2012 IEEE.
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Memristors have recently received significant attention as device-level components for building a novel generation of computing systems. These devices have many promising features, such as non-volatility, low power consumption, high density, and excellent scalability. The ability to control and modify biasing voltages at memristor terminals make them promising candidates to efficiently perform matrix-vector multiplications and solve systems of linear equations. In this article, we discuss how networks of memristors arranged in crossbar arrays can be used for efficiently solving optimization and machine learning problems. We introduce a new memristor-based optimization framework that combines the computational merits of memristor crossbars with the advantages of an operator splitting method, the alternating direction method of multipliers (ADMM). Here, ADMM helps in splitting a complex optimization problem into subproblems that involve the solution of systems of linear equations. The strength of this framework is shown by applying it to linear programming, quadratic programming, and sparse optimization. In addition to ADMM, implementation of a customized power iteration method for eigenvalue/eigenvector computation using memristor crossbars is discussed. The memristor-based power iteration method can further be applied to principal component analysis. The use of memristor crossbars yields a significant speed-up in computation, and thus, we believe, has the potential to advance optimization and machine learning research in artificial intelligence.
AB - Memristors have recently received significant attention as device-level components for building a novel generation of computing systems. These devices have many promising features, such as non-volatility, low power consumption, high density, and excellent scalability. The ability to control and modify biasing voltages at memristor terminals make them promising candidates to efficiently perform matrix-vector multiplications and solve systems of linear equations. In this article, we discuss how networks of memristors arranged in crossbar arrays can be used for efficiently solving optimization and machine learning problems. We introduce a new memristor-based optimization framework that combines the computational merits of memristor crossbars with the advantages of an operator splitting method, the alternating direction method of multipliers (ADMM). Here, ADMM helps in splitting a complex optimization problem into subproblems that involve the solution of systems of linear equations. The strength of this framework is shown by applying it to linear programming, quadratic programming, and sparse optimization. In addition to ADMM, implementation of a customized power iteration method for eigenvalue/eigenvector computation using memristor crossbars is discussed. The memristor-based power iteration method can further be applied to principal component analysis. The use of memristor crossbars yields a significant speed-up in computation, and thus, we believe, has the potential to advance optimization and machine learning research in artificial intelligence.
UR - http://www.scopus.com/inward/record.url?scp=85042135917&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85042135917&partnerID=8YFLogxK
U2 - 10.1109/MCAS.2017.2785421
DO - 10.1109/MCAS.2017.2785421
M3 - Article
AN - SCOPUS:85042135917
SN - 1531-636X
VL - 18
SP - 29
EP - 44
JO - IEEE Circuits and Systems Magazine
JF - IEEE Circuits and Systems Magazine
IS - 1
M1 - 8288635
ER -