AnRAD: A neuromorphic anomaly detection framework for massive concurrent data streams

Qiuwen Chen, Ryan Luley, Qing Wu, Morgan Bishop, Richard W. Linderman, Qinru Qiu

Research output: Contribution to journalArticlepeer-review

25 Scopus citations

Abstract

The evolution of high performance computing technologies has enabled the large-scale implementation of neuromorphic models and pushed the research in computational intelligence into a new era. Among the machine learning applications, unsupervised detection of anomalous streams is especially challenging due to the requirements of detection accuracy and real-time performance. Designing a computing framework that harnesses the growing computing power of the multicore systems while maintaining high sensitivity and specificity to the anomalies is an urgent research topic. In this paper, we propose anomaly recognition and detection (AnRAD), a bioinspired detection framework that performs probabilistic inferences. We analyze the feature dependency and develop a self-structuring method that learns an efficient confabulation network using unlabeled data. This network is capable of fast incremental learning, which continuously refines the knowledge base using streaming data. Compared with several existing anomaly detection approaches, our method provides competitive detection quality. Furthermore, we exploit the massive parallel structure of the AnRAD framework. Our implementations of the detection algorithm on the graphic processing unit and the Xeon Phi coprocessor both obtain substantial speedups over the sequential implementation on general-purpose microprocessor. The framework provides real-time service to concurrent data streams within diversified knowledge contexts, and can be applied to large problems with multiple local patterns. Experimental results demonstrate high computing performance and memory efficiency. For vehicle behavior detection, the framework is able to monitor up to 16000 vehicles (data streams) and their interactions in real time with a single commodity coprocessor, and uses less than 0.2 ms for one testing subject. Finally, the detection network is ported to our spiking neural network simulator to show the potential of adapting to the emerging neuromorphic architectures.

Original languageEnglish (US)
Pages (from-to)1622-1636
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume29
Issue number5
DOIs
StatePublished - May 2018

Keywords

  • Anomaly detection
  • General purpose graphics processing unit (GPGPU)
  • Heterogeneous systems
  • Machine learning
  • Neuromorphic computing

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'AnRAD: A neuromorphic anomaly detection framework for massive concurrent data streams'. Together they form a unique fingerprint.

Cite this