Abstract
Deep Convolutional Neural Networks (DCNNs) have been demonstrated as effective models for understanding image content. The computation behind DCNNs highly relies on the capability of hardware resources due to the deep structure. DCNNs have been implemented on different large-scale computing platforms. However, there is a trend that DCNNs have been embedded into light-weight local systems, which requires low power/energy consumptions and small hardware footprints. Stochastic Computing (SC) radically simplifies the hardware implementation of arithmetic units and has the potential to satisfy the small low-power needs of DCNNs. Local connectivities and down-sampling operations have made DCNNs more complex to be implemented using SC. In this paper, eight feature extraction designs for DCNNs using SC in two groups are explored and optimized in detail from the perspective of calculation precision, where we permute two SC implementations for inner-product calculation, two down-sampling schemes, and two structures of DCNN neurons. We evaluate the network in aspects of network accuracy and hardware performance for each DCNN using one feature extraction design out of eight. Through exploration and optimization, the accuracies of SC-based DCNNs are guaranteed compared with software implementations on CPU/GPU/binary-based ASIC synthesis, while area, power, and energy are significantly reduced by up to 776x, 190x, and 32835x.
Original language | English (US) |
---|---|
Title of host publication | Proceedings of the 2017 Design, Automation and Test in Europe, DATE 2017 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 250-253 |
Number of pages | 4 |
ISBN (Electronic) | 9783981537093 |
DOIs | |
State | Published - May 11 2017 |
Event | 20th Design, Automation and Test in Europe, DATE 2017 - Swisstech, Lausanne, Switzerland Duration: Mar 27 2017 → Mar 31 2017 |
Other
Other | 20th Design, Automation and Test in Europe, DATE 2017 |
---|---|
Country/Territory | Switzerland |
City | Swisstech, Lausanne |
Period | 3/27/17 → 3/31/17 |
ASJC Scopus subject areas
- Computer Networks and Communications
- Hardware and Architecture
- Safety, Risk, Reliability and Quality