TY - JOUR
T1 - Offline training for memristor-based neural networks
AU - Boquet, Guillem
AU - Macias, Edwar
AU - Morell, Antoni
AU - Serrano, Javier
AU - Miranda, Enrique
AU - Vicario, Jose Lopez
N1 - Funding Information:
This research is supported by the Catalan Government under Project 2017 SGR 1670 and the Spanish Government under Project TEC2017-84321-C4-4-R co-funded with European Union ERDF funds.
Publisher Copyright:
© 2021 European Signal Processing Conference, EUSIPCO. All rights reserved.
Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.
PY - 2021/1/24
Y1 - 2021/1/24
N2 - Neuromorphic systems based on Hardware Neural Networks (HNN) are expected to be an energy-efficient computing architecture for solving complex tasks. Due to the variability common to all nano-electronic devices, HNN success depends on the development of reliable weight storage or mitigation techniques against weight variation. In this manuscript, we propose a neural network training technique to mitigate the impact of device-to-device variation due to conductance imperfections at weight import in offline-learning. To that aim, we propose to add said variation to the weights during training in order to force the network to learn robust computations against that variation. Then, we experiment using a neural network architecture with quantized weights adapted to the design constrains imposed by memristive devices. Finally, we validate our proposal against real-world road traffic data and the MNIST image data set, showing improvements on the classification metrics.
AB - Neuromorphic systems based on Hardware Neural Networks (HNN) are expected to be an energy-efficient computing architecture for solving complex tasks. Due to the variability common to all nano-electronic devices, HNN success depends on the development of reliable weight storage or mitigation techniques against weight variation. In this manuscript, we propose a neural network training technique to mitigate the impact of device-to-device variation due to conductance imperfections at weight import in offline-learning. To that aim, we propose to add said variation to the weights during training in order to force the network to learn robust computations against that variation. Then, we experiment using a neural network architecture with quantized weights adapted to the design constrains imposed by memristive devices. Finally, we validate our proposal against real-world road traffic data and the MNIST image data set, showing improvements on the classification metrics.
KW - Deep learning
KW - Memristor
KW - Neuromorphic
KW - RRAM
KW - Traffic forecasting
UR - http://www.scopus.com/inward/record.url?scp=85099280591&partnerID=8YFLogxK
U2 - 10.23919/eusipco47968.2020.9287574
DO - 10.23919/eusipco47968.2020.9287574
M3 - Article
AN - SCOPUS:85099280591
SN - 2219-5491
SP - 1547
EP - 1551
JO - European Signal Processing Conference
JF - European Signal Processing Conference
ER -