A Deep Learning based Approach for Hand Gesture Recognition on a Low-power Microcontroller using IMU Sensors

Publikation: KonferenzbeitragPapierBegutachtung

Abstract

In this paper, we demonstrate an inertial measurement unit (IMU) based hand gesture recognition (HGR) on a lowpower microcontroller (STM32L476JGY) by using deep neural networks (DNN). To train the DNNs, a dataset was recorded which contains accelerometer and gyroscope readings from three IMUs mounted on the fingertips. With this dataset, various neural networks (NN) were trained and analysed. The best NN, in terms of accuracy and memory usage, was then selected and ported to the microcontroller. Finally, a runtime analysis of the model has been performed on the controller. The analysis showed that a LSTM is best suited for the detection of hand gestures. The selected model achieves an accuracy of 93 % and only takes up around 40 KiB of memory. In addition, the model has a throughput time of only 3.52 ms, which means that the prototype
can be used in real time.
OriginalspracheEnglisch
PublikationsstatusAngenommen/Im Druck - 2 Sep. 2022
Veranstaltung21st IEEE International Conference on Machine Learning and Applications - Nassau, Bahamas
Dauer: 12 Dez. 202215 Dez. 2022
https://www.icmla-conference.org/icmla22/howtosubmit.html

Konferenz

Konferenz21st IEEE International Conference on Machine Learning and Applications
KurztitelICSIMA
Land/GebietBahamas
OrtNassau
Zeitraum12.12.202215.12.2022
Internetadresse

Fingerprint

Untersuchen Sie die Forschungsthemen von „A Deep Learning based Approach for Hand Gesture Recognition on a Low-power Microcontroller using IMU Sensors“. Zusammen bilden sie einen einzigartigen Fingerprint.

Zitieren