바로가기메뉴

본문 바로가기 주메뉴 바로가기

Analysis of Deep learning Quantization Technology for Micro-sized IoT devices

Journal of The Korea Internet of Things Society / Journal of The Korea Internet of Things Society, (P)2799-4791;
2023, v.9 no.1, pp.9-17
https://doi.org/https://doi.org/10.20465/kiots.2023.9.1.009



Abstract

Deep learning with large amount of computations is difficult to implement on micro-sized IoT devices or moblie devices. Recently, lightweight deep learning technologies have been introduced to make sure that deep learning can be implemented even on small devices by reducing the amount of computation of the model. Quantization is one of lightweight techniques that can be efficiently used to reduce the memory and size of the model by expressing parameter values with continuous distribution as discrete values of fixed bits. However, the accuracy of the model is reduced due to discrete value representation in quantization. In this paper, we introduce various quantization techniques to correct the accuracy. We selected APoT and EWGS from existing quantization techniques, and comparatively analyzed the results through experimentations The selected techniques were trained and tested with CIFAR-10 or CIFAR-100 datasets in the ResNet model. We found out problems with them through experimental results analysis and presented directions for future research.

keywords
Internet of Things, Deep Learning, Quantization, Model Training, Experimental Configuration, 사물인터넷, 딥러닝, 양자화, 모델 훈련, 실험 구성

Journal of The Korea Internet of Things Society