TY - GEN
T1 - Realtime Mask Detection of Kitchen Staff Using YOLOv5 and Edge Computing
AU - Shi, Yunfan
AU - Yang, Zheng
AU - Bi, Yifei
AU - Li, Jingcheng
AU - Zhu, Xiaohui
AU - Yue, Yong
N1 - Funding Information:
This research was funded by the Suzhou Municipal Key Laboratory for Intelligent Virtual Engineering (SZS2022004), the Suzhou Science and Technology Project (SYG202122), the Teaching Development Fund of XJTLU (TDF21/22-R25-185), the Key Program Special Fund of XJTLU (KSF-A-19) and the Research Development Fund of XJTLU (RDF-19-02-23).
Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - We propose a new end-to-end, edge-device embedded solution for detection of improper mask-wearing of kitchen staff using network cameras. Mask detection on kitchen network cameras is a highly specified task with little ready-to use data. The filming position of network cameras and the enviroment in kitchen leaded to vague images and small targets. Also, the detection model should be light-weighted to be deployed on edge computing devices. To improve accuracy on this task, We constructed a novel dataset from real kitchen cameras of different positions, indoor layouts, light conditions and applied effective data augementation. We conducted transfer learning on our dataset starting from COCO pre-trained YOLOV5s weights. In addition, we optimized the model through parameter tuning and post training model pruning for a single Nvidia Jetson Nano device and achieved high accuracy and sensitivity on multiple HD resolution network camera video feed. Experimental results show that our model achieves a training accuracy of 100 percent mAP(0.5) and test accuracy of 97.6 percent mAP(0.5) with minimal training cost: only 89 epochs on our dataset with early stopping. With an inference speed of 10 FPS on Nvidia Jetson Nano, our solution suffices the application requirements and can handle mutiple parallel HD camera streams simultaneously. Compared with previous research, our solution provides competitive cost efficiency where accurate and sensitive high resolution image detection can be run on a single edge device.
AB - We propose a new end-to-end, edge-device embedded solution for detection of improper mask-wearing of kitchen staff using network cameras. Mask detection on kitchen network cameras is a highly specified task with little ready-to use data. The filming position of network cameras and the enviroment in kitchen leaded to vague images and small targets. Also, the detection model should be light-weighted to be deployed on edge computing devices. To improve accuracy on this task, We constructed a novel dataset from real kitchen cameras of different positions, indoor layouts, light conditions and applied effective data augementation. We conducted transfer learning on our dataset starting from COCO pre-trained YOLOV5s weights. In addition, we optimized the model through parameter tuning and post training model pruning for a single Nvidia Jetson Nano device and achieved high accuracy and sensitivity on multiple HD resolution network camera video feed. Experimental results show that our model achieves a training accuracy of 100 percent mAP(0.5) and test accuracy of 97.6 percent mAP(0.5) with minimal training cost: only 89 epochs on our dataset with early stopping. With an inference speed of 10 FPS on Nvidia Jetson Nano, our solution suffices the application requirements and can handle mutiple parallel HD camera streams simultaneously. Compared with previous research, our solution provides competitive cost efficiency where accurate and sensitive high resolution image detection can be run on a single edge device.
KW - Edge Computing
KW - Mask Detection
KW - Object Detection
UR - http://www.scopus.com/inward/record.url?scp=85168557591&partnerID=8YFLogxK
U2 - 10.1109/ICCCR56747.2023.10193943
DO - 10.1109/ICCCR56747.2023.10193943
M3 - Conference Proceeding
AN - SCOPUS:85168557591
T3 - 2023 3rd International Conference on Computer, Control and Robotics, ICCCR 2023
SP - 33
EP - 40
BT - 2023 3rd International Conference on Computer, Control and Robotics, ICCCR 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 3rd International Conference on Computer, Control and Robotics, ICCCR 2023
Y2 - 24 March 2023 through 26 March 2023
ER -