바로가기메뉴

본문 바로가기 주메뉴 바로가기

(사)한국터널지하공간학회

Development of a deep-learning based tunnel incident detection system on CCTVs

(사)한국터널지하공간학회 / (사)한국터널지하공간학회, (P)2233-8292; (E)2287-4747
2017, v.19 no.6, pp.915-936
https://doi.org/10.9711/KTAJ.2017.19.6.915




Abstract

In this study, current status of Korean hazard mitigation guideline for tunnel operation is summarized. It shows that requirement for CCTV installation has been gradually stricted and needs for tunnel incident detection system in conjunction with the CCTV in tunnels have been highly increased. Despite of this, it is noticed that mathematical algorithm based incident detection system, which are commonly applied in current tunnel operation, show very low detectable rates by less than 50%. The putative major reasons seem to be (1) very weak intensity of illumination (2) dust in tunnel (3) low installation height of CCTV to about 3.5 m, etc. Therefore, an attempt in this study is made to develop an deep-learning based tunnel incident detection system, which is relatively insensitive to very poor visibility conditions. Its theoretical background is given and validating investigation are undertaken focused on the moving vehicles and person out of vehicle in tunnel, which are the official major objects to be detected. Two scenarios are set up: (1) training and prediction in the same tunnel (2) training in a tunnel and prediction in the other tunnel. From the both cases, targeted object detection in prediction mode are achieved to detectable rate to higher than 80% in case of similar time period between training and prediction but it shows a bit low detectable rate to40% when the prediction times are far from the training time without further training taking place. However, it is believed that the AI based system would be enhanced in its predictability automatically as further training are followed with accumulated CCTV BigData without any revision or calibration of the incident detection system.

keywords
터널 영상유고감지 시스템, 딥러닝 알고리즘, 터널 CCTV, 영상처리, 터널 객체 영상 빅데이터, Automatic tunnel incident detection system, Deep learning algorithm, Tunnel CCTV, Image processing, Tunnel object image big data

Reference

1.

1. Choi, J.M., Kwon, J.O. (2010), “Converged security market trend report”, Samsung SDS, Samsung SDS Journal of IT Services, Vol.7, No. 2, pp. 13-29.

2.

2. Everingham, M., Gool, L.V., Williams, C.K.I., Winn, J., Zisserman, A. (2010), “The pascal visual object classes (VOC) challenge”, International Journal of Computer Vision, Vol. 88, No. 2, pp. 303-338.

3.

3. Geiger, A., Lenz, P., Stiller, C., Urtasun, R. (2013), “Vision meets robotics: The KITTI dataset”, The International Journal of Robotics Research, Vol. 32, No. 11, pp. 1231-1237.

4.

4. Girshick, R., Donahue, J., Darrell, T., Malik, J. (2014), “Rich feature hierarchies for accurate object detection and semantic segmentation”, The IEEE conference on Computer Vision and Pattern Recognition, pp. 580-587.

5.

5. Girshick, R. (2015), “Fast R-CNN”, The IEEE international conference on computer vision, pp. 1440-1448.

6.

6. Hinton, G.E., Osindero, S., Teh, Y.W. (2006), “A fast learning algorithm for deep belief nets”, Neural Computation, Vol. 18, No. 7, pp. 1527-1554.

7.

7. Simonyan, K., Zisserman, A. (2014), “Very deep convolutional networks for large-scale image recognition”, arXiv preprint, arXiv: 1409.1556.

8.

8. Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L. (2014), “Large-scale video classification with convolutional neural networks”, The IEEE conference on Computer Vision and Pattern Recognition. pp. 1725-1732.

9.

9. Kim, T.B. (2016), “The national highway, expressway tunnel video incident detection system performance analysis and reflect attributes for double deck tunnel in great depth underground space”, Journal of the Korea Institute of Information and Communication Engineering, Vol. 20, No. 7, pp. 1325-1334.

10.

10. Korea Tunneling and Underground Space Association (KTA) (2015), Study on revision of installation and operation guideline for hazard mitigation facilities of road tunnels, Ministry of Land Infrastructure and Transport (MOLIT), pp. 326.

11.

11. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L. (2014), “Microsoft coco: Common objects in context”, European Conference on Computer Vision. Springer, Cham, pp. 740-755.

12.

12. Ministry of Land, Infrastructure and Transport (MOLIT) (2016a), “Attempt for faultless safety system of road tunnels”, Press Release.

13.

13. Ministry of Land, Infrastructure and Transport (MOLIT) (2016b), Guideline of installation and management of disaster prevention facilities on road tunnels.

14.

14. Mu, Z. (2004), “Recall, precision and average precision”, Working Paper, Department of Statistics and Actuarial Science, University of Waterloo, Vol. 2, pp. 30.

15.

15. National Committee for Land and Transport (2016), “Tunnel accidents increase, but tunnel incident automatic detection system often fails in operation”, Press Release from parliamentary inspection of MOLIT. Congressman Yoon Hoo-Dyuk.

16.

16. Park, J.K., Park, Y.K., On, H.I., Kang, D.J. (2015), “Object perception methods in image using deep learning”, Institute of Control, Robotics and Systems, Journal of Institute of Control, Robotics and Systems, Vol. 21, No. 4, pp. 21-26.

17.

17. Ren, S., He, K., Girshick, R., Sun, J. (2015), “Faster R-CNN: Towards real-time object detection with region proposal networks”, Advances in Neural Information Processing Systems 28, pp. 91-99.

18.

18. Roh, C.G., Park, B.J., Kim, J.S. (2016), “A study on the contents for operation of tunnel management systems using a view synthesis technology”, The Journal of the Korea Contents Association, Vol. 16, No. 6, pp. 507-515.

19.

19. Samuel, A.L. (1959), “Some studies in machine learning using the game of checkers”, IBM Journal of Research and Development, Vol. 3, No. 3, pp. 210-229.

20.

20. Shin, H.S., Kim, D.K., Yim, M.J., Lee, K.B., Oh, Y.S. (2017), “A preliminary study for development of an automatic incident detection system on CCTV in tunnels based on a machine learning algorithm”, Journal of Korean Tunnelling and Underground Space Association, Vol. 19, No. 1, pp. 96-107.

21.

21. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. (2014), “Dropout: a simple way to prevent neural networks from overfitting”, Journal of Machine Learning Research, Vol. 15, No. 1, pp. 1929-1958.

22.

22. LeCun, Y., Boser, B.E., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W.E., Jackel, L.D. (1990), “Handwritten digit recognition with a back-propagation network”, Advances in Neural Information Processing Systems, pp. 396-404.

23.

23. LeCun, Y., Yoshua, B., Geoffrey, H. (2015), “Deep learning”, Nature, Vol. 521, pp. 436-444.

24.

24. Yoshua, B., Courville, A., Vincent, P. (2013), “Representation learning: a review and new perspectives”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 8, pp. 1798-1828.

(사)한국터널지하공간학회