Development of real-time defect detection technology for water distribution and sewerage networks

Dong Chae Park; Young Hwan Choi

doi:10.3741/JKWRA.2022.55.S-1.1177

All Issue

2022 Vol.55, Issue 12S Preview Page Next Page

Research Article

Development of real-time defect detection technology for water distribution and sewerage networks 시나리오 기반 상·하수도 관로의 실시간 결함검출 기술 개발

31 December 2022. pp. 1177-1185

PDF XML

Abstract

The water and sewage system is an infrastructure that provides safe and clean water to people. In particular, since the water and sewage pipelines are buried underground, it is very difficult to detect system defects. For this reason, the diagnosis of pipelines is limited to post-defect detection, such as system diagnosis based on the images taken after taking pictures and videos with cameras and drones inside the pipelines. Therefore, real-time detection technology of pipelines is required. Recently, pipeline diagnosis technology using advanced equipment and artificial intelligence techniques is being developed, but AI-based defect detection technology requires a variety of learning data because the types and numbers of defect data affect the detection performance. Therefore, in this study, various defect scenarios are implemented using 3D printing model to improve the detection performance when detecting defects in pipelines. Afterwards, the collected images are performed to pre-processing such as classification according to the degree of risk and labeling of objects, and real-time defect detection is performed. The proposed technique can provide real-time feedback in the pipeline defect detection process, and it would be minimizing the possibility of missing diagnoses and improve the existing water and sewerage pipe diagnosis processing capability.

Keywords

Pipeline defect detection

Artificial intelligence

Image data training

Real-time detection and diagnosis

상·하수도 시스템은 사람들에게 안전하고 깨끗한 물을 공급해주는 사회기반시설이며, 특히 상·하수도 관로는 지중에 매설되어 있기 때문에 시스템의 결함검출이 매우 어렵다. 이러한 이유로 상·하수도 관로의 진단은 관로 내부에 카메라 및 드론을 통한 촬영을 하여 사후에 촬영된 영상을 바탕으로 시스템 진단하는 등의 사후 결함검출로 제한되기 때문에, 작업자의 업무 효율 증대와 진단의 신속성을 위해서는 관로의 실시간 탐지기술이 필요하다. 최근 첨단장비 및 인공지능 기법을 활용한 시설물 진단 기술이 개발되고 있지만, 인공지능기반 결함검출 기술은 결함 데이터의 종류 및 형태, 수가 검출 성능에 영향을 주기 때문에 다양한 학습데이터가 필요하다. 따라서, 본 연구에서는 상·하수도 관로의 결함검출 시 탐지 성능 향상을 위해 다양한 결함 시나리오를 3D 프린트를 이용하여 구현하고 이를 수집된 결함 데이터와 함께 학습데이터로 사용한다. 이후 수집된 이미지는 위험도에 따른 분류 및 객체의 라벨링 등의 전처리 작업이 수행되고 실시간 결함탐지를 수행한다. 제안된 기법은 상·하수도시스템 결함검출 시 실시간 피드백을 제공함으로써, 작업자의 진단 누락 가능성을 최소화하며 기존의 상·하수도관 진단업무 처리능력을 향상할 수 있다.

키워드

상·하수도 결함탐지

인공지능

이미지 데이터 학습

실시간 검출 및 진단

References

Cha, Y.J., Choi, W., and Büyüköztürk, O. (2017). “Deep learning-based crack damage detection using convolutional neural networks.” Computer - Aided Civil and Infrastructure Engineering, Vol. 32, No. 5, pp. 361-378. 10.1111/mice.12263

Duran, O., Althoefer, K., and Seneviratne, L.D. (2007). “Automated pipe defect detection and categorization using camera/laser-based profiler and artificial neural network.” IEEE Transactions on Automation Science and Engineering, Vol. 4, No. 1, pp. 118-126. 10.1109/TASE.2006.873225

Gillins, M.N. (2016). Unmanned aircraft systems for bridge inspection: Testing and developing end-to-end operational workflow. Masters Thesis, Oregon State University, Corvallis, OR, U.S.

Girshick, R. (2015). “Fast R-CNN.” 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, pp. 1440-1448. doi: 10.1109/ICCV.2015.169. 10.1109/ICCV.2015.169

Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014). “Rich feature hierarchies for accurate object detection and semantic segmentation.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, U.S., pp. 580-587. 10.1109/CVPR.2014.81

Hassan, S.I., Dang, L.M., Im, S.H., Min, K.B., Nam, J.Y., and Moon, H.J. (2018). “Damage detection and classification system for sewer inspection using convolutional neural networks based on deep learning.” Journal of the Korea Institute of Information and Communication Engineering, Vol. 22, No. 3, pp. 451-457.

He, K., Zhang, X., Ren, S., and Sun, J. (2016). “Deep residual learning for image recognition.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, U.S., pp. 770-778 10.1109/CVPR.2016.90

Kim, H.Y., Choi, K.A., and Lee, I.P. (2018). “Drone image-based facility inspection-focusing on automatic process using reference images.” Journal of the Korean Society for Geospatial Information Science, Vol. 26, No. 2, pp. 21-32. 10.7319/kogsis.2018.26.2.021

Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, Vol. 60, No. 6, pp. 84-90. 10.1145/3065386

K-water (2018). Application of deep-learning techniques to in-line inspection data.

Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). “Ssd: Single shot multibox detector.” European Conference on Computer Vision, Springer, Amsterdam, The Netherlands, pp. 21-37. 10.1007/978-3-319-46448-0_2

Magalhães, S.A., Castro, L., Moreira, G., Dos Santos, F.N., Cunha, M., Dias, J., and Moreira, A.P. (2021). “Evaluating the single-shot multibox detector and YOLO deep learning models for the detection of tomatoes in a greenhouse.” Sensors, Vol. 21, No. 10, 3569. 10.3390/s2110356934065568PMC8160895

Mashford, J.S., Rahilly, M., and Davis, P. (2008). “An approach using mathematical morphology and support vector machines to detect features in pipe images.” 2008 Digital Image Computing: Techniques and Applications, IEEE, Washington DC, U.S., pp. 84-89. 10.1109/DICTA.2008.25

Ministry of Land, Infrastructure and Transport (MOLIT) (2015). A study on institutionalization of social infrastructure maintenance.

Moselhi, O., and Shehab-Eldeen, T. (1999). “Automated detection of defects in underground sewer and water pipes.” Automation in Construction, Vol. 8, No. 5, pp. 581-588. 10.1016/S0926-5805(99)00007-2

Nam, W.S., Kim, G.S., and Jung, H.J. (2018). “Trends of inspection technology for concrete structures based on AI (Artificial Intelligence).” Proceedings of the Korea Concrete Institute, Vol. 30, No. 1, pp. 771-772.

Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). “You only look once: Unified, real-time object detection.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, U.S., pp. 779-788. 10.1109/CVPR.2016.91

Ren, S., He, K., Girshick, R., and Sun, J. (2015). “Faster r-cnn: Towards real-time object detection with region proposal networks.” Advances in neural information processing systems, 28: Proceeding of the Annual Conference on Neural Information Processing Systems 2015, Quebec, Canada.

Sajjanar, S., Mankani, S.K., Dongrekar, P.R., Kumar, N.S., and Aradhya, H.R. (2016). “Implementation of real time moving object detection and tracking on FPGA for video surveillance applications.” 2016 IEEE Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER), Surathkal, India, pp. 289-295. 10.1109/DISCOVER.2016.7806248

Sinha, S.K., Fieguth, P.W., and Polak, M.A. (2003). “Computer vision techniques for automatic structural assessment of underground pipes.” Computer - Aided Civil and Infrastructure Engineering, Vol. 18, No. 2, pp. 95-112. 10.1111/1467-8667.00302

Information

Publisher :KOREA WATER RESOURECES ASSOCIATION
Publisher(Ko) :한국수자원학회
Journal Title :Journal of Korea Water Resources Association
Journal Title(Ko) :한국수자원학회 논문집
Volume : 55
No :12
Pages :1177-1185
Received Date : 2022-07-21
Revised Date : 2022-09-18
Accepted Date : 2022-09-22
DOI :https://doi.org/10.3741/JKWRA.2022.55.S-1.1177

Journal of Korea Water Resources Association ISSN:2799-8746(Print) 2799-8754(Online) 한국수자원학회 논문집

All Issue