Accuracy evaluation of threshold rainfall impacting pedestrian using ROC

Kyungsu Choo; Dongho Kang; Byungsik Kim

doi:10.3741/JKWRA.2020.53.12.1173

All Issue

2020 Vol.53, Issue 12 Preview Page Next Page

Research Article

Accuracy evaluation of threshold rainfall impacting pedestrian using ROC ROC를 이용한 보행에 영향을 미치는 한계강우량의 정확도 평가

31 December 2020. pp. 1173-1181

PDF XML

Abstract

Recently, as local heavy rains occur frequently in a short period of time, economic and social impacts are increasing beyond the simple primary damage. In advanced meteorologically advanced countries, realistic and reliable impact forecasts are conducted by analyzing socio-economic impacts, not information transmission as simple weather forecasts. In this paper, the degree of flooding was derived using the Spatial Runoff Assessment Tool (S-RAT) and FLO-2D models to calculate the threshold rainfall that can affect human walking, and the threshold rainfall of the concept of Grid to Grid (G2G) was calculated. In addition, although it was used a lot in the medical field in the past, a quantitative accuracy analysis was performed through the ROC analysis technique, which is widely used in natural phenomena such as drought or flood and machine learning. As a result of the analysis, the results of the time period similar to that of the actual and simulated immersion were obtained, and as a result of the ROC (Receiver Operating Characteristic) curve, the adequacy of the fair stage was secured with more than 0.7.

Keywords

Urban flooding

Impact forecast

Flood simulation

ROC

Threshold rainfall

최근 단기간의 국지성호우가 빈번하게 발생하면서 단순 1차적 피해를 넘어 경제적, 사회적 영향이 커지고 있다. 기상선진국에서는 단순 기상예보로서의 정보전달이 아닌 사회 경제적 영향을 분석하여 현실적이고 신뢰할 수 있는 영향예보를 실시하고 있다. 본 논문에서는 사람의 보행에 영향을 미칠 수 있는 영향한계강우량을 산정하기 위해서 Spatial Runoff Assessment Tool (S-RAT), FLO-2D 모델을 사용하여 침수정도를 도출하였고 Grid to Grid (G2G)개념의 한계강우량을 산정하였다. 또한, 과거 의학 분야에서 많이 사용하였지만 현재는 가뭄이나 홍수 등의 자연현상 및 머신러닝에 많이 사용하는 ROC 분석 기법을 통해 정량적인 정확도분석을 실시하였다. 분석 결과 실제 침수와 모의 침수가 비슷한 시간대의 결과가 나왔으며 ROC 곡선의 결과 0.7이상으로 Fair 단계의 적정성을 확보하였다.

키워드

도시침수

영향예보

침수모의

ROC

한계강우량

References

Bae, S.J., Ahn, D.B., Yoo, H.W., and Lee, C.M. (2017). "Optimization of underground water reservoir location problem for preventing floods-seoul case study." Journal of the Korean Institute of Industrial Engineers, Vol. 43, No. 4, pp. 308-317. 10.7232/JKIIE.2017.43.4.308

Fawcett, T. (2006), "An introduction to ROC analysis." Pattern Recognition Letters, No. 27, pp. 861-874. 10.1016/j.patrec.2005.10.010

Gariano, S.L., Brunetti, M.T., Iovine, G., Melilloa, M., Peruccacci, S., Terranova, O, Vennari, C., and Guzzetti, F. (2015), "Calibration and validation of rainfall thresholds for shallow landslide forecasting in Sicily, southern Italy." Geomorphology, Vol. 228 pp. 653-665. 10.1016/j.geomorph.2014.10.019

Hanson, P., and Weltzin, J. (2000). "Drought disturbance from climate change: Response of United States forests." The Science of the Total Environment, Vol. 262, pp. 205-220. 10.1016/S0048-9697(00)00523-4

Heckerling, P.S. (2002). "Parametric receiver operating characteristic curve analysis using mathematica." Computer Methods and Programs in Biomedicine, Vol. 69, No. 1, pp. 65-73. 10.1016/S0169-2607(01)00179-1

Jeong, K.Y. (2016), "Impact forecast vision and direction." Meteorological Technology & Policy, Vol. 9, No. 1, pp. 6-22.

Jeong, M.S., Kim, J.S., Jang, H.W., and Lee, J.H. (2016). "ROC evaluation for MLP ANN drought forecasting model." Journal of Korea Water Resource Association, Vol. 49, No. 10, pp. 877-885. 10.3741/JKWRA.2016.49.10.877

Jia, P., Liu, R., Ma, M., Liu, Q., Wang, Y., Zhai, X., Xu, S., and Wang, D. (2019). "Flash flood simulation for ungauged catchments based on the distributed hydrological model." Water, Vol. 11, p. 76. 10.3390/w11010076

Kang, S.M., Park, M.J., Kim, S.H., and Kim S.J. (2007). "A study on the mitigation of inundation damage using flood inundation analysis model FLUMEN." Journal Of The Korean Society of Civil Engineers, Vol. 27, pp. 583-590.

Keum, H.J., Kim, H.I., and Han, K.Y. (2018). "Real-time forecast of rainfall impact on urban inundation." Journal of the Korean Association of Geographic Information Studies, Vol. 21, No. 3, pp. 76-92.

Kim, B.S., Yoon, S.K., Hong, S.J., and Kwon, H.H. (2010). "Development of grid-based conceptual hydrologic model." Korea Water Resoures Association, Vol. 42, No. 7, pp. 667-679. 10.3741/JKWRA.2010.43.7.667

Kim, G.S., and Lee, J.W. (2011). "Evaluation on drought indices using the drought Records." Journal of Korea Water Resource Association, Vol. 44, No. 8, pp. 639-652. 10.3741/JKWRA.2011.44.8.639

Kim, H.M., Min, K.R., Kim, I.G., Lim, B.H., Youn, M.J., and Kim, S.B. (2017). "Paradigm shift to impact-based forecasting and warning services for natural hazard response." Korea Society of Innovation, Vol. 12, No. 3, pp. 161-178. 10.46251/INNOS.2017.08.12.3.161

Lee, B.J. (2017). "Analysis on inundation characteristics for flood impact forecasting in Gangnam drainage basin." Atmosphere, Vol. 27, No. 2, pp. 189-197.

Lee, J.T., Seo, K.A., and Hur, S.C. (2010). "Flood forecasting and warning system using real-time hydrologic observed data from the Jungnang stream basin." Korea Water Resources Association, Vol. 33, No. 1, pp. 51-65. 10.3741/JKWRA.2010.43.1.51

Lee, J.Y., Kim, D.K., Park, K.W., and Kim, T.W. (2019). "Establishment of accuracy criteria of flood inundation map using quantitative evaluation indices." Journal of The Korean Society Of Civil Engineers, Vol. 39, No. 3, pp. 381-389.

Lee, K.S., Lee, D.E., Jung, S.H., and Lee, G.H. (2018), "Analysis of large-scale flood inundation area using optimal topographic factors." Journal of Korea Water Resources Association, Vol. 51, No. 6, pp. 481-490.

Lee, S.H., Kang, D.H., and Kim, B.S. (2018). "A study on the method of calculating the threshold rainfall for rainfall impact forecasting." Journal of the Korean Society of Hazard Mitigation, Vol. 18, pp. 93-102. 10.9798/KOSHAM.2018.18.7.93

Liao, H.Y., Pan, T.Y., Chang, H.K., Hsieh, C.T., Lai, J.S., Tan, Y.C., and Su, M.D. (2019). "Using Tabu Search adjusted with urban sewer flood simulation to improve pluvial flood warning via rainfall thresholds." Water, Vol. 11, p. 348. 10.3390/w11020348

Lusted, L.B. (1960). "Logical analysis in roentgen diagnosis." Radiology, Vol. 74, pp. 178-193. 10.1148/74.2.17814419034

Metz, C.E. (1978). "Basic principles of ROC analysis." Seminars in Nuclear Medicine, Vol. 8, pp. 283-298. 10.1016/S0001-2998(78)80014-2

Ministry of Public Safety and Security (MPSS) (2015). 2015 Disaster Annual Report, p. 222.

Muller, M.P., Tomlinson, G., Marrie, T.J., Tang, P., McGeer, A., Donald, E.L., Detsky, A.S., and Gold, W.L. (2005). "Can routine laboratory tests discriminate between severe acute respiratory syndrome and other causes of community-acqured pneumonia?" Clinical Infectious Diseases, Vol. 40, pp. 1079-1086. 10.1086/42857715791504PMC7107805

Simões, N.E., Rodríguez, S.O., Wand, L.P., Pina, R.D., Marques, A.S., Onof, C., and Leitão, J.P. (2015). "Stochastic urban pluvial flood hazard maps based upon a spatial-temporal rainfall generator." Water, Vol. 7, No. 7, pp. 3396-3406. 10.3390/w7073396

Swets, J.A. (1988). "Easuring the accuracy of diagnostic systems." Science, Vol. 240, No. 4857, pp. 1285-1293. 10.1126/science.32876153287615

Yoo, J.Y., Song H.Y., Kim, T.W., and Ahn, J.H. (2013). "Evaluation of short-term drought using daily standardized precipitation index and ROC analysis." Journal of The Korean Society of Civil Engineers, Vol. 33, No. 5, pp. 1851-1860. 10.12652/Ksce.2013.33.5.1851

Information

Publisher :KOREA WATER RESOURECES ASSOCIATION
Publisher(Ko) :한국수자원학회
Journal Title :Journal of Korea Water Resources Association
Journal Title(Ko) :한국수자원학회 논문집
Volume : 53
No :12
Pages :1173-1181
Received Date : 2020-11-04
Revised Date : 2020-11-16
Accepted Date : 2020-11-16
DOI :https://doi.org/10.3741/JKWRA.2020.53.12.1173

Journal of Korea Water Resources AssociationISSN:2799-8746(Print) 2799-8754(Online)한국수자원학회

All Issue