Repo for flood prediction using LSTMs and HAND

Overview

Abstract

Every year, floods cause billions of dollars’ worth of damages to life, crops, and property. With a proper early flood warning system in place, decision-makers can take the necessary steps to prevent or at least mitigate the damage caused by floods. Although various flood prediction models exist, a majority of them fail to be fast, reliable, and detailed simultaneously. Our proposed system presents a novel hybrid flood prediction model using Long Short Term Memory(LSTM) for multivariate time series forecasting of water depth based on meteorological conditions and Height Above Nearest Drainage(HAND) to predict river stage in real-time and map the inundated areas for the corresponding water depth using enhanced HAND. Unlike traditional flood forecasting models, this hybrid approach is resource efficient and easy to implement making it highly practicable for real-time flood inundation mapping.

Methodology

The proposed system prioritizes quick development and real-time predictions without compromising on the accuracy. A range of factors affect the occurrences of riverine floods. However, climatological conditions are the major driving force behind them. Factors such as land use/land change and deforestation, although important, only affect flooding in the watershed over a long period of time. Hence, the proposed system used only meteorological conditions and DEM rasters for predicting floods over the next few days.

The relation between weather conditions and flood inundation is simplified by breaking the system into two modules. The first module being estimation of river stage height and the second one being flood inundation mapping. The system uses LSTMs, a data-driven empirical approach, to model the dependence of stage height on meteorological data and HAND, a simplified conceptual approach, to generate flood inundation maps based on the terrain of the watershed and the river stage height predicted by the first module.

Modules :

  1. Inundation Mapping - HAND algorithm to map inundated areas for a given stage height(as proposed in this paper).
  2. River Stage Estimation - Recurring neural networks (LSTMs) to predict the maximum stage height based on weather conditions of the last 3 days.
  3. Deforestation Analysis - Land use classification to identify the changing features of the area over time and identify the areas affected by deforestation.

Datasets

The proposed system uses different data for the three modules. Each of these are collected from different sources and processed separately. The module-wise requirements of data are as follows :

  1. Inundation Mapping:
    1. Digital Elevation Maps from United States Geological Survey
  2. River Stage Estimation:
    1. Meteorological data from National Climatic Data Center
    2. River stage height data from United States Army Corps of Engineers’ river gage data.
  3. Deforestation Analysis:
    1. Satellite images - Landsat 8, Landsat 5 from USGS Earth Explorer

Results

Stage Height Estimation

We tested our proposed system for Cedar Rapids, Iowa. Our experiments showed that features such as vegetation and soil type have little effect on short term flooding and can be disregarded for the prediction module. Testing multiple models showed that single output LSTM models perform better than single shot models. These models are stable upto lead times of 4 days with a Nash-Sutcliffe Efficiency greater than 0.5.

Flood Mapping

Each pixel of the inundation map raster is compared with a reference map created by ground-truthing to identify how many points were incorrectly classified as not flooded. The red areas in the image depict false negatives generated by the proposed system.

Wordle Env: A Daily Word Environment for Reinforcement Learning

Wordle Env: A Daily Word Environment for Reinforcement Learning Setup Steps: git pull [email&#

2 Mar 28, 2022
CCAFNet: Crossflow and Cross-scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images

Code and result about CCAFNet(IEEE TMM) 'CCAFNet: Crossflow and Cross-scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images' IEE

zyrant丶 14 Dec 29, 2021
Example Of Fine-Tuning BERT For Named-Entity Recognition Task And Preparing For Cloud Deployment Using Flask, React, And Docker

Example Of Fine-Tuning BERT For Named-Entity Recognition Task And Preparing For Cloud Deployment Using Flask, React, And Docker This repository contai

Nikita 12 Dec 14, 2022
Machine Translation Implement By Bi-GRU And Transformer

Seq2Seq Translation Implement By Bidirectional GRU And Transformer In Pytorch Before You Run The Code You should download the data through the link be

He Wang 2 Oct 27, 2021
A large-scale video dataset for the training and evaluation of 3D human pose estimation models

ASPset-510 ASPset-510 (Australian Sports Pose Dataset) is a large-scale video dataset for the training and evaluation of 3D human pose estimation mode

Aiden Nibali 36 Oct 30, 2022
Atomistic Line Graph Neural Network

Table of Contents Introduction Installation Examples Pre-trained models Quick start using colab JARVIS-ALIGNN webapp Peformances on a few datasets Use

National Institute of Standards and Technology 91 Dec 30, 2022
Composing methods for ML training efficiency

MosaicML Composer contains a library of methods, and ways to compose them together for more efficient ML training.

MosaicML 2.8k Jan 08, 2023
PyTorch implementation for the visual prior component (i.e. perception module) of the Visually Grounded Physics Learner [Li et al., 2020].

VGPL-Visual-Prior PyTorch implementation for the visual prior component (i.e. perception module) of the Visually Grounded Physics Learner (VGPL). Give

Toru 8 Dec 29, 2022
PyTorch implementation of PP-LCNet: A Lightweight CPU Convolutional Neural Network

PyTorch implementation of PP-LCNet Reproduction of PP-LCNet architecture as described in PP-LCNet: A Lightweight CPU Convolutional Neural Network by C

Quan Nguyen (Fly) 47 Nov 02, 2022
【CVPR 2021, Variational Inference Framework, PyTorch】 From Rain Generation to Rain Removal

From Rain Generation to Rain Removal (CVPR2021) Hong Wang, Zongsheng Yue, Qi Xie, Qian Zhao, Yefeng Zheng, and Deyu Meng [PDF&&Supplementary Material]

Hong Wang 48 Nov 23, 2022
VoxHRNet - Whole Brain Segmentation with Full Volume Neural Network

VoxHRNet This is the official implementation of the following paper: Whole Brain Segmentation with Full Volume Neural Network Yeshu Li, Jonathan Cui,

Microsoft 12 Nov 24, 2022
ISBI 2022: Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image.

Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Introduction This repository contains the PyTorch implem

25 Nov 09, 2022
ML-based medical imaging using Azure

Disclaimer This code is provided for research and development use only. This code is not intended for use in clinical decision-making or for any other

Microsoft Azure 68 Dec 23, 2022
Code for Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks Under construction. Description Code for Phase diagram of S

Rodrigo Veiga 3 Nov 24, 2022
DrWhy is the collection of tools for eXplainable AI (XAI). It's based on shared principles and simple grammar for exploration, explanation and visualisation of predictive models.

Responsible Machine Learning With Great Power Comes Great Responsibility. Voltaire (well, maybe) How to develop machine learning models in a responsib

Model Oriented 590 Dec 26, 2022
[v1 (ISBI'21) + v2] MedMNIST: A Large-Scale Lightweight Benchmark for 2D and 3D Biomedical Image Classification

MedMNIST Project (Website) | Dataset (Zenodo) | Paper (arXiv) | MedMNIST v1 (ISBI'21) Jiancheng Yang, Rui Shi, Donglai Wei, Zequan Liu, Lin Zhao, Bili

683 Dec 28, 2022
ML-PersonalWork - Big assignment PersonalWork in Machine Learning, 2021 autumn BUAA.

ML-PersonalWork - Big assignment PersonalWork in Machine Learning, 2021 autumn BUAA.

Snapdragon Lee 2 Dec 16, 2022
(Python, R, C/C++) Isolation Forest and variations such as SCiForest and EIF, with some additions (outlier detection + similarity + NA imputation)

IsoTree Fast and multi-threaded implementation of Extended Isolation Forest, Fair-Cut Forest, SCiForest (a.k.a. Split-Criterion iForest), and regular

141 Dec 29, 2022
DSTC10 Track 2 - Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations

DSTC10 Track 2 - Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations This repository contains the data, scripts and baseline co

Alexa 51 Dec 17, 2022
An implementation of RetinaNet in PyTorch.

RetinaNet An implementation of RetinaNet in PyTorch. Installation Training COCO 2017 Pascal VOC Custom Dataset Evaluation Todo Credits Installation In

Conner Vercellino 297 Jan 04, 2023