a practicable framework used in Deep Learning. So far UDL only provide DCFNet implementation for the ICCV paper (Dynamic Cross Feature Fusion for Remote Sensing Pansharpening)

Related tags

Deep LearningUDL
Overview

UDL

UDL is a practicable framework used in Deep Learning (computer vision).

Benchmark

codes, results and models are available in UDL, please contact @Liang-Jian Deng (corresponding author)

Pansharpening model zoo:
  • PNN (RS'2016)
  • PanNet (CVPR'2017)
  • DiCNN1 (JSTAR'2019)
  • FusionNet (TGRS'2020)
  • DCFNet (ICCV'2021)

Results of DCFNet

Quantitative results

wv3 SAM ERGAS
new_data10 3.934 2.531
new_data11 4.133 2.630
new_data12_512 4.108 2.712
new_data6 2.638 1.461
new_data7 3.866 2.820
new_data8 3.257 2.210
new_data9 4.154 2.718
Avg(std) 3.727(0.571) 2.440(0.474)
Ideal Value 0 0
wv3_1258 SAM ERGAS
Avg(std) 3.377(1.200) 2.257(0.910)
Ideal Value 0 0

Visual results

please see the paper and the sub-directory: ./UDL/results/DCFNet

Install [Option]

please run python setup.py develop

Usage

open UDL/panshaprening/tests, run the following code:

python run_DCFNet.py

Note that default configures don't fit other environments, you can modify configures in pansharpening/models/DCFNet/option_DCFNet.py.

Benefit from mmcv/config.py, the project has the global configures in Basis/option.py, option_DCFNet inherits directly from Basis/option.py.

1. Data preparation

You need to download WorldView-3 datasets.

The directory tree should be look like this:

|-$ROOT/datasets
├── pansharpening
│   ├── training_data
│   │   ├── train_wv3_10000.h5
│   │   ├── valid_wv3_10000.h5
│   ├── test_data
│   │   ├── WV3_Simu
│   │   │   ├── new_data6.mat
│   │   │   ├── new_data7.mat
│   │   │   ├── ...
│   │   ├── WV3_Simu_mulExm
│   │   │   ├── test1_mulExm1258.mat

2. Training

args.eval = False, args.dataset='wv3'

3. Inference

args.eval = True, args.dataset='wv3_singleMat'

Plannings

Please expect more tasks and models

  • pansharpening

    • models
  • derain

    • models
  • HISR

    • models

Contribution

We appreciate all contributions to improve UDL. Looking forward to your contribution to UDL.

Citation

If you use this toolbox or benchmark in your research, please cite this project.

@InProceedings{Wu_2021_ICCV,
    author    = {Wu, Xiao and Huang, Ting-Zhu and Deng, Liang-Jian and Zhang, Tian-Jing},
    title     = {Dynamic Cross Feature Fusion for Remote Sensing Pansharpening},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2021},
    pages     = {14687-14696}
}

Acknowledgement

  • MMCV: OpenMMLab foundational library for computer vision.
  • HRNet : High-resolution networks and Segmentation Transformer for Semantic Segmentation

License & Copyright

This project is open sourced under GNU General Public License v3.0

Owner
Xiao Wu
Xiao Wu
Hardware accelerated, batchable and differentiable optimizers in JAX.

JAXopt Installation | Examples | References Hardware accelerated (GPU/TPU), batchable and differentiable optimizers in JAX. Installation JAXopt can be

Google 621 Jan 08, 2023
Implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

SinGAN This is an unofficial implementation of SinGAN from someone who's been sitting right next to SinGAN's creator for almost five years. Please ref

35 Nov 10, 2022
A knowledge base construction engine for richly formatted data

Fonduer is a Python package and framework for building knowledge base construction (KBC) applications from richly formatted data. Note that Fonduer is

HazyResearch 386 Dec 05, 2022
EssentialMC2 Video Understanding

EssentialMC2 Introduction EssentialMC2 is a complete system to solve video understanding tasks including MHRL(representation learning), MECR2( relatio

Alibaba 106 Dec 11, 2022
Rl-quickstart - Reinforcement Learning Quickstart

Reinforcement Learning Quickstart To get setup with the repository, git clone ht

UCLA DataRes 3 Jun 16, 2022
Sleep staging from ECG, assisted with EEG

Sleep_Staging_Knowledge Distillation This codebase implements knowledge distillation approach for ECG based sleep staging assisted by EEG based sleep

2 Dec 12, 2022
Naszilla is a Python library for neural architecture search (NAS)

A repository to compare many popular NAS algorithms seamlessly across three popular benchmarks (NASBench 101, 201, and 301). You can implement your ow

270 Jan 03, 2023
Sound-guided Semantic Image Manipulation - Official Pytorch Code (CVPR 2022)

🔉 Sound-guided Semantic Image Manipulation (CVPR2022) Official Pytorch Implementation Sound-guided Semantic Image Manipulation IEEE/CVF Conference on

CVLAB 58 Dec 28, 2022
Code accompanying "Adaptive Methods for Aggregated Domain Generalization"

Adaptive Methods for Aggregated Domain Generalization (AdaClust) Official Pytorch Implementation of Adaptive Methods for Aggregated Domain Generalizat

Xavier Thomas 15 Sep 20, 2022
A multi-mode modulator for multi-domain few-shot classification (ICCV)

A multi-mode modulator for multi-domain few-shot classification (ICCV)

Yanbin Liu 8 Apr 28, 2022
Group Fisher Pruning for Practical Network Compression(ICML2021)

Group Fisher Pruning for Practical Network Compression (ICML2021) By Liyang Liu*, Shilong Zhang*, Zhanghui Kuang, Jing-Hao Xue, Aojun Zhou, Xinjiang W

Shilong Zhang 129 Dec 13, 2022
source code the paper Fast and Robust Iterative Closet Point.

Fast-Robust-ICP This repository includes the source code the paper Fast and Robust Iterative Closet Point. Authors: Juyong Zhang, Yuxin Yao, Bailin De

yaoyuxin 320 Dec 28, 2022
An implementation of the WHATWG URL Standard in JavaScript

whatwg-url whatwg-url is a full implementation of the WHATWG URL Standard. It can be used standalone, but it also exposes a lot of the internal algori

314 Dec 28, 2022
OMNIVORE is a single vision model for many different visual modalities

Omnivore: A Single Model for Many Visual Modalities [paper][website] OMNIVORE is a single vision model for many different visual modalities. It learns

Meta Research 451 Dec 27, 2022
Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Real-ESRGAN Colab Demo for Real-ESRGAN . Portable Windows executable file. You can find more information here. Real-ESRGAN aims at developing Practica

Xintao 17.2k Jan 02, 2023
This is the official code release for the paper Shape and Material Capture at Home

This is the official code release for the paper Shape and Material Capture at Home. The code enables you to reconstruct a 3D mesh and Cook-Torrance BRDF from one or more images captured with a flashl

89 Dec 10, 2022
sktime companion package for deep learning based on TensorFlow

NOTE: sktime-dl is currently being updated to work correctly with sktime 0.6, and wwill be fully relaunched over the summer. The plan is Refactor and

sktime 573 Jan 05, 2023
A synthetic texture-invariant dataset for object detection of UAVs

A synthetic dataset for object detection of UAVs This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial datas

LARICS Lab 10 Aug 13, 2022
object recognition with machine learning on Respberry pi

Respberrypi_object-recognition object recognition with machine learning on Respberry pi line.py 建立一支與樹梅派連線的 linebot 使用此 linebot 遠端控制樹梅派拍照 config.ini l

1 Dec 11, 2021
The source codes for TME-BNA: Temporal Motif-Preserving Network Embedding with Bicomponent Neighbor Aggregation.

TME The source codes for TME-BNA: Temporal Motif-Preserving Network Embedding with Bicomponent Neighbor Aggregation. Our implementation is based on TG

2 Feb 10, 2022