Curated list of awesome GAN applications and demo

Overview

banner

gans-awesome-applications

Curated list of awesome GAN applications and demonstrations.

Note: General GAN papers targeting simple image generation such as DCGAN, BEGAN etc. are not included in the list. I mainly care about applications.

The landmark papers that I respect.

  • Generative Adversarial Networks, [paper], [github]
  • Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks, [paper], [github]
  • Improved Techniques for Training GANs, [paper], [github]
  • BEGAN: Boundary Equilibrium Generative Adversarial Networks, [paper], [github]

Contents

Use this contents list or simply press command + F to search for a keyword


Applications using GANs

Font generation

  • Learning Chinese Character style with conditional GAN, [blog], [github]
  • Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning, [paper], [github]
  • Attribute2Font: Creating Fonts You Want From Attributes, [paper], [github]

Anime character generation

  • Towards the Automatic Anime Characters Creation with Generative Adversarial Networks, [paper]
  • [Project] A simple PyTorch Implementation of Generative Adversarial Networks, focusing on anime face drawing, [github]
  • [Project] A simple, clean TensorFlow implementation of Generative Adversarial Networks with a focus on modeling illustrations, [github]
  • [Project] Keras-GAN-Animeface-Character, [github]
  • [Project] A DCGAN to generate anime faces using custom mined dataset, [github]

Interactive Image generation

  • Generative Visual Manipulation on the Natural Image Manifold, [paper], [github]
  • Neural Photo Editing with Introspective Adversarial Networks, [paper], [github]

Text2Image (text to image)

  • TAC-GAN – Text Conditioned Auxiliary Classifier Generative Adversarial Network, [paper], [github]
  • StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, [paper], [github]
  • Generative Adversarial Text to Image Synthesis, [paper], [github], [github]
  • Learning What and Where to Draw, [paper], [github]

3D Object generation

  • Parametric 3D Exploration with Stacked Adversarial Networks, [github], [youtube]
  • Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling, [paper], [github], [youtube]
  • 3D Shape Induction from 2D Views of Multiple Objects, [paper]
  • Fully Convolutional Refined Auto-Encoding Generative Adversarial Networks for 3D Multi Object Scenes, [github], [blog]

Image Editing

  • Invertible Conditional GANs for image editing, [paper], [github]
  • Image De-raining Using a Conditional Generative Adversarial Network, [paper], [github]

Face Aging

  • Age Progression/Regression by Conditional Adversarial Autoencoder, [paper], [github]
  • CAN: Creative Adversarial Networks Generating “Art” by Learning About Styles and Deviating from Style Norms, [paper]
  • FACE AGING WITH CONDITIONAL GENERATIVE ADVERSARIAL NETWORKS, [paper]

Human Pose Estimation

  • Joint Discriminative and Generative Learning for Person Re-identification, [paper], [github], [video]
  • Pose Guided Person Image Generation, [paper]

Domain-transfer (e.g. style-transfer, pix2pix, sketch2image)

  • Image-to-Image Translation with Conditional Adversarial Networks, [paper], [github], [youtube]
  • Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks, [paper], [github], [youtube]
  • Learning to Discover Cross-Domain Relations with Generative Adversarial Networks, [paper], [github]
  • Unsupervised Creation of Parameterized Avatars, [paper]
  • UNSUPERVISED CROSS-DOMAIN IMAGE GENERATION, [paper]
  • Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks, [paper], [github]
  • Pixel-Level Domain Transfer [paper], [github]
  • TextureGAN: Controlling Deep Image Synthesis with Texture Patches, [paper], [demo]
  • Vincent AI Sketch Demo Draws In Throngs at GTC Europe, [blog], [youtube]
  • Deep Photo Style Transfer, [paper], [github]

Image Inpainting (hole filling)

  • Context Encoders: Feature Learning by Inpainting, [paper], [github]
  • Semantic Image Inpainting with Perceptual and Contextual Losses, [paper], [github]
  • SEMI-SUPERVISED LEARNING WITH CONTEXT-CONDITIONAL GENERATIVE ADVERSARIAL NETWORKS, [paper]
  • Generative Face Completion, [paper], [github]

Super-resolution

  • Image super-resolution through deep learning, [github]
  • Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, [paper], [github]
  • High-Quality Face Image Super-Resolution Using Conditional Generative Adversarial Networks, [paper]
  • Analyzing Perception-Distortion Tradeoff using Enhanced Perceptual Super-resolution Network, [paper], [github]

Image Blending

  • GP-GAN: Towards Realistic High-Resolution Image Blending, [paper], [github]

High-resolution image generation (large-scale image)

  • Generating Large Images from Latent Vectors, [blog], [github]
  • PROGRESSIVE GROWING OF GANS FOR IMPROVED QUALITY, STABILITY, AND VARIATION, [paper], [github]

Adversarial Examples (Defense vs Attack)

  • SafetyNet: Detecting and Rejecting Adversarial Examples Robustly, [paper]
  • ADVERSARIAL EXAMPLES FOR GENERATIVE MODELS, [paper]
  • Adversarial Examples Generation and Defense Based on Generative Adversarial Network, [paper]

Visual Saliency Prediction (attention prediction)

  • SalGAN: Visual Saliency Prediction with Generative Adversarial Networks, [paper], [github]

Object Detection/Recognition

  • Perceptual Generative Adversarial Networks for Small Object Detection, [paper]
  • Adversarial Generation of Training Examples for Vehicle License Plate Recognition, [paper]

Robotics

  • Unsupervised Pixel–Level Domain Adaptation with Generative Adversarial Networks, [paper], [github]

Video (generation/prediction)

  • DEEP MULTI-SCALE VIDEO PREDICTION BEYOND MEAN SQUARE ERROR, [paper], [github]

Synthetic Data Generation

  • Learning from Simulated and Unsupervised Images through Adversarial Training, [paper], [github]

Others

  • (Physics) Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis, [paper], [github]
  • (Games) STYLE TRANSFER GENERATIVE ADVERSARIAL NETWORKS: LEARNING TO PLAY CHESS DIFFERENTLY, [paper], [github]
  • (General) Spectral Normalization for Generative Adversarial Networks, [paper], [github]

Did not use GAN, but still interesting applications.

Real-time face reconstruction

  • Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction, [paper], [github], [youtube]

Super-resolution

Photorealistic Image generation (e.g. pix2pix, sketch2image)

Human Pose Estimation

  • Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation, [paper], [github]

3D Object generation

  • 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction, [paper], [github]

GAN tutorials with easy and simple example code for starters


Implementations of various types of GANs collection


Trendy AI-application Articles

Author

Minchul Shin, @nashory

Any recommendations to add to the list are welcome :)
Feel free to make pull requests!

Owner
Minchul Shin
Deep Learning, Computer Vision | Research Scientist at kakaobrain (2021-present) | ex-SWE at NAVER (2017-2021)
Minchul Shin
Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolution

FAU Implementation of the paper: Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolution. Yingruo

Evelyn 78 Nov 29, 2022
Code for "Adversarial Attack Generation Empowered by Min-Max Optimization", NeurIPS 2021

Min-Max Adversarial Attacks [Paper] [arXiv] [Video] [Slide] Adversarial Attack Generation Empowered by Min-Max Optimization Jingkang Wang, Tianyun Zha

Jingkang Wang 12 Nov 23, 2022
Pyramid Pooling Transformer for Scene Understanding

Pyramid Pooling Transformer for Scene Understanding Requirements: torch 1.6+ torchvision 0.7.0 timm==0.3.2 Validated on torch 1.6.0, torchvision 0.7.0

Yu-Huan Wu 119 Dec 29, 2022
Multi-label classification of retinal disorders

Multi-label classification of retinal disorders This is a deep learning course project. The goal is to develop a solution, using computer vision techn

Sundeep Bhimireddy 1 Jan 29, 2022
The source code for CATSETMAT: Cross Attention for Set Matching in Bipartite Hypergraphs

catsetmat The source code for CATSETMAT: Cross Attention for Set Matching in Bipartite Hypergraphs To be able to run it, add catsetmat to PYTHONPATH H

2 Dec 19, 2022
A Low Complexity Speech Enhancement Framework for Full-Band Audio (48kHz) based on Deep Filtering.

DeepFilterNet A Low Complexity Speech Enhancement Framework for Full-Band Audio (48kHz) based on Deep Filtering. libDF contains Rust code used for dat

Hendrik Schröter 292 Dec 25, 2022
PyTorch implementation of InstaGAN: Instance-aware Image-to-Image Translation

InstaGAN: Instance-aware Image-to-Image Translation Warning: This repo contains a model which has potential ethical concerns. Remark that the task of

Sangwoo Mo 827 Dec 29, 2022
Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It can use GPUs and perform efficient symbolic differentiation.

============================================================================================================ `MILA will stop developing Theano https:

9.6k Jan 06, 2023
Discriminative Condition-Aware PLDA

DCA-PLDA This repository implements the Discriminative Condition-Aware Backend described in the paper: L. Ferrer, M. McLaren, and N. Brümmer, "A Speak

Luciana Ferrer 31 Aug 05, 2022
Code base for the paper "Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation"

This repository contains code for the paper Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiati

8 Aug 28, 2022
The official PyTorch code implementation of "Human Trajectory Prediction via Counterfactual Analysis" in ICCV 2021.

Human Trajectory Prediction via Counterfactual Analysis (CausalHTP) The official PyTorch code implementation of "Human Trajectory Prediction via Count

46 Dec 03, 2022
Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative Adversarial Neural Networks

ForecastingNonverbalSignals This is the implementation for the paper Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative A

1 Feb 10, 2022
Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalization

Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalization Official PyTorch implementation for our URST (Ultra-Resolution Sty

czczup 148 Dec 27, 2022
TeST: Temporal-Stable Thresholding for Semi-supervised Learning

TeST: Temporal-Stable Thresholding for Semi-supervised Learning TeST Illustration Semi-supervised learning (SSL) offers an effective method for large-

Xiong Weiyu 1 Jul 14, 2022
High-fidelity 3D Model Compression based on Key Spheres

High-fidelity 3D Model Compression based on Key Spheres This repository contains the implementation of the paper: Yuanzhan Li, Yuqi Liu, Yujie Lu, Siy

5 Oct 11, 2022
Generative Adversarial Networks for High Energy Physics extended to a multi-layer calorimeter simulation

CaloGAN Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks. This repository c

Deep Learning for HEP 101 Nov 13, 2022
Ian Covert 130 Jan 01, 2023
Bayesian algorithm execution (BAX)

Bayesian Algorithm Execution (BAX) Code for the paper: Bayesian Algorithm Execution: Estimating Computable Properties of Black-box Functions Using Mut

Willie Neiswanger 38 Dec 08, 2022
Sync2Gen Code for ICCV 2021 paper: Scene Synthesis via Uncertainty-Driven Attribute Synchronization

Sync2Gen Code for ICCV 2021 paper: Scene Synthesis via Uncertainty-Driven Attribute Synchronization 0. Environment Environment: python 3.6 and cuda 10

Haitao Yang 62 Dec 30, 2022
Official PyTorch(Geometric) implementation of DPGNN(DPGCN) in "Distance-wise Prototypical Graph Neural Network for Node Imbalance Classification"

DPGNN This repository is an official PyTorch(Geometric) implementation of DPGNN(DPGCN) in "Distance-wise Prototypical Graph Neural Network for Node Im

Yu Wang (Jack) 18 Oct 12, 2022