A curated list of neural rendering resources.

Last update: Dec 09, 2022

Related tags

Deep Learning Awesome-of-Neural-Rendering

Overview

Awesome-of-Neural-Rendering

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering
Neural-Rendering
Awesome Surveys
Awesome Blogs
Videos
Datasets
Tools

Type of Neural-Rendering

Type	`View`	``	``	``	``	``	`Other`
Explanation	View Synthesis						other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title	Venue	Type	Code	Star
	ICCV	`Other`	PyTorch(Author)	``
Self-Calibrating Neural Radiance Fields	ICCV	`Other`	PyTorch(Author)	`72`
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering	ICLR-Oral	`Other`	PyTorch(Author)	``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields	ICCV-Oral	`Other`	PyTorch(Author)	``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering	ICCV	`Other`	PyTorch(Author)	`128`
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting	CVPR	`Other`	PyTorch(Author)	`33`
IBRNet: Learning Multi-View Image-Based Rendering	CVPR	`View`	PyTorch(Author)	`126`
NeX: Real-time View Synthesis with Neural Basis Expansion	CVPR-Oral	`View`	PyTorch(Author)	`320`
Neural Lumigraph Rendering	CVPR	`Other`	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	`Other`	PyTorch(Author)	`80`
pixelNeRF: Neural Radiance Fields from One or Few Images	CVPR	`View`	PyTorch(Author)	`456`
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes	CVPR	`View`	PyTorch(Author)	`32`
D-NeRF: Neural Radiance Fields for Dynamic Scenes	CVPR	`Other`	PyTorch(Author)	`61`
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis	CVPR	`Other`	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	`Other`	PyTorch(Author)	``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields	CVPR-BestPaper	`Other`	PyTorch(Author)	`609`
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	SIGGRAPH Asia	`Other`	PyTorch(Author)	`104`

2020

Title	Venue	Type	Code	Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material	NeurIPS	`Other`	PyTorch(Author)	`223`
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis	NeurIPS	`Other`	PyTorch(Author)	`183`
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision	CVPR	`Other`	PyTorch(Author)	`471`
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis	ECCV-Oral	`View`	TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd)	`3.6k/1.1k/429/19.2k`

2019

Title	Venue	Type	Code	Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines	SIGGRAPH	`View`	PyTorch(Author)	`691`
Deferred Neural Rendering: Image Synthesis using Neural Textures	SIGGRAPH	`Other`	PyTorch(Author)	`123`
Geometry-Aware Neural Rendering	NeurIPS	`Other`	PyTorch(Author)	``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations	NeurIPS-Oral	`Other`	PyTorch(Author)	`287`
Monocular Neural Image Based Rendering with Continuous View Control	ICCV	`Other`	PyTorch(Author)	`43`
	CVPR	`Other`	PyTorch(Author)	``

2018

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

2017

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

2016

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

Previous Venues

Title	Venue	Type	Code	Star
Ray-casting Point-in-polyhedron Test	2012-CESCG	`Other`	-

Arxiv

Title	Date	Type	Code	Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field	2021.08.04	`View`	-
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs	2021.08.02	`Other`	PyTorch(Author)	`169`
Neural Rays for Occlusion-aware Image-based Rendering	2021.07.28	`Other`	PyTorch(Author)	`13`
Fast and Explicit Neural View Synthesis	2021.07.12	`View`	-
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields	2021.06.24	`Other`	PyTorch(Author)	``
Volume Rendering of Neural Implicit Surfaces	2021.06.22	`Other`	-
Learning to Stylize Novel Views	2021.05.27	``	-
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis	2021.04.28	`Other`	PyTorch(Author)	`7`
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling	2021.04.17	``	PyTorch(Author)	``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation	2021.04.02	`Other`	PyTorch(Author)	``
Inverting Neural Radiance Fields for Pose Estimation	2021.04.01	`Other`	-
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	2021.01.04	`Other`	PyTorch(Author)	`115`
	2021.08.10	``	PyTorch(Author)	``
	2021.08.10	``	PyTorch(Author)	``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner

Zhiwei ZHANG

Zhiwei ZHANG

GitHub Repository

This is the official implementation of TrivialAugment and a mini-library for the application of multiple image augmentation strategies including RandAugment and TrivialAugment.

Trivial Augment This is the official implementation of TrivialAugment (https://arxiv.org/abs/2103.10158), as was used for the paper. TrivialAugment is

94 Dec 30, 2022

Code for "Retrieving Black-box Optimal Images from External Databases" (WSDM 2022)

Retrieving Black-box Optimal Images from External Databases (WSDM 2022) We propose how a user retreives an optimal image from external databases of we

5 Apr 13, 2022

Realtime segmentation with ENet, the fast and accurate segmentation net.

Enet This is a realtime segmentation net with almost 22 fps on GTX1080 ti, and the model size is very small with only 28M. This repo contains the infe

14 Aug 30, 2022

PURE: End-to-End Relation Extraction

PURE: End-to-End Relation Extraction This repository contains (PyTorch) code and pre-trained models for PURE (the Princeton University Relation Extrac

657 Jan 09, 2023

Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.

Smaller Multilingual Transformers This repository shares smaller versions of multilingual transformers that keep the same representations offered by t

79 Dec 28, 2022

StarGAN v2-Tensorflow - Simple Tensorflow implementation of StarGAN v2

Official Tensorflow implementation Open ! - Clova AI StarGAN v2 — Un-official TensorFlow Implementation [Paper] [Pytorch] : Diverse Image Synthesis f

110 Jul 02, 2022

Region-aware Contrastive Learning for Semantic Segmentation, ICCV 2021

Region-aware Contrastive Learning for Semantic Segmentation, ICCV 2021 Abstract Recent works have made great success in semantic segmentation by explo

30 Dec 29, 2022

Ever felt tired after preprocessing the dataset, and not wanting to write any code further to train your model? Ever encountered a situation where you wanted to record the hyperparameters of the trained model and able to retrieve it afterward? Models Playground is here to help you do that. Models playground allows you to train your models right from the browser.

Models Playground 🗂️ Upload a Preprocessed Dataset 🌠 Choose whether to perform Classification or Regression 🦹 Enter the Dependent Variable ?

19 Dec 10, 2022

UMPNet: Universal Manipulation Policy Network for Articulated Objects

UMPNet: Universal Manipulation Policy Network for Articulated Objects Zhenjia Xu, Zhanpeng He, Shuran Song Columbia University Robotics and Automation

33 Dec 03, 2022

Alpha-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression

Alpha-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression YOLOv5 with alpha-IoU losses implemented in PyTorch. Example r

147 Dec 05, 2022

Real-time ground filtering algorithm of cloud points acquired using Terrestrial Laser Scanner (TLS)

This repository contains tools to simulate the ground filtering process of a registered point cloud. The repository contains two filtering methods. The first method uses a normal vector, and fit to p

5 Aug 25, 2022

WSDM2022 "A Simple but Effective Bidirectional Extraction Framework for Relational Triple Extraction"

BiRTE WSDM2022 "A Simple but Effective Bidirectional Extraction Framework for Relational Triple Extraction" Requirements The main requirements are: py

9 Dec 27, 2022

codes for "Scheduled Sampling Based on Decoding Steps for Neural Machine Translation" (long paper of EMNLP-2022)

Scheduled Sampling Based on Decoding Steps for Neural Machine Translation (EMNLP-2021 main conference) Contents Overview Background Quick to Use Furth

13 Jul 25, 2022

Audio Visual Emotion Recognition using TDA

Audio Visual Emotion Recognition using TDA RAVDESS database with two datasets analyzed: Video and Audio dataset: Audio-Dataset: https://www.kaggle.com

3 May 11, 2022

generate-2D-quadrilateral-mesh-with-neural-networks-and-tree-search

generate-2D-quadrilateral-mesh-with-neural-networks-and-tree-search This repository contains single-threaded TreeMesh code. I'm Hua Tong, a senior stu

18 Sep 21, 2022

Safe Local Motion Planning with Self-Supervised Freespace Forecasting, CVPR 2021

Safe Local Motion Planning with Self-Supervised Freespace Forecasting By Peiyun Hu, Aaron Huang, John Dolan, David Held, and Deva Ramanan Citing us Yo

90 Dec 01, 2022

Reinforcement Learning for Automated Trading

Reinforcement Learning for Automated Trading This thesis has been realized for the obtention of the Master's in Mathematical Engineering at the Polite

80 Jun 19, 2022

Benchmark VAE - Library for Variational Autoencoder benchmarking

Documentation pythae This library implements some of the most common (Variational) Autoencoder models. In particular it provides the possibility to pe

1.1k Jan 02, 2023

Unsupervised Feature Ranking via Attribute Networks.

FRANe Unsupervised Feature Ranking via Attribute Networks (FRANe) converts a dataset into a network (graph) with nodes that correspond to the features

7 Sep 29, 2022

phylotorch-bito is a package providing an interface to BITO for phylotorch

phylotorch-bito phylotorch-bito is a package providing an interface to BITO for phylotorch Dependencies phylotorch BITO Installation Get the source co

2 Sep 01, 2022