A curated list of neural rendering resources.

Overview

Awesome-of-Neural-Rendering Awesome

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering

Type View `` `` `` `` `` Other
Explanation View Synthesis other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title Venue Type Code Star
ICCV Other PyTorch(Author) ``
Self-Calibrating Neural Radiance Fields ICCV Other PyTorch(Author) 72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering ICLR-Oral Other PyTorch(Author) ``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields ICCV-Oral Other PyTorch(Author) ``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering ICCV Other PyTorch(Author) 128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting CVPR Other PyTorch(Author) 33
IBRNet: Learning Multi-View Image-Based Rendering CVPR View PyTorch(Author) 126
NeX: Real-time View Synthesis with Neural Basis Expansion CVPR-Oral View PyTorch(Author) 320
Neural Lumigraph Rendering CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) 80
pixelNeRF: Neural Radiance Fields from One or Few Images CVPR View PyTorch(Author) 456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes CVPR View PyTorch(Author) 32
D-NeRF: Neural Radiance Fields for Dynamic Scenes CVPR Other PyTorch(Author) 61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) ``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields CVPR-BestPaper Other PyTorch(Author) 609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination SIGGRAPH Asia Other PyTorch(Author) 104

2020

Title Venue Type Code Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material NeurIPS Other PyTorch(Author) 223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis NeurIPS Other PyTorch(Author) 183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision CVPR Other PyTorch(Author) 471
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ECCV-Oral View TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd) 3.6k/1.1k/429/19.2k

2019

Title Venue Type Code Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines SIGGRAPH View PyTorch(Author) 691
Deferred Neural Rendering: Image Synthesis using Neural Textures SIGGRAPH Other PyTorch(Author) 123
Geometry-Aware Neural Rendering NeurIPS Other PyTorch(Author) ``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations NeurIPS-Oral Other PyTorch(Author) 287
Monocular Neural Image Based Rendering with Continuous View Control ICCV Other PyTorch(Author) 43
CVPR Other PyTorch(Author) ``

2018

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2017

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2016

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

Previous Venues

Title Venue Type Code Star
Ray-casting Point-in-polyhedron Test 2012-CESCG Other -

Arxiv

Title Date Type Code Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2021.08.04 View -
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs 2021.08.02 Other PyTorch(Author) 169
Neural Rays for Occlusion-aware Image-based Rendering 2021.07.28 Other PyTorch(Author) 13
Fast and Explicit Neural View Synthesis 2021.07.12 View -
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields 2021.06.24 Other PyTorch(Author) ``
Volume Rendering of Neural Implicit Surfaces 2021.06.22 Other -
Learning to Stylize Novel Views 2021.05.27 `` -
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 2021.04.28 Other PyTorch(Author) 7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling 2021.04.17 `` PyTorch(Author) ``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation 2021.04.02 Other PyTorch(Author) ``
Inverting Neural Radiance Fields for Pose Estimation 2021.04.01 Other -
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination 2021.01.04 Other PyTorch(Author) 115
2021.08.10 `` PyTorch(Author) ``
2021.08.10 `` PyTorch(Author) ``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner
Zhiwei ZHANG
Zhiwei ZHANG
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

xmu-xiaoma66 7.7k Jan 05, 2023
Install alphafold on the local machine, get out of docker.

AlphaFold This package provides an implementation of the inference pipeline of AlphaFold v2.0. This is a completely new model that was entered in CASP

Kui Xu 73 Dec 13, 2022
Machine Learning automation and tracking

The Open-Source MLOps Orchestration Framework MLRun is an open-source MLOps framework that offers an integrative approach to managing your machine-lea

873 Jan 04, 2023
Vignette is a face tracking software for characters using osu!framework.

Vignette is a face tracking software for characters using osu!framework. Unlike most solutions, Vignette is: Made with osu!framework, the game framewo

Vignette 412 Dec 28, 2022
Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening

Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening Introduction This is an implementation of the model used for breast

757 Dec 30, 2022
Official Pytorch implementation of 'GOCor: Bringing Globally Optimized Correspondence Volumes into Your Neural Network' (NeurIPS 2020)

Official implementation of GOCor This is the official implementation of our paper : GOCor: Bringing Globally Optimized Correspondence Volumes into You

Prune Truong 71 Nov 18, 2022
This project provides a stock market environment using OpenGym with Deep Q-learning and Policy Gradient.

Stock Trading Market OpenAI Gym Environment with Deep Reinforcement Learning using Keras Overview This project provides a general environment for stoc

Kim, Ki Hyun 769 Dec 25, 2022
Code release for SLIP Self-supervision meets Language-Image Pre-training

SLIP: Self-supervision meets Language-Image Pre-training What you can find in this repo: Pre-trained models (with ViT-Small, Base, Large) and code to

Meta Research 621 Dec 31, 2022
Weakly Supervised Text-to-SQL Parsing through Question Decomposition

Weakly Supervised Text-to-SQL Parsing through Question Decomposition The official repository for the paper "Weakly Supervised Text-to-SQL Parsing thro

14 Dec 19, 2022
Code for paper Novel View Synthesis via Depth-guided Skip Connections

Novel View Synthesis via Depth-guided Skip Connections Code for paper Novel View Synthesis via Depth-guided Skip Connections @InProceedings{Hou_2021_W

8 Mar 14, 2022
MetaBalance: High-Performance Neural Networks for Class-Imbalanced Data

This repository is the official PyTorch implementation of Meta-Balance. Find the paper on arxiv MetaBalance: High-Performance Neural Networks for Clas

Arpit Bansal 20 Oct 18, 2021
Bayesian Inference Tools in Python

BayesPy Bayesian Inference Tools in Python Our goal is, given the discrete outcomes of events, estimate the distribution of categories. Using gradient

Max Sklar 99 Dec 14, 2022
Python library for science observations from the James Webb Space Telescope

JWST Calibration Pipeline JWST requires Python 3.7 or above and a C compiler for dependencies. Linux and MacOS platforms are tested and supported. Win

Space Telescope Science Institute 386 Dec 30, 2022
Unofficial PyTorch Implementation of "DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Features"

Pytorch Implementation of Deep Orthogonal Fusion of Local and Global Features (DOLG) This is the unofficial PyTorch Implementation of "DOLG: Single-St

DK 96 Jan 06, 2023
Deep Multimodal Neural Architecture Search

MMNas: Deep Multimodal Neural Architecture Search This repository corresponds to the PyTorch implementation of the MMnas for visual question answering

Vision and Language Group@ MIL 23 Dec 21, 2022
Unofficial implementation of One-Shot Free-View Neural Talking Head Synthesis

face-vid2vid Usage Dataset Preparation cd datasets wget https://yt-dl.org/downloads/latest/youtube-dl -O youtube-dl chmod a+rx youtube-dl python load_

worstcoder 68 Dec 30, 2022
Learning Open-World Object Proposals without Learning to Classify

Learning Open-World Object Proposals without Learning to Classify Pytorch implementation for "Learning Open-World Object Proposals without Learning to

Dahun Kim 149 Dec 22, 2022
A collection of Reinforcement Learning algorithms from Sutton and Barto's book and other research papers implemented in Python.

Reinforcement-Learning-Notebooks A collection of Reinforcement Learning algorithms from Sutton and Barto's book and other research papers implemented

Pulkit Khandelwal 1k Dec 28, 2022
This repository contains Prior-RObust Bayesian Optimization (PROBO) as introduced in our paper "Accounting for Gaussian Process Imprecision in Bayesian Optimization"

Prior-RObust Bayesian Optimization (PROBO) Introduction, TOC This repository contains Prior-RObust Bayesian Optimization (PROBO) as introduced in our

Julian Rodemann 2 Mar 19, 2022
A foreign language learning aid using a neural network to predict probability of translating foreign words

Langy Langy is a reading-focused foreign language learning aid orientated towards young children. Reading is an activity that every child knows. It is

Shona Lowden 6 Nov 17, 2021