Awesome-of-Neural-Rendering

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

• Type of Neural-Rendering

• Neural-Rendering

  • 2021 Venues
  • 2020 Venues
  • 2019 Venues
  • 2018 Venues
  • 2017 Venues
  • 2016 Venues
  • Previous Venues
  • Arxiv

• Awesome Surveys

• Awesome Blogs

• Videos

• Datasets

• Tools

Type of Neural-Rendering

Type	View	``	``	``	``	``	Other
Explanation	View Synthesis						other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title	Venue	Type	Code	Star
	ICCV	Other	PyTorch(Author)	``
Self-Calibrating Neural Radiance Fields	ICCV	Other	PyTorch(Author)	72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering	ICLR-Oral	Other	PyTorch(Author)	``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields	ICCV-Oral	Other	PyTorch(Author)	``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering	ICCV	Other	PyTorch(Author)	128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting	CVPR	Other	PyTorch(Author)	33
IBRNet: Learning Multi-View Image-Based Rendering	CVPR	View	PyTorch(Author)	126
NeX: Real-time View Synthesis with Neural Basis Expansion	CVPR-Oral	View	PyTorch(Author)	320
Neural Lumigraph Rendering	CVPR	Other	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	Other	PyTorch(Author)	80
pixelNeRF: Neural Radiance Fields from One or Few Images	CVPR	View	PyTorch(Author)	456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes	CVPR	View	PyTorch(Author)	32
D-NeRF: Neural Radiance Fields for Dynamic Scenes	CVPR	Other	PyTorch(Author)	61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis	CVPR	Other	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	Other	PyTorch(Author)	``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields	CVPR-BestPaper	Other	PyTorch(Author)	609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	SIGGRAPH Asia	Other	PyTorch(Author)	104

2020

Title	Venue	Type	Code	Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material	NeurIPS	Other	PyTorch(Author)	223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis	NeurIPS	Other	PyTorch(Author)	183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision	CVPR	Other	PyTorch(Author)	471
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis	ECCV-Oral	View	TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd)	3.6k/1.1k/429/19.2k

2019

Title	Venue	Type	Code	Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines	SIGGRAPH	View	PyTorch(Author)	691
Deferred Neural Rendering: Image Synthesis using Neural Textures	SIGGRAPH	Other	PyTorch(Author)	123
Geometry-Aware Neural Rendering	NeurIPS	Other	PyTorch(Author)	``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations	NeurIPS-Oral	Other	PyTorch(Author)	287
Monocular Neural Image Based Rendering with Continuous View Control	ICCV	Other	PyTorch(Author)	43
	CVPR	Other	PyTorch(Author)	``

2018

Title	Venue	Type	Code	Star
	CVPR	Other	PyTorch(Author)	``

2017

Title	Venue	Type	Code	Star
	CVPR	Other	PyTorch(Author)	``

2016

Title	Venue	Type	Code	Star
	CVPR	Other	PyTorch(Author)	``

Previous Venues

Title	Venue	Type	Code	Star
Ray-casting Point-in-polyhedron Test	2012-CESCG	Other	-

Arxiv

Title	Date	Type	Code	Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field	2021.08.04	View	-
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs	2021.08.02	Other	PyTorch(Author)	169
Neural Rays for Occlusion-aware Image-based Rendering	2021.07.28	Other	PyTorch(Author)	13
Fast and Explicit Neural View Synthesis	2021.07.12	View	-
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields	2021.06.24	Other	PyTorch(Author)	``
Volume Rendering of Neural Implicit Surfaces	2021.06.22	Other	-
Learning to Stylize Novel Views	2021.05.27	``	-
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis	2021.04.28	Other	PyTorch(Author)	7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling	2021.04.17	``	PyTorch(Author)	``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation	2021.04.02	Other	PyTorch(Author)	``
Inverting Neural Radiance Fields for Pose Estimation	2021.04.01	Other	-
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	2021.01.04	Other	PyTorch(Author)	115
	2021.08.10	``	PyTorch(Author)	``
	2021.08.10	``	PyTorch(Author)	``

Awesome Surveys

• awesome-neural-rendering
• awesome-neural-rendering
• New-View-Synthesis
• Differentiable Rendering: A Survey
• State of the Art on Neural Rendering
• Neural Volumetric Rendering
• Neural Volumetric Rendering: NeRF, etc.

Awesome Blogs

• NeRF Explosion 2020
• Real-Time Volume Graphics
• 光线投射算法原理、改进与实现
• 体积渲染
• 知乎NeRF

Videos

• Jon Barron - Understanding and Extending Neural Radiance Fields
• Matthew Tancik: Neural Radiance Fields for View Synthesis
• Neural Rendering (CVPR 2020)
• TUM AI Lecture Series - New Methods for Reconstruction and Neural Rendering (Christian Theobalt)
• Matthias Niessner - Why Neural Rendering is Super Cool!

Datasets

• DeepVoxels: paper, data, other
• DTU: paper, data, other
• [SLF]: paper, [data]
• NeRF: paper, data
• Google Scanned Objects: paper, data
• RealEstate10K: paper, data
• Spaces: paper, data
• LLFF: paper, data
• NeRF: paper, data
• NLR: paper, data
• pixelNeRF: paper, data
• : paper, data
• : paper, data
• : paper, data
• : paper, data

Tools

• Mitsuba 2
• Remove Image Background