Awesome Neural Radiance Fields (NeRF)

A curated list of awesome neural radiance fields (NeRF) papers. All papers are grouped according to keywords/tasks, and sorted by year. We hope this review can help peers who are interested in conducting NeRF related research.

Contributing

Warmly welcome everyone to participate in this project!!! If you are interested in joining our team and organizing NeRF related papers/codes/projects together, please submit PR according to the following guide. We'll put your name on the list of contributors.

Submit a Pull Request

Table of Contents

• Papers
  • Survey
  • NeRF
    • Data Augmentation
    • Few shot
    • Rendering Performance
    • Theory
    • Training & Inference Efficiency
  • NeRF Related Tasks
    • Deblur & Denoise
    • Depth Estimation
    • Editing
    • Face
    • High Dynamic Range (HDR)
    • Human
    • Image Generation
      • Image Generation
      • Text & Image Guided Generation
    • Large Scale Scene
    • Pose Misalignment
    • Reinforcement Learning
    • Relighting
    • Segmentation
    • Stylized
    • Surface Reconstruction
    • Video
    • View Synthesis Extrapolation
  • Unclassified
• Datasets
• Talks
• Acknowledgment
• Team

Papers

Year	Conf/Jour	Code	Title	OtherInfo
2020	ECCV	TF Torch	NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis	Project Page

Survey

Year	Conf/Jour	Code	Title	OtherInfo
2022	Computer Graphics Forum		Advances in Neural Rendering
2022	-		NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review
2022	Computer Graphics Forum		Neural Fields in Visual Computing and Beyond
2020	Computer Graphics Forum		State of the Art on Neural Rendering

NeRF

Data Augmentation

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV		GeoAug: Data Augmentation for Few-Shot NeRF with Geometry Constrains
2022	ECCV	Torch	Neural-Sim: Learning to Generate Training Data with NeRF
2022	CVPR	Torch	Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations

Few Shot

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS	TF	D^2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video	Project Page
2022	ECCV	Comming Soon	ActiveNeRF: Learning where to See with Uncertainty Estimation
2022	ECCV		GeoAug: Data Augmentation for Few-Shot NeRF with Geometry Constrains
2022	ECCV	Torch	SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image	Project Page
2022	CVPR		Dense Depth Priors for Neural Radiance Fields from Sparse Input Views
2022	CVPR	TF	RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs
2022	CVPR		AutoRF: Learning 3D Object Radiance Fields from Single View Observation	Project Page
2022	CVPR	Torch	InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering
2022	CVPR	Torch	Depth-supervised NeRF: Fewer Views and Faster Training for Free
2021	ICCV	Torch	Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis	Project Page
2021	ICCV	Torch	Neural Radiance Flow for 4D View Synthesis and Video Processing
2021	ICCV	Torch	MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo	Project Page
2021	CVPR	Torch	pixelNeRF: Neural Radiance Fields from One or Few Images	Project Page

Rendering Performance

Year	Conf/Jour	Code	Title	OtherInfo
2022	arXiv	JAX	MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures	Project Page
2022	NeurIPS	Torch	Compressible-composable NeRF via Rank-residual Decomposition
2022	NeurIPS		Neural Transmitted Radiance Fields
2022	ECCV	Torch	TensoRF: Tensorial Radiance Fields	Project Page
2022	ECCV	Jax	NeXT: Towards High Quality Neural Radiance Fields via Multi-Skip Transformer
2022	ECCV	Torch	R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis	Project Page
2022	ECCV		Gaussian Activated Neural Radiance Fields for High Fidelity Reconstruction & Pose Estimation
2022	ECCV		Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantification
2022	ECCV	Torch	ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
2022	ECCV		Gaussian Activated Neural Radiance Fields for High Fidelity Reconstruction & Pose Estimation
2022	CVPR		Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
2022	CVPR		Urban Radiance Fields
2022	CVPR	Torch	GeoNeRF: Generalizing NeRF with Geometry Priors	Project Page
2022	CVPR		NeRFReN: Neural Radiance Fields with Reflections
2022	CVPR	Torch	Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations
2021	ICCV	Torch	GNeRF: GAN-based Neural Radiance Field without Posed Camera
2021	ICCV	Torch	UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
2021	ICCV	Torch	MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis
2021	ICCV	TF	Nerfies: Deformable Neural Radiance Fields	Project Page

Theory

Year	Conf/Jour	Code	Title	OtherInfo
2020	ECCV	TF Torch	NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis

Training & Inference Efficiency

Year	Conf/Jour	Code	Title	OtherInfo
2022	ACM TOG	Code	Instant Neural Graphics Primitives with a Multiresolution Hash Encoding	Project Page
2022	ECCV	Torch	R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis	Project Page
2022	ECCV		Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering
2022	ECCV	Torch	ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
2022	ECCV	Torch	AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields
2022	CVPR	Torch	Point-NeRF: Point-based Neural Radiance Fields
2022	CVPR	Torch	DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering
2022	CVPR		Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time
2022	CVPR	Torch	Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction	Project Page
2022	CVPR	Torch	EfficientNeRF – Efficient Neural Radiance Fields
2022	CVPR		Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
2021	ICCV	TF	Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
2021	ICCV	Torch	PlenOctrees for Real-time Rendering of Neural Radiance Fields	Project Page
2021	ICCV	Torch	KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs
2021	ICCV	TF	Baking Neural Radiance Fields for Real-Time View Synthesis	Project Page
2021	CVPR	TF	DeRF: Decomposed Radiance Fields	Project Page

NeRF Related Tasks

Deblur & Denoise

Year	Conf/Jour	Code	Title	OtherInfo
2022	CVPR	Torch	Deblur-NeRF: Neural Radiance Fields from Blurry Images
2022	CVPR		NAN: Noise-Aware NeRFs for Burst-Denoising	Project Page
2022	CVPR		NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images

Depth Estimation

Year	Conf/Jour	Code	Title	OtherInfo
2022	CVPR		AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fields	Project Page
2021	ICCV	Torch	NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo
2021	ICCV	Torch	MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis

Editing

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS	Torch	DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes	Project Page
2022	NeurIPS		Decomposing NeRF for Editing via Feature Field Distillation	Project Page
2022	NeurIPS		CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation
2022	ECCV	Comming Soon	Deforming Radiance Fields with Cages	Project Page
2022	ECCV	Torch	MoFaNeRF: Morphable Facial Neural Radiance Field
2022	ECCV	Torch	PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo	Project Page
2022	ECCV	Torch	NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing	Project Page
2022	CVPR	Torch	DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering
2022	CVPR	Jittor	NeRF-Editing: Geometry Editing of Neural Radiance Fields
2022	CVPR	Torch	FENeRF: Face Editing in Neural Radiance Fields
2022	CVPR		RigNeRF: Fully Controllable Neural 3D Portraits
2022	CVPR		CoNeRF: Controllable Neural Radiance Fields
2021	ICCV	Torch	Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering	Project Page
2021	ICCV	Torch	Editing Conditional Radiance Fields	Project Page
2021	CVPR	Torch	GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields	Project Page
2021	CVPR	Torch	Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence
2021	NeurIPS	Torch	Geometry Processing with Neural Fields	Project Page

Face

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS		Generative Neural Articulated Radiance Fields
2022	ECCV	Torch	Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis	Project Page
2022	ECCV	Torch	Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis
2022	ECCV	Torch	MoFaNeRF: Morphable Facial Neural Radiance Field
2022	ECCV	Torch	Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields	Project Page
2022	CVPR		LOLNeRF: Learn from One Look	Project Page
2022	CVPR	Torch	FENeRF: Face Editing in Neural Radiance Fields
2022	CVPR		CoNeRF: Controllable Neural Radiance Fields
2022	CVPR	Torch	HeadNeRF: A Real-time NeRF-based Parametric Head Model
2022	CVPR	Torch	Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to NeuralRadiance Fields Translation
2021	ICCV	Torch	AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
2021	CVPR		Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction	Project Page

High Dynamic Range (HDR)

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV	Comming Soon	HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields
2022	CVPR		HDR-NeRF: High Dynamic Range Neural Radiance Fields

Human

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS		Generative Neural Articulated Radiance Fields
2022	ECCV		Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering
2022	ECCV	Torch	KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints	Project Page
2022	ECCV	Torch	NeuMan: Neural Human Radiance Field from a Single Video
2022	CVPR		Structured Local Radiance Fields for Human Avatar Modeling
2022	CVPR	Torch	Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis
2022	CVPR	Torch	HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video
2022	CVPR		DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering
2021	ICCV	Torch	Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies	Project Page
2021	ICCV	Torch	Neural Articulated Radiance Field
2021	ACM TOG		Editable Free-Viewpoint Video using a Layered Neural Representation

Image Generation

Image Generation

Year	Conf/Jour	Code	Title	OtherInfo
2022	CVPR	Torch	Efficient Geometry-aware 3D Generative Adversarial Networks	Project Page
2020	NeurIPS	Torch	GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis

Text & Image Guided Generation

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV	Torch	Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields	Project Page
2022	CVPR	Code	CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

Large Scale Scene

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV	Torch	NeRF for Outdoor Scene Relighting	Project Page
2022	CVPR		Urban Radiance Fields
2022	CVPR	Torch	NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
2022	CVPR		Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs
2022	CVPR		Block-NeRF: Scalable Large Scene Neural View Synthesis
2022	CVPR	Torch	Hallucinated Neural Radiance Fields in the Wild
2021	ICCV	Torch	Unconstrained Scene Generation with Locally Conditioned Radiance Fields	Project Page
2021	CVPR		NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections	Project Page

Pose Misalignment

Year	Conf/Jour	Code	Title	OtherInfo
2021	ICCV		BARF: Bundle-Adjusting Neural Radiance Fields	Project Page

Reinforcement Learning

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS		Reinforcement Learning with Neural Radiance Fields	Project Page

Relighting

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV	Torch	NeRF for Outdoor Scene Relighting	Project Page
2022	ACM MM		Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation	Project Page
2021	CVPR	TF	NeRD: Neural Reflectance Decomposition from Image Collections	Project Page
2021	CVPR		NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
2021	ACM TOG	TF	NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	Project Page

Segmentation

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS		Unsupervised Multi-View Object Segmentation Using Radiance Field Propagation
2022	NeurIPS	TF	D^2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video	Project Page
2022	NeurIPS		Decomposing NeRF for Editing via Feature Field Distillation	Project Page
2022	ECCV		LaTeRF: Label and Text Driven Object Radiance Fields

Stylized

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV	Torch	ARF: Artistic Radiance fields	Project Page
2022	CVPR	Jittor	StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning
2021	ICCV	Torch	Learning to Stylize Novel Views	Project Page

Surface Reconstruction

Year	Conf/Jour	Code	Title	OtherInfo
2021	ICCV	Torch	UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
2021	NeurIPS	Torch	NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction	Project Page
2021	NeurIPS		Volume Rendering of Neural Implicit Surfaces

Video

Year	Conf/Jour	Code	Title	OtherInfo
2022	NeurIPS	Torch	DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes	Project Page
2022	ECCV	Torch	NeuMan: Neural Human Radiance Field from a Single Video
2021	ACM TOG	TF	HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields	Project Page
2021	CVPR	Torch	D-NeRF: Neural Radiance Fields for Dynamic Scenes
2021	ICCV	Torch	Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video
2021	CVPR		Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction	Project Page
2021	CVPR		Learning Compositional Radiance Fields of Dynamic Human Heads	Project Page
2021	CVPR		Space-time Neural Irradiance Fields for Free-Viewpoint Video	Project Page

View Synthesis Extrapolation

Year	Conf/Jour	Code	Title	OtherInfo
2022	CVPR		Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation

Unclassified

Year	Conf/Jour	Code	Title	OtherInfo
2022	ECCV		BungeeNeRF: Progressive Neural Radiance Field for Extreme Multiscale Scene Rendering
2022	CVPR		Neural Volumetric Object Selection	Project Page
2021	ICCV	Torch	CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
2021	ICCV	Torch	Self-Calibrating Neural Radiance Fields

Datasets

Year	Name	Related Paper	Task	Instances	Note
2022	PeRFception	PeRFception: Perception using Radiance Fields	2D classification, 3D classification, 3D segmentation	19k
2021	NeuS-DATA	NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction	Surface Reconstruction	-
2020	NeRF-DATA	NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis	View Synthesis	-	Benchmark

Talks

Year	Theme	Speaker/Publisher	Language
2022	TensoRF: Tensorial Radiance Fields	Zexiang Xu	EN
2022	ECCV2022 - Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis	Shens	EN
2022	[NeRF-OSR, ECCV 2022] NeRF for Outdoor Scene Relighting	Vlad Golyanik (4DQV)	EN
2022	PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo (ECCV 2022)	Yoo	EN
2022	[ECCV 2022] KeypointNeRF: Generalizing Image-based Volumetric Avatars	Marko Mihajlovic	EN
2022	[ECCV'22] Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields	Yuedong Chen	EN
2022	[CVPR 2022] Neural Volumetric Object Selection	Jason Ren	EN
2022	[ACM-MM'22] Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation	Bangbang Yang	EN
2021	Geometry Processing with Neural Fields	Guandao Yang	EN
2021	Editing Conditional Radiance Fields	Steven Liu	EN
2021	Michael Niemeyer: Generative Neural Scene Representations 3D Representation Seminar	Yen-Chen Lin	EN
2021	NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	Xiuming Zhang	EN
2020	NeRD: Neural Reflectance Decomposition from Image Collections	Mark Boss	EN
2020	NeRF: Neural Radiance Fields	Matthew Tancik	EN

Acknowledgment

When we reviewed the literatures about NeRF, we found that this excellent repo had not been updated for a long time, so we reorganized and released our awesome-NeRF. Some features were borrowed from repo, so we are grateful for their works.

Team

Team Members

Zhongwei Qiu (Leader), Zijiang Yang, Tianle Cheng

Contributors

Hutao99999, Tyler Luan