Neural Radiance Fields (NeRFs) at Mapillary
/ A.I., photogrammetry

Today, Mapillary is launching NeRFs, a new feature that will allow you to explore landmarks and popular sites in detailed 3D views – all reconstructed from 2D images uploaded to Mapillary.

 

https://blog.mapillary.com/update/2024/03/11/Mapillary-NeRF.html

 

https://www.mapillary.com/app/?lat=17.751177534360437&lng=0&z=1.5

 

3D Gaussian Splatting step by step beginner course
/ A.I., photogrammetry

 

https://www.reshot.ai/3d-gaussian-splatting

 

 what are 3D Gaussians? They are a generalization of 1D Gaussians (the bell curve) to 3D. Essentially they are ellipsoids in 3D space, with a center, a scale, a rotation, and “softened edges”.

 

 

Each 3D Gaussian is optimized along with a (viewdependant) color and opacity. When blended together, here’s the visualization of the full model, rendered from ANY angle. As you can see, 3D Gaussian Splatting captures extremely well the fuzzy and soft nature of the plush toy, something that photogrammetry-based methods struggle to do.

 

https://towardsdatascience.com/a-comprehensive-overview-of-gaussian-splatting-e7d570081362

Luma Interactive Scenes announced: Gaussian Splatting
/ A.I., photogrammetry

https://neuralradiancefields.io/luma-interactive-scenes-announced/

 

“…these are in fact Gaussian Splats that are being run and it’s a proprietary iteration of the original Inria paper. They hybridize the performance gain of realtime rendering with Gaussian Splatting with robust cloud based rendering that’s already widely being used in commercial applications. This has been in the works for a while over at Luma and I had the opportunity to try out some of my datasets on their new method.”

MICHAEL RUBLOFF

 

https://lumalabs.ai/embed/95aa8119-a2fd-4ba2-9e1d-a9ea668f4be2?mode=sparkles&background=%23ffffff&color=%23000000&showTitle=true&loadBg=true&logoPosition=bottom-left&infoPosition=bottom-right&cinematicVideo=undefined&showMenu=false

 

https://lumalabs.ai/capture/ccd7a96a-c2e2-44cf-a358-80b2fea8532f

 

Getting Started With 3D Gaussian Splatting for Windows (Beginner Tutorial)
/ A.I., photogrammetry, software

 

https://www.reshot.ai/3d-gaussian-splatting

 

 what are 3D Gaussians? They are a generalization of 1D Gaussians (the bell curve) to 3D. Essentially they are ellipsoids in 3D space, with a center, a scale, a rotation, and “softened edges”.

Each 3D Gaussian is optimized along with a (viewdependant) color and opacity. When blended together, here’s the visualization of the full model, rendered from ANY angle. As you can see, 3D Gaussian Splatting captures extremely well the fuzzy and soft nature of the plush toy, something that photogrammetry-based methods struggle to do.

CamP: Camera Preconditioning for NERF (Neural Radiance Fields)
/ A.I., photogrammetry, software

https://camp-nerf.github.io/

 

https://arxiv.org/pdf/2308.10902.pdf

 

“…any errors in the camera position solve can dramatically reduce the quality of a reconstruction. “

 

“Introducing CamP — a method to precondition camera optimization for NeRFs to significantly improve quality. With CamP we’re able to create high quality reconstructions even when input poses are bad.
CamP is a general purpose trick that you can apply in many places. Apply CamP to prior SOTA NeRF models like Zip-NeRF, and you improve quality and establish a new SOTA. Applying CamP to existing camera optimization models, like SCNeRF, to improve their performance.” – Keunhong Park

 

(a) ARKit Poses (w/o COLMAP)                         (b) ARKit Poses + CamP (Ours)

 

 

A short 170 year history of Neural Radiance Fields (NeRF), Holograms, and Light Fields
/ photogrammetry, production, software

https://neuralradiancefields.io/history-of-neural-radiance-fields/

 

“Lightfield and hologram capture started with a big theoretical idea 115 years ago and we have struggled to make them viable ever since. Neural Radiance fields aka NeRF along with gaming computers now for the first time provide a promising easy and low cost way for everybody to capture and display lightfields.”

“Neural Radiance fields (NeRF) recently had its third birthday but the technology is just the latest answer to a question people have been chasing since the 1860s: How do you capture and recreate space (from images)?”

 

“The plenoptic function measures physical light properties at every point in space and it describes how light transport occurs throughout a 3D volume.”

 

Google project Starline the latest in real time and compression image to 3D technology

Loading...