Loading video...

Video Failed to Load

Go Home

SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration Abstract (excerpt): When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging. Video-conferencing tools often do not provide the desired viewpoints for a remote viewer. While RGB-D cameras offer 3D views, they lack...

10,615 views • 1 year ago •via X (Twitter)

3 Comments

MrNeRF's profile picture
MrNeRF1 year ago

Paper (pdf): Youtube:

Mose Sakashita's profile picture
Mose Sakashita1 year ago

Thank you for sharing the work!:)

N Y 🇵🇸's profile picture
N Y 🇵🇸1 year ago

this is so cool

Related Videos

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 views • 3 years ago

FAU Erlangen-Nürnberg presents TRIPS Trilinear Point Splatting for Real-Time Radiance Field Rendering paper page: Point-based radiance field rendering has demonstrated impressive results for novel view synthesis, offering a compelling blend of rendering quality and computational efficiency. However, also latest approaches in this domain are not without their shortcomings. 3D Gaussian Splatting [Kerbl and Kopanas et al. 2023] struggles when tasked with rendering highly detailed scenes, due to blurring and cloudy artifacts. On the other hand, ADOP [R\"uckert et al. 2022] can accommodate crisper images, but the neural reconstruction network decreases performance, it grapples with temporal instability and it is unable to effectively address large gaps in the point cloud. In this paper, we present TRIPS (Trilinear Point Splatting), an approach that combines ideas from both Gaussian Splatting and ADOP. The fundamental concept behind our novel technique involves rasterizing points into a screen-space image pyramid, with the selection of the pyramid layer determined by the projected point size. This approach allows rendering arbitrarily large points using a single trilinear write. A lightweight neural network is then used to reconstruct a hole-free image including detail beyond splat resolution. Importantly, our render pipeline is entirely differentiable, allowing for automatic optimization of both point sizes and positions. Our evaluation demonstrate that TRIPS surpasses existing state-of-the-art methods in terms of rendering quality while maintaining a real-time frame rate of 60 frames per second on readily available hardware. This performance extends to challenging scenarios, such as scenes featuring intricate geometry, expansive landscapes, and auto-exposed footage.

AK

45,459 views • 2 years ago

THIRD EYE SPIES: PROJECT STARGATE Full Documentary Project Stargate was a CIA program involving the use of remote viewing, pyschic abilities, occult sorcery, and witchcraft similar to those of the ancient mystery schools such as the Rosicrucians etc. using astral projection and various other methods. "Two physicists discover psychic abilities are real only to have their experiments at Stanford co-opted by the CIA and their research silenced by the demands of secrecy. Yet, as both these 'remote viewers' and our audience learn, the 'more you hide something, the more it shines like a beacon in psychic space and this ancient truth can no longer be suppressed." "Project Star gate is the collective name for advanced psychic functioning or Remote viewing experiments and programs that were undertaken for over twenty years to create a trainable, repeatable, operational and if at all possible, accurate method of psychic spying or information gathering for the U.S. Military and intelligence agencies (CIA, NSA, DIA)." Here are some notable remote viewing examples but trust me its much more than this. 1. Ingo Swann’s Experiments: Ingo Swann, a key figure in Operation Stargate, is often cited as one of the most successful remote viewers. In controlled experiments, Swann provided detailed and accurate information about remote locations and objects he had never seen. These experiments played a significant role in gaining initial credibility for remote viewing. 2. Pat Price’s Predictions: Pat Price, another remote viewer involved in Operation Stargate, made several predictions about secret underground installations. Some of these predictions were eerily accurate, such as describing an underground facility at the White Sands Missile Range, which was later confirmed. 3. The SRI Experiments: The Stanford Research Institute conducted numerous experiments to investigate remote viewing. Some of the experiments involved remote viewing of distant or hidden targets, and some of the results were reportedly impressive, though they remain controversial. 4. Lyn Buchanan’s Claims: Lyn Buchanan, a former military remote viewer, has claimed several successful remote viewing missions. One notable claim is his involvement in the search for an SR-71 Blackbird spy plane that had crashed in hostile territory. Further research and documents Inside The CIA’s Project Stargate To Create Remote Viewing Spies

Redpill Drifter

430,225 views • 1 year ago