Loading video...

Video Failed to Load

Go Home

SplatVoxel: History-Aware Novel View Streaming without Temporal Training Contributions: • We propose a hybrid Splat-Voxel feed-forward reconstruction framework that leverages historical information to enable novel view streaming, without relying on multi-view video datasets for training. • We develop an efficient sparse voxel transformer with a coarse-to-fine voxel representation, outperforming...

10,823 views • 1 year ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 views • 1 year ago

Introducing Kaleido💮 from AI at Meta — a universal generative neural rendering engine for photorealistic, unified object and scene view synthesis. Kaleido is built on a simple but powerful design philosophy: 3D perception is a form of visual common sense. Following this idea, we formulate rendering purely as a sequence-to-sequence generation problem, successfully unifying neural rendering with the architecture principles behind modern language and video models. Unlike traditional neural rendering methods, Kaleido learns 3D purely in a data-driven way, without explicit 3D representations or structures. It acquires spatial understanding directly through large-scale video pretraining, then multi-view 3D data finetuning, inspired by how LLMs acquire textual common sense from large corpora before specialising in domains like coding. Through extensive ablations, we progressively modernised the architecture design and training strategies and tackled key scaling challenges in sequence-to-sequence generative rendering, arriving at a design that’s simple, versatile, and scalable. Kaleido significantly outperforms prior generative models in few-view settings, and remarkably is the first zero-shot generative method matches InstantNGP-level rendering quality in multi-view settings. We view Kaleido also as an alternative step towards world modeling that flexibly spans a spectrum of “realities": with many views, it faithfully reconstructs grounded reality; with fewer views, it imagines plausible unseen details. 🔗 Explore more results and paper:

Shikun Liu

22,389 views • 10 months ago

NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions paper page: present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear kernels for interpolating features at continuous query points. The spatial positions of their neural features are fixed on grid nodes and cannot well adapt to target signals. Our method instead builds upon general radial bases with flexible kernel position and shape, which have higher spatial adaptivity and can more closely fit target signals. To further improve the channel-wise capacity of radial basis functions, we propose to compose them with multi-frequency sinusoid functions. This technique extends a radial basis to multiple Fourier radial bases of different frequency bands without requiring extra parameters, facilitating the representation of details. Moreover, by marrying adaptive radial bases with grid-based ones, our hybrid combination inherits both adaptivity and interpolation smoothness. We carefully designed weighting schemes to let radial bases adapt to different types of signals effectively. Our experiments on 2D image and 3D signed distance field representation demonstrate the higher accuracy and compactness of our method than prior arts. When applied to neural radiance field reconstruction, our method achieves state-of-the-art rendering quality, with small model size and comparable training speed.

AK

194,469 views • 2 years ago

We’re excited to introduce ShinkaEvolve: An open-source framework that evolves programs for scientific discovery with unprecedented sample-efficiency. Blog: Code: Like AlphaEvolve and its variants, our framework leverages LLMs to find state-of-the-art solutions to complex problems, but using orders of magnitude fewer resources! Many evolutionary AI systems are powerful but act like brute-force engines, burning thousands of samples to find good solutions. This makes discovery slow and expensive. We took inspiration from the efficiency of nature. ‘Shinka’ (進化) is Japanese for evolution, and we designed our system to be just as resourceful. On the classic circle packing optimization problem, ShinkaEvolve discovered a new state-of-the-art solution using only 150 samples. This is a big leap in efficiency compared to previous methods that required thousands of evaluations. We applied ShinkaEvolve to a diverse set of hard problems with real-world applications: 1/ AIME Math Reasoning: It evolved sophisticated agentic scaffolds that significantly outperform strong baselines, discovering an entire Pareto frontier of solutions trading performance for efficiency. 2/ Competitive Programming: On ALE-Bench (a benchmark for NP-Hard optimization problems), ShinkaEvolve took the best existing agent's solutions and improved them, turning a 5th place solution on one task into a 2nd place leaderboard rank in a competitive programming competition. 3/ LLM Training: We even turned ShinkaEvolve inward to improve LLMs themselves. It tackled the open challenge of designing load balancing losses for Mixture-of-Experts (MoE) models. It discovered a novel loss function that leads to better expert specialization and consistently improves model performance and perplexity. ShinkaEvolve achieves its remarkable sample-efficiency through three key innovations that work together: (1) an adaptive parent sampling strategy to balance exploration and exploitation, (2) novelty-based rejection filtering to avoid redundant work, and (3) a bandit-based LLM ensemble that dynamically picks the best model for the job. By making ShinkaEvolve open-source and highly sample-efficient, our goal is to democratize access to advanced, open-ended discovery tools. Our vision for ShinkaEvolve is to be an easy-to-use companion tool to help scientists and engineers with their daily work. We believe that building more efficient, nature-inspired systems is key to unlocking the future of AI-driven scientific research. We are excited to see what the community builds with it! Learn more in our technical report:

Sakana AI

360,198 views • 10 months ago

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 views • 1 year ago

Ahead of Hadron Energy beginning trading on Nasdaq under the ticker $HDRN on May 26th, we wanted to share a glimpse of Hadron’s vision building the future of microreactors. Hadron Energy is developing the Halo Micro Modular Reactor (MMR), a compact, factory-built light-water reactor designed to deliver reliable, carbon-free power for AI data centers, industrial sites, remote communities, military applications, and critical infrastructure. Each Hadron MMR is designed to generate 10 MWe of reliable power and is transportable by truck or rail to support flexible deployment where power is needed most. By generating power directly on-site, Hadron’s microreactors may reduce reliance on extensive transmission and distribution infrastructure. Multiple units can be deployed in a modular format to meet growing demand, with a targeted fuel-cycle of 10 years and an intended 50-year useful life. Hadron’s microreactors leverage proven light-water technology which powers ~90% of the global nuclear power fleet today. The Nuclear Regulatory Commission (NRC) is most familiar with light-water designs, they have ~27,000 cumulative reactor years of operational history, and light-water avoids the risks associated with novel fuels or coolants. Hadron’s microreactors are designed with inherent and passive safety features and are installed below grade to maximize protection of the public and the environment. Hadron uses Low Enriched Uranium Plus (LEU+), enriched to approximately 8% U-235. This fuel builds on the same proven uranium fuel used in today’s commercial reactors while enabling longer operating cycles and efficient power output for microreactor applications through slightly higher enrichment. Because LEU+ remains within the existing regulatory framework, may support a more familiar licensing pathway relative to certain advanced reactor technologies. Most importantly, LEU+ leverages existing portions of the domestic light-water reactor fuel supply chain, which we believe may reduce fuel supply constraints relative to certain advanced reactor approaches dependent on HALEU or TRISO fuel. Our approach focuses on regulatory efficiency and standardized deployment. In October 2025, the NRC accepted Hadron’s Quality Assurance Program Description (QAPD) Topical Report for review, an important step in establishing the company’s regulatory foundation. Hadron maintains active engagement with the NRC through a dual-track pathway, pursuing both Manufacturing and Combined Licenses, while monitoring evolving NRC initiatives intended to support standardized deployment and serial manufacturing approaches for advanced reactors. Hadron’s leadership team brings decades of experience across nuclear plant operations, NRC licensing, reactor engineering, fuel design, and quality assurance, supported by engineers focused on moving from design through deployment efficiently. As electricity demand continues to accelerate globally, particularly across AI infrastructure and industrial applications, Hadron is targeting a growing market expected to exceed $7 billion by 2030, according to Grand View Research. We believe light-water reactors continuing to produce reliable, 24/7 power, will play a critical role in the future of energy and national security. Please refer to Hadron Energy’s public SEC filings for additional information.

Samuel Gibson

67,076 views • 2 months ago

This app has completely transformed over the last three years and it is amazing to see how far it has come. - Launched X Chat and encrypted DMs - Launched Video/Audio calling - Launched Ad revenue share program for the creators - Reached a new alltime high of userseconds - Launched Community Notes - Community Notes passed 1M contributers mark - Launched the AI driven algo - Paid millions to the creators - Integerated Grok within the app - Rebranded as 𝕏 - Open sourced the recommendation algorithm. - Over 500 million posts everyday - Over 100 billion impressions daily - 650+ million users - 400000+ communities - #1 News App in 155+ countries - 2 billion+ app downloads - People are spending more time on X - 6th most visited website - Launched X Pro - Announced X Payments - Reduced child sexual abuse material by around 95 since the acquisition - Released subscriptions for creators - Removed legacy checkmarks - Prioritized the verified accounts to fight spam bots - All time low hate speech levels - Released new features in the shortest time period in Xs history - Exposed truth via Twitter files - Removed censorship - Restored free speech - Launched long form posts / Articles. - Improved the live streaming quality - Started paying the creators twice in a month - Added live chat to live streams - Enhanced the Community Notes algorithm - Added an ability to post timestamps while uploading videos - Added an edit post feature - Added view counts on posts publicly - Enhanced the support for Premium users - Added similar posts button - Added new app icons for premium users - Launched different tiers for Premium - Launched Verified Organizations - Added bookmark button on home timeline for posts - Over Ninety percent of the top 100 advertisers have returned to X - Video views are up as compared to previous years - All time high platform usage - Added more privacy options for calling - Introduced recruitment jobs feature for verified organizations - Expanded the community notes in more countries worldwide - Improved ad experience - Increased group chat size to 200 people - Lowered the eligibility threshold for ads revenue sharing from 15M to 5M - Rolled out vertical video ads for brands - Improved communities experience - Announced the removal of tweepcred system - Added live streams on the top bar of the feed - Improved live streaming tested game streaming - Launched the immersive video player - Made the process of reporting a post easier - Improved the UI - Announced the ability of group calling - Announced the removal of block feature except for DMs - Major upgrades to videos and media - Secured money transmission license in multiple states for payments - Introduced video downloads for verified users - Added an ability to limit replies to verified users only - Launched expanded bios - Made communities accessible in more countries - Added ID verification - Added an ability to hide likes - Added a tab for verified followers on user profiles - Added an ability to accept dms from verified users only to prevent spam - Introduced dm support for the ad customers - Announced that X will fund legal representation for users fired from their jobs for their posts - Included posts from communities in for you feed - Renamed notes feature to articles that will have no character limits - Added highlights tab to the profiles - Improved account analytics - Added an ability for community admins to spotlight their community in the profile - Introduced voice dms - Deleted millions of bot accounts - Introduced an ability to upload long videos - Improved advertisement brand safety - Introduced formatting for long form posts - Extended the community notes availability to more countries - Introduced individual reply to dms custom emoji reactions - Launched faster playback mini player for videos - Added an ability to allow dms from subs only - Continued UX/Ui improvements - Added air play button for videos on iOS - Added an ability to fast forwardrewind videos on - Became the most downloaded news app in multiple countries - Improved ad relevance - Removed child po*n - Introduced rate limits to prevent data scraping - Added fast forward backward feature to videos - Launched subscriber only replies - Launched spaces on web - Added an ability to hide the blue checkmark - Reduced scam accounts - Improved engagements for advertisers - Reinstated a multitude of suspended accounts - Introduced Multiple organization affiliate badges - Improved post analytics - Community notes debunking propaganda misstatements - Introduced verified badges for organizations - Launched X TV and many more features.

DogeDesigner

3,602,880 views • 9 months ago