Loading video...

Video Failed to Load

Go Home

Volumetric Capture is Hard There is no magic solution. Anyone interested in spatial R&D can get access to some awesome datasets online to test with, which can be especially interesting when processed with 3DGS and played back as 4DGS. However you need a ton of compute power. (multiple 3080,...

129,521 views • 2 years ago •via X (Twitter)

10 Comments

3D Scanstore's profile picture
3D Scanstore2 years ago

It's surprising how many people would have you believe that cameras can see around corners :) "We reconstructed this entire cathedral from just one image” There’s a lot of selective camera angles and exaggerated claims circulating currently. The work you're doing is setting the bar. I wouldn’t concern yourself with the misleading information out there; ultimately, the quality of your work and the actual complexity of 360 degree 4D video will become apparent quite quickly once clients start asking for it.

Infinite-Realities's profile picture
Infinite-Realities2 years ago

Thanks that's most appreciated. The missinformation does tend to muddy the waters though, which makes it a little harder to navigate becuase of false expectations.

SMOUSE 🔸's profile picture
SMOUSE 🔸2 years ago

The distortion could make a really cool movie effect about looking through time, kinda like interstellar

Alvinoo's profile picture
Alvinoo2 years ago

Something like a 4DGS in Soccer or UFC should be amazing. Preinstalled cameras recording from different angles, pit dimensions set and don’t require rendering. Only 22 players + ref. Could work?

Infinite-Realities's profile picture
Infinite-Realities2 years ago

It's been done for Football by Canon and other companies in the past. Also it's worth a google for the Intel stage (which shuttered). The results are OK. UFC would be cool for sure. You would still need a ton of cameras. 150-200+ it's a multi-million £ project.

Mitya Shabat's profile picture
Mitya Shabat2 years ago

Yeah, very hard not to overfit to the provided camera set, even if there's a lot Lots of ideas in research on how to regularize these 3D representations to work with sparse input, but these are mostly heuristics and hard to configure properly. This is hard. I love it

Zvezdan Nedeljkovic's profile picture
Zvezdan Nedeljkovic2 years ago

It would be useful to separate the subject somehow from the rest of the scene and if nothing changes in the background keep the background the same until something changes. With reflective surfaces it would be much harder of course.

Infinite-Realities's profile picture
Infinite-Realities2 years ago

That's the research we are currently doing. We were just demonstrating real-world capture results. Capturing in situ is hard.

⚡LaserEyeMaxi⚡'s profile picture
⚡LaserEyeMaxi⚡2 years ago

Post it on

Tim Reha's profile picture
Tim Reha2 years ago

Streaming holodeck

Related Videos

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 views • 1 year ago