Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Volumetric Capture is Hard There is no magic solution. Anyone interested in spatial R&D can get access to some awesome datasets online to test with, which can be especially interesting when processed with 3DGS and played back as 4DGS. However you need a ton of compute power. (multiple 3080,...

129,512 Aufrufe • vor 2 Jahren •via X (Twitter)

10 Kommentare

Profilbild von 3D Scanstore
3D Scanstorevor 2 Jahren

It's surprising how many people would have you believe that cameras can see around corners :) "We reconstructed this entire cathedral from just one image” There’s a lot of selective camera angles and exaggerated claims circulating currently. The work you're doing is setting the bar. I wouldn’t concern yourself with the misleading information out there; ultimately, the quality of your work and the actual complexity of 360 degree 4D video will become apparent quite quickly once clients start asking for it.

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

Thanks that's most appreciated. The missinformation does tend to muddy the waters though, which makes it a little harder to navigate becuase of false expectations.

Profilbild von SMOUSE 🔸
SMOUSE 🔸vor 2 Jahren

The distortion could make a really cool movie effect about looking through time, kinda like interstellar

Profilbild von Alvinoo
Alvinoovor 2 Jahren

Something like a 4DGS in Soccer or UFC should be amazing. Preinstalled cameras recording from different angles, pit dimensions set and don’t require rendering. Only 22 players + ref. Could work?

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

It's been done for Football by Canon and other companies in the past. Also it's worth a google for the Intel stage (which shuttered). The results are OK. UFC would be cool for sure. You would still need a ton of cameras. 150-200+ it's a multi-million £ project.

Profilbild von Mitya Shabat
Mitya Shabatvor 2 Jahren

Yeah, very hard not to overfit to the provided camera set, even if there's a lot Lots of ideas in research on how to regularize these 3D representations to work with sparse input, but these are mostly heuristics and hard to configure properly. This is hard. I love it

Profilbild von Zvezdan Nedeljkovic
Zvezdan Nedeljkovicvor 2 Jahren

It would be useful to separate the subject somehow from the rest of the scene and if nothing changes in the background keep the background the same until something changes. With reflective surfaces it would be much harder of course.

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

That's the research we are currently doing. We were just demonstrating real-world capture results. Capturing in situ is hard.

Profilbild von ⚡LaserEyeMaxi⚡
⚡LaserEyeMaxi⚡vor 2 Jahren

Post it on

Profilbild von Tim Reha
Tim Rehavor 2 Jahren

Streaming holodeck

Ähnliche Videos

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting. In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless. Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve. The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment. This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you. Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services. HQ YouTube Link: HQ Vimeo Link: #spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea Music "Vision" by megiddo music Special thanks to Aras Pranckevičius 🇺🇦🇱🇹

Infinite-Realities

202,783 Aufrufe • vor 2 Jahren

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,827 Aufrufe • vor 1 Jahr

Interesting turn of events with Nancy Guthrie case (mother of NBC host kidnapping) The woman the FBI got the Nest camera footage from didn’t have a Premium subscription Yet without a subscription, even being disabled, it was able to record and store footage “We are tracked, they are listening, they are watching, we are being recorded” What’s happening is even if you don’t have a subscription Google is recording and storing the footage from your doorbell camera, but you can only access it without a subscription You think it’s not being recorded and stored, but it is…. Even with the camera disabled, it was recording footage and able to be recovered… “Nancy Guthrie had a Nest camera, which is owned by Google, and law enforcement initially believed the doorbell footage was lost and said Nancy Guthrie did not have a premium subscription to access video from her doorbell camera — Now, according to Google, if a Nest camera is disabled, it can still record up to three hours of event video history without a subscription. So many are wondering, why did it take so long for this video to be released? Well, it takes time for authorities to basically recover this video from Google servers, since Nancy Guthrie did not have a premium subscription that offers special features for video history. And essentially, video is continuously recorded and saved with a subscription, but without a subscription, video is saved until it's overwritten. In this case, they thought because there was no subscription, it would have been erased and recorded over because it would be sort of a continuous situation. And then that's the real issue here. Look, we live in a surveillance economy and as much as we'd like to think that we can delete things and things will go away, and there are some apps that in fact make things go away, the truth of the matter is that we are tracked, They are listening, they are watching, we are being recorded.”

Wall Street Apes

255,091 Aufrufe • vor 5 Monaten

Milestone! We (robotic arms for gadgets assembly) finished the first commercial order, which brought the first revenue. Here are some learnings from this: The customer was a smart toy manufacturer. The task was to add a heatsink to Raspberry Pi. We received parts from them and returned the assembled modules back. Currently, it's done by teleoperation. Later it will be done by a remote employee via the Internet. Then it will be automated action by action, reducing the operator's time on this and making the task profitable. ps. If you have an assembly task that we can do for you asynchronically - leave a comment below. Learning 1. It's possible! This task which is usually done by the human arm with 5 fingers can be done with a two-finger gripper with the addition of a couple of simple tooling. The task was not simplified. We peeled off thin films from stickers, unpacked paper boxes, moved PCB boards full of components, etc. And no unsolvable problems have been encountered yet. Challenges: 1) The paper box shifted during the opening Solved with the plastic walls that you can lean against 2) Heat pad, stuck to the gripper instead of heat sync. Can be solved by gripper with a pump, but this time solved with the patience of the operator 3) The film on the pad is very thin. Turned out that sub-millimeter arm precision is enough to peel it off with just a regular gripper. 4) The working area has not enough space. You'll only know this by doing real tasks in bulk. This could be solved by an extra pair of long arms, but in this case, solved with the patience of the operator. I think that in the end, we will have 5-10 types of universal tooling and 5-10 types of grippers to solve almost all the problems in such assembly tasks. Learning 2. It's slow. It took 5 times more time, than doing it with human hands. But the good news is there's a lot of room for improvement. We now have specific “time for task” metrics, which we will decrease with iterations. The main reasons for slowness: 1) To rotate the gripper to a steep angle you are forced to control one robot arm with two hands instead of using both arms. We can fix this by just making more room for rotations. 2) Grabbing PCB board with two arms is hard. A slight difference in rotation can break the board, and it's hard to control these angles visually. To solve this, the best way is to use force feedback so you can feel the pressure applied to the item. 3) Accuracy and steadiness is still can be improved We will try a metal version and double the motors to do this. 4) It is physically difficult for the human hands to move with such precision To solve this, we will add a pad for the hands like in surgical robots Learning 3. It's a good business model The "Factory in the cloud" is a good business model for this stage. You send us parts and we send back assembled modules. Currently, it's more convenient than sending a robot to your place, as we can iterate/fix the robot quickly and utilize it 100% of the time. When we polish the set-up over time - we can send robots to your place. So if we can assemble something for you in the USA with Chinese prices by using modern automation - leave a comment below.

Igor Kulakov

37,266 Aufrufe • vor 1 Jahr