正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Doesn't look like the super low-res depth maps from the iPhone Pro's LiDAR sensor would be too useful as supervision (or sanity check) for recent monocular depth estimators.

Chris Offner

4,695 subscribers

66,094 次观看 • 1 年前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

AI-Enhanced LiDAR. Left vs right. A real LiDAR device costs thousands of dollars. What's in your iPhone Pro is a "baby LiDAR". Limited depth resolution, noisy output, not really built for high-precision 3D. You can't change the hardware. So we built an ML layer on top. Denoising, geometry completion, detail recovery. Processed server-side. Same sensor. Very different result.

AI-Enhanced LiDAR. Left vs right. A real LiDAR device costs thousands of dollars. What's in your iPhone Pro is a "baby LiDAR". Limited depth resolution, noisy output, not really built for high-precision 3D. You can't change the hardware. So we built an ML layer on top. Denoising, geometry completion, detail recovery. Processed server-side. Same sensor. Very different result.

KIRI Engine - 3D Scanner App

51,835 次观看 • 4 个月前

Some updates on the multiview vistadream pipeline with Rerun! Rerun came in extremely useful here, as being able to visualize depths at each stage of the pipeline allowed me to debug some nasty bugs. Since the last time, I was only working with a single image input. I've added in VGGT as my multiview pose + depth estimator. It works REALLY well for getting camera poses, but the depths are not that great. To try and fix that, I estimated depth maps from MoGeV2 for each of the views, and scale+shift aligned them so that they would match up to the confident sections of VGGT's depth predictions. You can see in the video just how much sharper the visualized 2d depth maps are! The biggest issue continues to be the multiview consistency 🫠 That's up next, along with actually training the Gaussian splat. Lots of work went into actually understanding inputs+outputs for VGGT. I had some funky bugs where the confidence values would all collapse to true I'm also really excited for this pipeline to use Difix3D+ Nvidia instead of Flux Inpainting, it seems like a better suited for a multiview pipeline.

Some updates on the multiview vistadream pipeline with Rerun! Rerun came in extremely useful here, as being able to visualize depths at each stage of the pipeline allowed me to debug some nasty bugs. Since the last time, I was only working with a single image input. I've added in VGGT as my multiview pose + depth estimator. It works REALLY well for getting camera poses, but the depths are not that great. To try and fix that, I estimated depth maps from MoGeV2 for each of the views, and scale+shift aligned them so that they would match up to the confident sections of VGGT's depth predictions. You can see in the video just how much sharper the visualized 2d depth maps are! The biggest issue continues to be the multiview consistency 🫠 That's up next, along with actually training the Gaussian splat. Lots of work went into actually understanding inputs+outputs for VGGT. I had some funky bugs where the confidence values would all collapse to true I'm also really excited for this pipeline to use Difix3D+ Nvidia instead of Flux Inpainting, it seems like a better suited for a multiview pipeline.

Pablo Vela

29,904 次观看 • 1 年前

2024 LHP Mitchell Tarnowski 1st in depth look at the southpaw and it was impressive. 6-foot-2, clean arm, delivery works and showed feel for the zone. FB was 85-87 mph and played up / got consistent late offerings from hitters. Also showed feel for spin, breaking off a low 70s breaker with good depth.

2024 LHP Mitchell Tarnowski 1st in depth look at the southpaw and it was impressive. 6-foot-2, clean arm, delivery works and showed feel for the zone. FB was 85-87 mph and played up / got consistent late offerings from hitters. Also showed feel for spin, breaking off a low 70s breaker with good depth.

Prep Baseball Ohio

10,154 次观看 • 3 年前

I was today years old when I found out Apple Maps works even offline in flight mode It's super fun and easy to look down from the plane and know what city or country you're looking at The landing was fun too I'm like a child when I'm on a plane, sorry 🙃

I was today years old when I found out Apple Maps works even offline in flight mode It's super fun and easy to look down from the plane and know what city or country you're looking at The landing was fun too I'm like a child when I'm on a plane, sorry 🙃

stemonte

2,431,269 次观看 • 3 个月前

Matt Shaw is always tweaking his batting stance. He's changed from last year's open, high-hands setup to a closed, low-hands "Edgar Renteria" look. Between Pedro Ramírez and a need to address pitching depth for '27, I wonder how the front office weigh Shaw's relentless tinkering in the offseason.

Matt Shaw is always tweaking his batting stance. He's changed from last year's open, high-hands setup to a closed, low-hands "Edgar Renteria" look. Between Pedro Ramírez and a need to address pitching depth for '27, I wonder how the front office weigh Shaw's relentless tinkering in the offseason.

Brendan Miller

30,552 次观看 • 4 天前

you don't need threejs for this effect just apply `perspective` to the container and animate each image with `translate3d(...)` over time, where depth is something like `z = z0 + speed * dt` and the rest is handled by the browser easy to map opacity or scroll to speed too

you don't need threejs for this effect just apply `perspective` to the container and animate each image with `translate3d(...)` over time, where depth is something like `z = z0 + speed * dt` and the rest is handled by the browser easy to map opacity or scroll to speed too

daniel petho

116,696 次观看 • 7 个月前

Dear artist friends working w/ AI, I can now confirm that AI art is art :) Our piece at MoMA got reviews from 3 biased art critiques using same descriptions with super shallow and like catchy titles. At the meantime 6 true researcher critiques looked for the depth and meaning. :)

Dear artist friends working w/ AI, I can now confirm that AI art is art :) Our piece at MoMA got reviews from 3 biased art critiques using same descriptions with super shallow and like catchy titles. At the meantime 6 true researcher critiques looked for the depth and meaning. :)

Refik Anadol

1,138,796 次观看 • 3 年前

China just dropped an open source model that turns any phone into a 3D scanner you point it at a room and walk through it the whole space builds itself into a 3D point cloud in real time as the camera moves, no LiDAR and no depth sensor anywhere it held a full 13 minute walkthrough at 25,000 frames without the map drifting or collapsing > ~20 fps on a single GPU > works indoors and outdoors from plain footage > the scan normally needs a $50,000 rig and a technician > Apache 2.0 and runs fully offline on your machine repo in the reply

China just dropped an open source model that turns any phone into a 3D scanner you point it at a room and walk through it the whole space builds itself into a 3D point cloud in real time as the camera moves, no LiDAR and no depth sensor anywhere it held a full 13 minute walkthrough at 25,000 frames without the map drifting or collapsing > ~20 fps on a single GPU > works indoors and outdoors from plain footage > the scan normally needs a $50,000 rig and a technician > Apache 2.0 and runs fully offline on your machine repo in the reply

savip.

105,305 次观看 • 2 个月前

A preview of what's next, visualized with Rerun and PlayCanvas supersplat ✨ (Also, feel free to send me a DM 📩; I’ll be in San Francisco from July 21–29, and I'm looking to meet like-minded folks!) I'm convinced that Gaussian Splats will be an integral part of any data engine as an underlying representation. So I've started putting together a repo that: 1. Given a single image, perform image outpainting 🖼️🖌️ 2. Estimate a monocular depth map on the outpainted image 📏 3. Train a Gaussian Splat initialized from the monocular depth 🎓✨ 4. Warp to new views, perform inpainting on the missing masks -> Train new splat 🔄🎨 This is going to be integrated into exo-egoforge, but I wanted to start with the simple single-image version before moving to a multi-video implementation There's some weirdness in the final rerun visualization, but the trained splat looks great 🎉! This is all based on the very cool VistaDream paper ( .github.io/) More on this next week!

A preview of what's next, visualized with Rerun and PlayCanvas supersplat ✨ (Also, feel free to send me a DM 📩; I’ll be in San Francisco from July 21–29, and I'm looking to meet like-minded folks!) I'm convinced that Gaussian Splats will be an integral part of any data engine as an underlying representation. So I've started putting together a repo that: 1. Given a single image, perform image outpainting 🖼️🖌️ 2. Estimate a monocular depth map on the outpainted image 📏 3. Train a Gaussian Splat initialized from the monocular depth 🎓✨ 4. Warp to new views, perform inpainting on the missing masks -> Train new splat 🔄🎨 This is going to be integrated into exo-egoforge, but I wanted to start with the simple single-image version before moving to a multi-video implementation There's some weirdness in the final rerun visualization, but the trained splat looks great 🎉! This is all based on the very cool VistaDream paper ( .github.io/) More on this next week!

Pablo Vela

26,036 次观看 • 1 年前

名画を立体的に鑑賞する方法 Nano Banana Pro (深度/法線マップ生成)→ WebGL(Three.js) スマホでも体験できます👉 【プロンプト】（法線マップ用） Generate a surface normal map from the input artwork image. Output one RGB image where each pixel encodes the surface normal direction in standard tangent-space format: •R = X direction •G = Y direction •B = Z direction Requirements: •Maintain the same resolution and aspect ratio as the input image. •Normal directions must follow the local geometry implied by brush strokes, shading, and contours. •Do NOT add new artistic elements or repaint the scene. •Only infer plausible micro-geometry and surface orientation. •Ensure smooth, consistent normal transitions without noise. （深度マップ用） Generate a depth map from the input artwork image. Output a single grayscale depth map where: •White = near to the viewer •Black = far from the viewer Requirements: •Maintain the same resolution and aspect ratio as the input image. •Depth must be smooth, continuous, and physically plausible. •Infer only geometric depth that could reasonably exist in the original artwork. •Do NOT add new objects or details. •Do NOT stylize, repaint, or reinterpret the scene. •Avoid texture noise; focus solely on depth structure.

名画を立体的に鑑賞する方法 Nano Banana Pro (深度/法線マップ生成)→ WebGL(Three.js) スマホでも体験できます👉 【プロンプト】（法線マップ用） Generate a surface normal map from the input artwork image. Output one RGB image where each pixel encodes the surface normal direction in standard tangent-space format: •R = X direction •G = Y direction •B = Z direction Requirements: •Maintain the same resolution and aspect ratio as the input image. •Normal directions must follow the local geometry implied by brush strokes, shading, and contours. •Do NOT add new artistic elements or repaint the scene. •Only infer plausible micro-geometry and surface orientation. •Ensure smooth, consistent normal transitions without noise. （深度マップ用） Generate a depth map from the input artwork image. Output a single grayscale depth map where: •White = near to the viewer •Black = far from the viewer Requirements: •Maintain the same resolution and aspect ratio as the input image. •Depth must be smooth, continuous, and physically plausible. •Infer only geometric depth that could reasonably exist in the original artwork. •Do NOT add new objects or details. •Do NOT stylize, repaint, or reinterpret the scene. •Avoid texture noise; focus solely on depth structure.

ハシモトタクマ / FunTech

27,192 次观看 • 9 个月前

Pacifico seems to be about the same height as Yamal, or maybe a little taller, but he definitely doesn't look like he's 1.87m 🤨 For reference, the person giving coaching instructions next to Pacifico is Heiko Westerman(1.90 m), the tallest on Barcelona's coaching staff ↕️

Pacifico seems to be about the same height as Yamal, or maybe a little taller, but he definitely doesn't look like he's 1.87m 🤨 For reference, the person giving coaching instructions next to Pacifico is Heiko Westerman(1.90 m), the tallest on Barcelona's coaching staff ↕️

David 🇰🇷

50,159 次观看 • 6 个月前

When Halo 5 first launched I didn't like the Thrust Evade ability. As I played more, I realized that it created more depth in close quarter encounters. One example, in previous games close range Energy Sword encounters would be a sure kill for the sword user; whereas in Halo 5 you could time it, evade the lunge, and flip the odds in your favor.

When Halo 5 first launched I didn't like the Thrust Evade ability. As I played more, I realized that it created more depth in close quarter encounters. One example, in previous games close range Energy Sword encounters would be a sure kill for the sword user; whereas in Halo 5 you could time it, evade the lunge, and flip the odds in your favor.

Aozolai

26,822 次观看 • 1 个月前

So apparently Apple has begun production of a variable aperture camera for the iPhone 18 Pro Max. This would let the lens physically change its aperture depending on lighting, opening up in low light and narrowing in bright scenes. The result should be better exposure control and more natural depth of field. Korean publication ETNews reports that Sunny Optical has already started producing the tiny actuators responsible for this movement with full camera module assembly expected to kick off in early summer. It’s happening! Concept video by fpt./YouTube

So apparently Apple has begun production of a variable aperture camera for the iPhone 18 Pro Max. This would let the lens physically change its aperture depending on lighting, opening up in low light and narrowing in bright scenes. The result should be better exposure control and more natural depth of field. Korean publication ETNews reports that Sunny Optical has already started producing the tiny actuators responsible for this movement with full camera module assembly expected to kick off in early summer. It’s happening! Concept video by fpt./YouTube

Shishir

183,860 次观看 • 5 个月前

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

Alex

48,539 次观看 • 6 个月前

🇨🇳 Saw my first actually useful robot You know those toll way machines and you're always too far off the machine and have to hang out the window to pay, or you're too close and your wheel hits the side In Beijing they have a robot arm for it Although to be fair in Europe we just have a sensor we glue to the windshield and it auto charges your bank via IBAN So maybe not so useful But it looks cool!

🇨🇳 Saw my first actually useful robot You know those toll way machines and you're always too far off the machine and have to hang out the window to pay, or you're too close and your wheel hits the side In Beijing they have a robot arm for it Although to be fair in Europe we just have a sensor we glue to the windshield and it auto charges your bank via IBAN So maybe not so useful But it looks cool!

@levelsio

850,180 次观看 • 10 个月前

This is the only way you’ll feel when you buy from me cause I too dey deliver. check out business page @Royeshoes for shoes you’ll like or send a dm with a request as what’s posted isn’t all we have.

This is the only way you’ll feel when you buy from me cause I too dey deliver. check out business page @Royeshoes for shoes you’ll like or send a dm with a request as what’s posted isn’t all we have.

A Y O | 👟🔌

15,409 次观看 • 5 个月前

Trying to figure out the best way to make a part like this... > metal > thin wall > flat bottom > relatively deep hole > depth must be held tightly The top version is the simplified form, bottom version is closer to ideal. Bore as shown is 1/4" with 2" OAL. Running through different possibilities in my head on how to make it one piece or multi-piece. Ideally constructed out of stainless or titanium. It can have a hole in the end, but must still have some sort of step / lip for retaining purposes. Don't want to weld. Doesn't have to be super cheap. Under 1000 pieces per year right now. Need a nice finish. In actual production the length could increase to 4". Any thoughts?

Trying to figure out the best way to make a part like this... > metal > thin wall > flat bottom > relatively deep hole > depth must be held tightly The top version is the simplified form, bottom version is closer to ideal. Bore as shown is 1/4" with 2" OAL. Running through different possibilities in my head on how to make it one piece or multi-piece. Ideally constructed out of stainless or titanium. It can have a hole in the end, but must still have some sort of step / lip for retaining purposes. Don't want to weld. Doesn't have to be super cheap. Under 1000 pieces per year right now. Need a nice finish. In actual production the length could increase to 4". Any thoughts?

ＤＡＮ_ＡＮＴＯＮＥＬＬＩ

12,990 次观看 • 1 个月前