正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

🏀 I built this PoC using a single 2D broadcast video: applied pitch detection, player positioning, and movement tracking to reconstruct the play in 3D and map it onto a real basketball court in XR.

Stijn Spanhove

4,216 subscribers

36,957 次观看 • 10 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

26 条评论

Stijn Spanhove 的头像

Stijn Spanhove10 个月前

You can walk through the scene, pause it, analyse movement, see shot markers, select players and view stats. The play: Julie Allemand’s three-pointer in the Eurobasket final (Spain vs Belgium). Built with R3F and WebXR. #threejs @skalskip92 thanks for the inspiring examples!

SkalskiP 的头像

SkalskiP10 个月前

omg! this is soooo cool!

iambenslater 的头像

iambenslater10 个月前

This is incredible. Seriously. As lightweight AR glasses become accessible, imagine a team training where all players are wearing the glasses to work through plays.

Lidoor L. Joseph 的头像

Lidoor L. Joseph10 个月前

For a millisecond I thought you hyperscape scanned and invited people to come play.

Stijn Spanhove 的头像

Stijn Spanhove10 个月前

No that would also be an option 😅

Lidoor L. Joseph 的头像

Lidoor L. Joseph10 个月前

Don’t forget to send the hyperlink if you ever do 😎

Azad Balabanian 的头像

Azad Balabanian10 个月前

Such a cool concept!

Chris Smith 的头像

Chris Smith10 个月前

Well done, that's a great idea (and execution)!

miki ⋆｡°✩ 的头像

miki ⋆｡°✩10 个月前

awesome

Daa 😎 的头像

Daa 😎10 个月前

Cool!

SaoGalaxyVR 的头像

SaoGalaxyVR10 个月前

This is nice full scale

Natsuo Okada ⛏️🇯🇵 的头像

Natsuo Okada ⛏️🇯🇵10 个月前

Excelente work!

Sam Jurrens, CFA 的头像

Sam Jurrens, CFA10 个月前

Huge for pro teams reviewing game tape

Zara Techie 的头像

Zara Techie10 个月前

Impressive innovation! Truly groundbreaking work.

Furqan Rydhan 的头像

Furqan Rydhan10 个月前

looks cool!

AI PlanetX 的头像

AI PlanetX10 个月前

Impressive innovation! Your creativity is truly remarkable.

Jakub Klas 的头像

Jakub Klas10 个月前

This is nuts!

aLTis🇱🇹 的头像

aLTis🇱🇹10 个月前

That's actually really cool

Peter Von Buskirk 的头像

Peter Von Buskirk10 个月前

😲

Async (in SF) 的头像

Async (in SF)10 个月前

What. Seriously?

NIHAL JANI 的头像

NIHAL JANI10 个月前

Why cant i see anything like in this on my sam 3d playground

Urs Gehrig 的头像

Urs Gehrig10 个月前

Hello Stijn, do you intend to close the loop and also project from a 3D representation (e.g. a table soccer video) into a 2D view? Those projection transformations are generally helpful in sports teaching or e.g. music marching disciplines.

Agent Synister 的头像

Agent Synister10 个月前

Dude this is genius, well done, I imagine teams could use this to make better plays, critique movements etc, awesome

Steven Haller 的头像

Steven Haller10 个月前

This deserves much more recognition

10goldte.eth 的头像

10goldte.eth10 个月前

we need a real product

John Lehtonen 的头像

John Lehtonen10 个月前

I love this

相关视频

AI BASKETBALL ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, OPENCV, AND PYTHON. Take any NBA broadcast. Any camera angle. Any resolution. Feed it into the system. YOLO finds every player and the ball. Frame by frame. No manual annotation. No pre-labeled data.The model just sees the court and understands it. Zero-shot classification looks at jersey pixels and decides who plays for whom. Two teams separated in milliseconds. Without ever being told the team names. But here's where it gets wild. Court keypoint detection identifies the geometry of the playing surface. Homography transforms the broadcast camera into a top-down tactical map. Real meters. Real coordinates. From a flat 2D video. Now every player has a position on a real court. Every movement becomes a data point. Every pass becomes a vector. Speed. Distance. Possession time. Pass networks. All extracted from nothing but pixels. No GPS. No chips in the ball. No million-dollar Second Spectrum setup. A Python script and a GPU. The full pipeline is open source. The tutorial walks through every line of code. From detection to transformation to analytics output. Teams used to pay six figures for this data. Now you build it in an afternoon. Computer vision didn't just enter basketball. It democratized it.

AI BASKETBALL ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, OPENCV, AND PYTHON. Take any NBA broadcast. Any camera angle. Any resolution. Feed it into the system. YOLO finds every player and the ball. Frame by frame. No manual annotation. No pre-labeled data.The model just sees the court and understands it. Zero-shot classification looks at jersey pixels and decides who plays for whom. Two teams separated in milliseconds. Without ever being told the team names. But here's where it gets wild. Court keypoint detection identifies the geometry of the playing surface. Homography transforms the broadcast camera into a top-down tactical map. Real meters. Real coordinates. From a flat 2D video. Now every player has a position on a real court. Every movement becomes a data point. Every pass becomes a vector. Speed. Distance. Possession time. Pass networks. All extracted from nothing but pixels. No GPS. No chips in the ball. No million-dollar Second Spectrum setup. A Python script and a GPU. The full pipeline is open source. The tutorial walks through every line of code. From detection to transformation to analytics output. Teams used to pay six figures for this data. Now you build it in an afternoon. Computer vision didn't just enter basketball. It democratized it.

zostaff

231,628 次观看 • 5 个月前

🕹️ Turning drawings into XR worlds you can play in. I built a POC for @Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

🕹️ Turning drawings into XR worlds you can play in. I built a POC for @Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

Stijn Spanhove

37,239 次观看 • 1 年前

🥳 NEW TUTORIAL 🥳 2D look is making a big come back and I love it! In this video I give you my tips to achieve convincing 2D look for your 3D animation using #Blender obviously 🤗 👉 #b3D #animation #p2dessign #2D #3D #anime

🥳 NEW TUTORIAL 🥳 2D look is making a big come back and I love it! In this video I give you my tips to achieve convincing 2D look for your 3D animation using #Blender obviously 🤗 👉 #b3D #animation #p2dessign #2D #3D #anime

Pierrick Picaut

71,985 次观看 • 1 年前

I built a post-run recap design studio in SwiftUI Live animated map, 2D and 3D rendering, full customization. Here's how everything works 👇

I built a post-run recap design studio in SwiftUI Live animated map, 2D and 3D rendering, full customization. Here's how everything works 👇

JC Builds

37,931 次观看 • 4 个月前

The NHL partnered with Disney to broadcast its first-ever game in 3D animation yesterday. The broadcast used tracking chips embedded within the puck and player jerseys to recreate a real-time animated version of the game on Disney Channel. Pretty cool 🤯

The NHL partnered with Disney to broadcast its first-ever game in 3D animation yesterday. The broadcast used tracking chips embedded within the puck and player jerseys to recreate a real-time animated version of the game on Disney Channel. Pretty cool 🤯

Joe Pompliano

1,116,309 次观看 • 3 年前

The NBA app on Apple Vision Pro just dropped a massive update. World View (Alpha) puts you inside a live 3D recreation of the game. Every player and ref tracked in real time, rendered in NBA city-inspired environments, with visual effects when buckets drop or shots clank off the rim. You can move around the court using waypoints and even pull up the live broadcast synced to the 3D recreation simultaneously. The models aren’t photorealistic yet, but the tracking is impressively accurate. When they start mapping real likenesses onto these, it’s going to be something else entirely. Lastly, Tabletop is now called Court View. The NBA keeps pushing spatial computing forward. I love to see it!

The NBA app on Apple Vision Pro just dropped a massive update. World View (Alpha) puts you inside a live 3D recreation of the game. Every player and ref tracked in real time, rendered in NBA city-inspired environments, with visual effects when buckets drop or shots clank off the rim. You can move around the court using waypoints and even pull up the live broadcast synced to the 3D recreation simultaneously. The models aren’t photorealistic yet, but the tracking is impressively accurate. When they start mapping real likenesses onto these, it’s going to be something else entirely. Lastly, Tabletop is now called Court View. The NBA keeps pushing spatial computing forward. I love to see it!

Justin Ryan

28,377 次观看 • 6 个月前

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Motion Princess

22,007 次观看 • 6 个月前

I recreated the #ArcaneSeason2 Piltover Garden scene using #Blender. I roughly built a 3D scene, made a draft render, and then painted over it in 2D. All moving parts like foliage, characters and spinner are 3D elements. Breakdown coming soon. More info:

I recreated the #ArcaneSeason2 Piltover Garden scene using #Blender. I roughly built a 3D scene, made a draft render, and then painted over it in 2D. All moving parts like foliage, characters and spinner are 3D elements. Breakdown coming soon. More info:

trungduyng

34,849 次观看 • 1 年前

I got a lot of questions yesterday on how this made and if it was 3D or 2D so I decided to make a small breakdown video to explain. It was created using Non-Photorealistic Shaders and adapting a 2D animation workflow into 3D within Blender itself.

I got a lot of questions yesterday on how this made and if it was 3D or 2D so I decided to make a small breakdown video to explain. It was created using Non-Photorealistic Shaders and adapting a 2D animation workflow into 3D within Blender itself.

BNBaku

80,329 次观看 • 2 年前

There is a game coming out where you have to play it in 2d and 3d at the same time

There is a game coming out where you have to play it in 2d and 3d at the same time

Dexerto

7,085,009 次观看 • 2 年前

I built a full 3D strategy game with Opus 4.8 + Fable 5 Launching it today. Runs in your browser, no install, free: > 21 battlefields > economy + tech tree > tanks vs jets vs turrets, real counters > single player vs up to 7 AI bots > a battle royale storm map Click and you're at war in 10 seconds 👇

I built a full 3D strategy game with Opus 4.8 + Fable 5 Launching it today. Runs in your browser, no install, free: > 21 battlefields > economy + tech tree > tanks vs jets vs turrets, real counters > single player vs up to 7 AI bots > a battle royale storm map Click and you're at war in 10 seconds 👇

SoloTech

68,242 次观看 • 4 个月前

Global Anomaly Detection System update. Inspired by the recent global outage. visualizing worldwide impact zones while experimenting with projecting instanced geometries from a 3D sphere to a 2D Mercator map in three.js

Global Anomaly Detection System update. Inspired by the recent global outage. visualizing worldwide impact zones while experimenting with projecting instanced geometries from a 3D sphere to a 2D Mercator map in three.js

Dilum Sanjaya

39,622 次观看 • 11 个月前

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,746 次观看 • 3 年前

I applied Matt's prompt, ran it for a little over ten hours. About 1.3 million tokens on Opus 5. It created the game. I also made a video of it using Opus 5. Here's the video (and in my reply to this is a link to the actual game so you can play).

I applied Matt's prompt, ran it for a little over ten hours. About 1.3 million tokens on Opus 5. It created the game. I also made a video of it using Opus 5. Here's the video (and in my reply to this is a link to the actual game so you can play).

James Altucher

128,128 次观看 • 2 个月前

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

Alex

48,582 次观看 • 7 个月前

LaMelo Ball on building a chemistry with Rudy Gobert “I mean, he’s played basketball a long time, I have too, so it’s kind of easy. He’s just a big and in a little for real” On if he’s played with a player like Gobert before “I mean, he’s hall of fame for sure so that’s tough to say, but, I play a lot of 2K, you just play a lot of basketball, basketball is the same from a video game to on court to real life, On Gobert off the court “Rudy is funny as hell, great dude”

LaMelo Ball on building a chemistry with Rudy Gobert “I mean, he’s played basketball a long time, I have too, so it’s kind of easy. He’s just a big and in a little for real” On if he’s played with a player like Gobert before “I mean, he’s hall of fame for sure so that’s tough to say, but, I play a lot of 2K, you just play a lot of basketball, basketball is the same from a video game to on court to real life, On Gobert off the court “Rudy is funny as hell, great dude”

Andrew Dukowitz

200,853 次观看 • 11 天前

This game makes you play it in 2d and 3d at the same time, now they have caves

This game makes you play it in 2d and 3d at the same time, now they have caves

Dexerto

3,549,573 次观看 • 2 年前

I built a real-time, multiplayer whiteboard fully in Lovable. Real-time sync, cursor tracking, and drawing tools, all built in an afternoon.

I built a real-time, multiplayer whiteboard fully in Lovable. Real-time sync, cursor tracking, and drawing tools, all built in an afternoon.

Tyler Bruno

28,031 次观看 • 6 个月前

Today’s hobby project: Prototyped a real-time room scanning system with live sharing to XR devices. Explore scanned spaces in 3D on XR (not flat 2D screens) and share them with remote users for spatial remote collaboration. #metaquest #augmentedreality

Today’s hobby project: Prototyped a real-time room scanning system with live sharing to XR devices. Explore scanned spaces in 3D on XR (not flat 2D screens) and share them with remote users for spatial remote collaboration. #metaquest #augmentedreality

Takashi Yoshinaga

126,635 次观看 • 9 个月前