Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

🏀 I built this PoC using a single 2D broadcast video: applied pitch detection, player positioning, and movement tracking to reconstruct the play in 3D and map it onto a real basketball court in XR.

Stijn Spanhove

4,216 subscribers

36,957 просмотров • 10 месяцев назад •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

Комментарии: 26

Фото профиля Stijn Spanhove

Stijn Spanhove10 месяцев назад

You can walk through the scene, pause it, analyse movement, see shot markers, select players and view stats. The play: Julie Allemand’s three-pointer in the Eurobasket final (Spain vs Belgium). Built with R3F and WebXR. #threejs @skalskip92 thanks for the inspiring examples!

Фото профиля SkalskiP

SkalskiP10 месяцев назад

omg! this is soooo cool!

Фото профиля iambenslater

iambenslater10 месяцев назад

This is incredible. Seriously. As lightweight AR glasses become accessible, imagine a team training where all players are wearing the glasses to work through plays.

Фото профиля Lidoor L. Joseph

Lidoor L. Joseph10 месяцев назад

For a millisecond I thought you hyperscape scanned and invited people to come play.

Фото профиля Stijn Spanhove

Stijn Spanhove10 месяцев назад

No that would also be an option 😅

Фото профиля Lidoor L. Joseph

Lidoor L. Joseph10 месяцев назад

Don’t forget to send the hyperlink if you ever do 😎

Фото профиля Azad Balabanian

Azad Balabanian10 месяцев назад

Such a cool concept!

Фото профиля Chris Smith

Chris Smith10 месяцев назад

Well done, that's a great idea (and execution)!

Фото профиля miki ⋆｡°✩

miki ⋆｡°✩10 месяцев назад

awesome

Фото профиля Daa 😎

Daa 😎10 месяцев назад

Cool!

Фото профиля SaoGalaxyVR

SaoGalaxyVR10 месяцев назад

This is nice full scale

Фото профиля Natsuo Okada ⛏️🇯🇵

Natsuo Okada ⛏️🇯🇵10 месяцев назад

Excelente work!

Фото профиля Sam Jurrens, CFA

Sam Jurrens, CFA10 месяцев назад

Huge for pro teams reviewing game tape

Фото профиля Zara Techie

Zara Techie10 месяцев назад

Impressive innovation! Truly groundbreaking work.

Фото профиля Furqan Rydhan

Furqan Rydhan10 месяцев назад

looks cool!

Фото профиля AI PlanetX

AI PlanetX10 месяцев назад

Impressive innovation! Your creativity is truly remarkable.

Фото профиля Jakub Klas

Jakub Klas10 месяцев назад

This is nuts!

Фото профиля aLTis🇱🇹

aLTis🇱🇹10 месяцев назад

That's actually really cool

Фото профиля Peter Von Buskirk

Peter Von Buskirk10 месяцев назад

😲

Фото профиля Async (in SF)

Async (in SF)10 месяцев назад

What. Seriously?

Фото профиля NIHAL JANI

NIHAL JANI10 месяцев назад

Why cant i see anything like in this on my sam 3d playground

Фото профиля Urs Gehrig

Urs Gehrig10 месяцев назад

Hello Stijn, do you intend to close the loop and also project from a 3D representation (e.g. a table soccer video) into a 2D view? Those projection transformations are generally helpful in sports teaching or e.g. music marching disciplines.

Фото профиля Agent Synister

Agent Synister10 месяцев назад

Dude this is genius, well done, I imagine teams could use this to make better plays, critique movements etc, awesome

Фото профиля Steven Haller

Steven Haller10 месяцев назад

This deserves much more recognition

Фото профиля 10goldte.eth

10goldte.eth10 месяцев назад

we need a real product

Фото профиля John Lehtonen

John Lehtonen10 месяцев назад

I love this

Похожие видео

AI BASKETBALL ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, OPENCV, AND PYTHON. Take any NBA broadcast. Any camera angle. Any resolution. Feed it into the system. YOLO finds every player and the ball. Frame by frame. No manual annotation. No pre-labeled data.The model just sees the court and understands it. Zero-shot classification looks at jersey pixels and decides who plays for whom. Two teams separated in milliseconds. Without ever being told the team names. But here's where it gets wild. Court keypoint detection identifies the geometry of the playing surface. Homography transforms the broadcast camera into a top-down tactical map. Real meters. Real coordinates. From a flat 2D video. Now every player has a position on a real court. Every movement becomes a data point. Every pass becomes a vector. Speed. Distance. Possession time. Pass networks. All extracted from nothing but pixels. No GPS. No chips in the ball. No million-dollar Second Spectrum setup. A Python script and a GPU. The full pipeline is open source. The tutorial walks through every line of code. From detection to transformation to analytics output. Teams used to pay six figures for this data. Now you build it in an afternoon. Computer vision didn't just enter basketball. It democratized it.

AI BASKETBALL ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, OPENCV, AND PYTHON. Take any NBA broadcast. Any camera angle. Any resolution. Feed it into the system. YOLO finds every player and the ball. Frame by frame. No manual annotation. No pre-labeled data.The model just sees the court and understands it. Zero-shot classification looks at jersey pixels and decides who plays for whom. Two teams separated in milliseconds. Without ever being told the team names. But here's where it gets wild. Court keypoint detection identifies the geometry of the playing surface. Homography transforms the broadcast camera into a top-down tactical map. Real meters. Real coordinates. From a flat 2D video. Now every player has a position on a real court. Every movement becomes a data point. Every pass becomes a vector. Speed. Distance. Possession time. Pass networks. All extracted from nothing but pixels. No GPS. No chips in the ball. No million-dollar Second Spectrum setup. A Python script and a GPU. The full pipeline is open source. The tutorial walks through every line of code. From detection to transformation to analytics output. Teams used to pay six figures for this data. Now you build it in an afternoon. Computer vision didn't just enter basketball. It democratized it.

zostaff

231,628 просмотров • 5 месяцев назад

🕹️ Turning drawings into XR worlds you can play in. I built a POC for @Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

🕹️ Turning drawings into XR worlds you can play in. I built a POC for @Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

Stijn Spanhove

37,239 просмотров • 1 год назад

🥳 NEW TUTORIAL 🥳 2D look is making a big come back and I love it! In this video I give you my tips to achieve convincing 2D look for your 3D animation using #Blender obviously 🤗 👉 #b3D #animation #p2dessign #2D #3D #anime

🥳 NEW TUTORIAL 🥳 2D look is making a big come back and I love it! In this video I give you my tips to achieve convincing 2D look for your 3D animation using #Blender obviously 🤗 👉 #b3D #animation #p2dessign #2D #3D #anime

Pierrick Picaut

71,985 просмотров • 1 год назад

I built a post-run recap design studio in SwiftUI Live animated map, 2D and 3D rendering, full customization. Here's how everything works 👇

I built a post-run recap design studio in SwiftUI Live animated map, 2D and 3D rendering, full customization. Here's how everything works 👇

JC Builds

37,931 просмотров • 4 месяцев назад

The NHL partnered with Disney to broadcast its first-ever game in 3D animation yesterday. The broadcast used tracking chips embedded within the puck and player jerseys to recreate a real-time animated version of the game on Disney Channel. Pretty cool 🤯

The NHL partnered with Disney to broadcast its first-ever game in 3D animation yesterday. The broadcast used tracking chips embedded within the puck and player jerseys to recreate a real-time animated version of the game on Disney Channel. Pretty cool 🤯

Joe Pompliano

1,116,309 просмотров • 3 лет назад

The NBA app on Apple Vision Pro just dropped a massive update. World View (Alpha) puts you inside a live 3D recreation of the game. Every player and ref tracked in real time, rendered in NBA city-inspired environments, with visual effects when buckets drop or shots clank off the rim. You can move around the court using waypoints and even pull up the live broadcast synced to the 3D recreation simultaneously. The models aren’t photorealistic yet, but the tracking is impressively accurate. When they start mapping real likenesses onto these, it’s going to be something else entirely. Lastly, Tabletop is now called Court View. The NBA keeps pushing spatial computing forward. I love to see it!

The NBA app on Apple Vision Pro just dropped a massive update. World View (Alpha) puts you inside a live 3D recreation of the game. Every player and ref tracked in real time, rendered in NBA city-inspired environments, with visual effects when buckets drop or shots clank off the rim. You can move around the court using waypoints and even pull up the live broadcast synced to the 3D recreation simultaneously. The models aren’t photorealistic yet, but the tracking is impressively accurate. When they start mapping real likenesses onto these, it’s going to be something else entirely. Lastly, Tabletop is now called Court View. The NBA keeps pushing spatial computing forward. I love to see it!

Justin Ryan

28,377 просмотров • 6 месяцев назад

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Motion Princess

22,007 просмотров • 6 месяцев назад

I recreated the #ArcaneSeason2 Piltover Garden scene using #Blender. I roughly built a 3D scene, made a draft render, and then painted over it in 2D. All moving parts like foliage, characters and spinner are 3D elements. Breakdown coming soon. More info:

I recreated the #ArcaneSeason2 Piltover Garden scene using #Blender. I roughly built a 3D scene, made a draft render, and then painted over it in 2D. All moving parts like foliage, characters and spinner are 3D elements. Breakdown coming soon. More info:

trungduyng

34,849 просмотров • 1 год назад

I got a lot of questions yesterday on how this made and if it was 3D or 2D so I decided to make a small breakdown video to explain. It was created using Non-Photorealistic Shaders and adapting a 2D animation workflow into 3D within Blender itself.

I got a lot of questions yesterday on how this made and if it was 3D or 2D so I decided to make a small breakdown video to explain. It was created using Non-Photorealistic Shaders and adapting a 2D animation workflow into 3D within Blender itself.

BNBaku

80,329 просмотров • 2 лет назад

There is a game coming out where you have to play it in 2d and 3d at the same time

There is a game coming out where you have to play it in 2d and 3d at the same time

Dexerto

7,085,009 просмотров • 2 лет назад

I built a full 3D strategy game with Opus 4.8 + Fable 5 Launching it today. Runs in your browser, no install, free: > 21 battlefields > economy + tech tree > tanks vs jets vs turrets, real counters > single player vs up to 7 AI bots > a battle royale storm map Click and you're at war in 10 seconds 👇

I built a full 3D strategy game with Opus 4.8 + Fable 5 Launching it today. Runs in your browser, no install, free: > 21 battlefields > economy + tech tree > tanks vs jets vs turrets, real counters > single player vs up to 7 AI bots > a battle royale storm map Click and you're at war in 10 seconds 👇

SoloTech

68,242 просмотров • 4 месяцев назад

Global Anomaly Detection System update. Inspired by the recent global outage. visualizing worldwide impact zones while experimenting with projecting instanced geometries from a 3D sphere to a 2D Mercator map in three.js

Global Anomaly Detection System update. Inspired by the recent global outage. visualizing worldwide impact zones while experimenting with projecting instanced geometries from a 3D sphere to a 2D Mercator map in three.js

Dilum Sanjaya

39,622 просмотров • 11 месяцев назад

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,746 просмотров • 3 лет назад

I applied Matt's prompt, ran it for a little over ten hours. About 1.3 million tokens on Opus 5. It created the game. I also made a video of it using Opus 5. Here's the video (and in my reply to this is a link to the actual game so you can play).

I applied Matt's prompt, ran it for a little over ten hours. About 1.3 million tokens on Opus 5. It created the game. I also made a video of it using Opus 5. Here's the video (and in my reply to this is a link to the actual game so you can play).

James Altucher

128,128 просмотров • 2 месяцев назад

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

Alex

48,582 просмотров • 7 месяцев назад

LaMelo Ball on building a chemistry with Rudy Gobert “I mean, he’s played basketball a long time, I have too, so it’s kind of easy. He’s just a big and in a little for real” On if he’s played with a player like Gobert before “I mean, he’s hall of fame for sure so that’s tough to say, but, I play a lot of 2K, you just play a lot of basketball, basketball is the same from a video game to on court to real life, On Gobert off the court “Rudy is funny as hell, great dude”

LaMelo Ball on building a chemistry with Rudy Gobert “I mean, he’s played basketball a long time, I have too, so it’s kind of easy. He’s just a big and in a little for real” On if he’s played with a player like Gobert before “I mean, he’s hall of fame for sure so that’s tough to say, but, I play a lot of 2K, you just play a lot of basketball, basketball is the same from a video game to on court to real life, On Gobert off the court “Rudy is funny as hell, great dude”

Andrew Dukowitz

200,853 просмотров • 12 дней назад

This game makes you play it in 2d and 3d at the same time, now they have caves

This game makes you play it in 2d and 3d at the same time, now they have caves

Dexerto

3,549,573 просмотров • 2 лет назад

I built a real-time, multiplayer whiteboard fully in Lovable. Real-time sync, cursor tracking, and drawing tools, all built in an afternoon.

I built a real-time, multiplayer whiteboard fully in Lovable. Real-time sync, cursor tracking, and drawing tools, all built in an afternoon.

Tyler Bruno

28,031 просмотров • 6 месяцев назад

Today’s hobby project: Prototyped a real-time room scanning system with live sharing to XR devices. Explore scanned spaces in 3D on XR (not flat 2D screens) and share them with remote users for spatial remote collaboration. #metaquest #augmentedreality

Today’s hobby project: Prototyped a real-time room scanning system with live sharing to XR devices. Explore scanned spaces in 3D on XR (not flat 2D screens) and share them with remote users for spatial remote collaboration. #metaquest #augmentedreality

Takashi Yoshinaga

126,635 просмотров • 9 месяцев назад