Loading video...

Video Failed to Load

Go Home

Learning Physically Simulated Tennis Skills from Broadcast Videos demonstrate that system produces controllers for physically-simulated tennis players that can hit the incoming ball to target positions accurately using a diverse array of strokes (serves, forehands, and backhands), spins (topspins and slices), and playing styles (one/two-handed backhands, left/right-handed play). Overall,...

125,559 views • 3 years ago •via X (Twitter)

10 Comments

Mike Rodriguez's profile picture
Mike Rodriguez3 years ago

@Scobleizer This is amazing. That being said, I can imagine broadcast sports and media companies not taking kindly to this. They have the power to shut things down for a lot of us. As opposed to artists who might not have the budget to attempt to retain usage rights.

尬聊's profile picture
尬聊3 years ago

I know I'm too late but prepare for all the "actually their technique sucks" takes

James Darpinian's profile picture
James Darpinian3 years ago

Those movements don't look realistic at all. They're supposed to be physically simulated?

Noah Basketball's profile picture
Noah Basketball2 years ago

Train your shooters on the same technology the top coaches use for player evaluation. #MakeMoreShots #WinMoreGames

Gustavo's profile picture
Gustavo3 years ago

bloody incredible. Not lifelike just yet but not far off

William Lamkin's profile picture
William Lamkin3 years ago

I’d be curious to see this kind of research for MMA. I would imagine the system might come across interesting and novel submission moves, unexpected fake outs, discover unexploited weaknesses and strange ways of leveraging the human form for combat, etc.

Michael Ehrmantraut's profile picture
Michael Ehrmantraut3 years ago

Two-handed backhand needs some work. Also forehands could use the same adjustment. Namely to take the racquet back higher and then drop it down into place (rather than the low take back).

Jama Noor's profile picture
Jama Noor3 years ago

I think this would allow for training in VR, where previously unscalable, now any significant set of high quality video should allow for improved human training. Everyone can afford a 1-on-1 tutor at the highest level in any sport.

Chloro's profile picture
Chloro3 years ago

@Algon_33

Akshay 🚀's profile picture
Akshay 🚀3 years ago

Interesting! I particularly liked the single handed backhand & the kick serve!!

Related Videos

AI TENNIS ANALYSIS. A FULL COMPUTER VISION SYSTEM. BUILT ON YOLO, PYTORCH, AND KEYPOINT EXTRACTION. Take any tennis match broadcast, any camera angle, any resolution. Feed it into the pipeline. YOLO detects both players and the tennis ball frame by frame. No manual labeling, no pre-annotated dataset. A fine-tuned YOLOv5 model trained on a Roboflow tennis ball dataset handles the ball - the hardest object to track in any sport. Tiny, fast, constantly occluded. The model finds it anyway. Trackers maintain identity across frames so Player 1 stays Player 1 from the first serve to match point. But detection is just the start. A ResNet50 CNN trained in PyTorch predicts court keypoints from every frame - the corners, service lines, baselines, net posts. Fourteen points that define the entire playing surface geometry. From those keypoints the system builds a homography matrix and warps the broadcast perspective into a top-down mini court with real coordinates. Now every player has a position in real space, not pixel space. Every frame becomes a measurement. Every rally becomes a dataset. Player movement speed - calculated from position deltas between frames, converted to meters per second through the homography. Ball shot speed - measured from the ball trajectory across consecutive detections. Number of shots per rally - counted automatically through ball direction changes. All of this rendered live on the video as an overlay. A mini court in the corner showing both players as dots moving in real time. Stats updating after every point. OpenCV handles the rendering. Pandas handles the math. PyTorch handles the intelligence. YOLO handles the eyes. No Hawkeye subscription, no court-embedded sensors, no tracking chips in the ball. A Python script, a trained model, and a GPU. The full code is on GitHub. The tutorial walks through every module - from ball detector training to court keypoint extraction to the final statistical overlay. Professional teams used to need broadcast deals and proprietary hardware for this kind of analysis. Now you build it in an afternoon with open-source tools. Trading here: Computer vision didn't just enter tennis. It made the expensive stuff free.

zostaff

121,478 views • 5 months ago

I take back my statement that “Anyone can build a game with AI.” After 256 prompts building Top Tennis, I think people underestimate the person giving the instructions. One example from a prompt I wrote for Top Tennis: “i feel like the only way to score is going under the net or waiting for the CPU to make a mistake. there should be other ways. a deep ball should push the opponent behind the baseline, leaving space for a drop shot. after a difficult return, it should take longer to recover. changing direction should cost it time. give the CPU a reaction delay before it responds to my shot. it shouldn’t know where i’m aiming before racket contact. when it changes direction, make it decelerate before accelerating the other way. make return quality depend on positioning, incoming ball speed and preparation time. a stretched player running at full speed shouldn’t hit with the same accuracy and power as one waiting in position. look at player speed, acceleration, court size and ball speed together. compare how long the ball takes to reach its destination with how long the opponent needs to get there. test specific patterns: deep ball then drop shot, wide crosscourt then down the line, and hitting behind a moving opponent. check whether they create real openings without making every combination an automatic winner. beating the CPU should feel like you’re learning how to play tennis. analyze this deeply before changing anything.”

Matteo V.

71,310 views • 16 days ago

Tennis players live 9.7 years longer than sedentary people. Not 9.7 months. 9.7 years. Nearly a decade. The Copenhagen City Heart Study tracked 8,577 people for 25 years and ranked every sport by how much life it adds. Badminton: 6.2 years. Soccer: 4.7. Cycling: 3.7. Swimming: 3.4. Jogging: 3.2. Tennis almost triples jogging. A separate study of 80,000 adults found racket sports cut all-cause mortality by 47% and cardiovascular death by 56%. Swimming hit 41%. Aerobics hit 36%. The question is why racket sports destroy everything else. Three mechanisms stack on top of each other. First, the physical demands. A tennis rally requires explosive sprints, lateral cuts, and sustained aerobic output. You're training fast-twitch and slow-twitch muscle fibers simultaneously. Most cardio only trains one system. Second, the cognitive load. You're reading spin, predicting angles, adjusting position, and executing motor patterns in real-time. Your brain is solving spatial puzzles at 80+ mph. That hand-eye coordination and strategic processing builds neural connections that protect against cognitive decline. Third, and this is the one researchers keep coming back to: you literally cannot play alone. Every racket sport requires another person on the other side of the net. That forced social interaction triggers neurochemical benefits that solitary exercise cannot replicate. Strong social connection alone increases your chance of longevity by 50%. Jogging is you and your thoughts. Tennis is you, a strategic opponent, and a community. Dr. Daniel Amen is right. The data is overwhelming. If you want the single highest-ROI activity for a longer life, pick up a racket.

Aakash Gupta

5,245,831 views • 6 months ago

🚨 BREAKING: Microsoft's first robotics foundation model! 🤯 Microsoft just announced Rho-alpha (ρα), their first robotics model derived from the Phi series of vision-language models. Rho-alpha translates natural language commands into control signals for robotic systems performing bimanual manipulation tasks. Commands like "push the green button with the right gripper," "pull out the red wire," "flip the top switch on," or "turn the knob to position 5" get executed directly by dual-arm robots. What makes this different from standard vision-language-action (VLA) models is the additional modalities. Rho-alpha is a VLA+ model that adds tactile sensing to the perceptual mix, with plans to incorporate force feedback. On the learning side, the model is designed to continually improve during deployment by learning from human feedback. The training approach combines trajectories from physical demonstrations and simulated tasks with web-scale visual question answering data. Since teleoperation data is scarce and expensive, Microsoft is using NVIDIA Isaac Sim on Azure to generate physically accurate synthetic datasets via reinforcement learning. These simulated trajectories get combined with commercial and open physical demonstration datasets. The model is currently under evaluation on dual-arm setups and humanoid robots. Microsoft is opening an Early Access Program for organizations interested in evaluating Rho-alpha. Robots that can adapt to dynamic situations and human preferences are more useful in real environments and more trusted by the people operating them. Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

61,071 views • 8 months ago

Mojo Australian Open Quarterfinals 🧙🏼‍♂️🇦🇺🎾 —— 5U MAX 2026: (18-3) 85.71% 🏦 —— 5U 🇺🇸Ben Shelton +7.0 games (-155) 🔮 Seven games for Shelton when he is arguably playing the best tennis of his career is too many. Shelton has only been broken 3 times this entire tournament and has played better overall players by a landslide than Sinner. Shelton has hit 184 winners to 115 unforced errors in his 4 matches in Melbourne. This stat alone shows the quality of tennis Shelton has been playing. Sinner has hit 152 winners to 99 unforced errors. Shelton has a slight advantage in winners/unforced errors ratio while playing better opponents… And we are getting 7 games. Look, I know Sinner is insane and I know the history between these two players. I will tell you I have watched Shelton play shout 100 matches of professional tennis and the confidence he is playing with right now is unlike anything I have seen from him. While on the contrary Sinner has not looked anything above his typical level. Give me the 7 games. Even if Shelton gets broken once in every single set, we still cover or push. 6-3 6-4 6-4 | 6-4 6-4 6-4 . And this is assume we don’t get any break chances of our own. If Shelton can confidently hold serve like he has been doing all tournament then it will open the door for him to be hyper aggressive on return and go for shots that will win him the match. I love this play. Let’s get it 🧙🏼‍♂️

MOJO 🧙🏼‍♂️

37,303 views • 8 months ago