Kaifeng Zhang's banner

Kaifeng Zhang

@kaiwynd • 3,473 subscribers

Robotics @columbia

Shorts

Cloth simulation using NVIDIA Newton. Not perfect, but looking good!

Cloth simulation using NVIDIA Newton. Not perfect, but looking good!

34,650 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

I asked Astra to express itself using a keyboard. 40 minutes, several accidental long presses, and a lot of backspace later, it learned how to type. Video at 20× speed. Watch till the end!

I asked Astra to express itself using a keyboard. 40 minutes, several accidental long presses, and a lot of backspace later, it learned how to type. Video at 20× speed. Watch till the end!

48,670 Aufrufe • vor 1 Monat

Gave GPT-6 Astra the task to plug in an ethernet cable. It did it after 2 hours and 4 human prompt interventions. Being able to complete a task with tight tolerance and deformable objects is impressive. But I think speed is still a big problem with agentic robotic systems, since deep reasoning via 3D programs is an integral part of this pipeline, and it’s not obvious to me how that can be distilled/accelerated to a level comparable to VLAs.

Gave GPT-6 Astra the task to plug in an ethernet cable. It did it after 2 hours and 4 human prompt interventions. Being able to complete a task with tight tolerance and deformable objects is impressive. But I think speed is still a big problem with agentic robotic systems, since deep reasoning via 3D programs is an integral part of this pipeline, and it’s not obvious to me how that can be distilled/accelerated to a level comparable to VLAs.

17,994 Aufrufe • vor 1 Monat

🧵 Evaluating robot policies in the real world is slow, expensive, and hard to scale. During my internship at SceniX this summer, we had many discussions around the two key questions: how accurate must a simulator be for evaluation to be meaningful, and how do we get there? Our new framework, Real2Sim-Eval, takes a step toward that answer. By combining Gaussian Splatting for photorealistic rendering and soft-body digital twins for realistic dynamics, we make simulation predictive of real-world performance. 👉

🧵 Evaluating robot policies in the real world is slow, expensive, and hard to scale. During my internship at SceniX this summer, we had many discussions around the two key questions: how accurate must a simulator be for evaluation to be meaningful, and how do we get there? Our new framework, Real2Sim-Eval, takes a step toward that answer. By combining Gaussian Splatting for photorealistic rendering and soft-body digital twins for realistic dynamics, we make simulation predictive of real-world performance. 👉

67,703 Aufrufe • vor 11 Monaten

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

46,516 Aufrufe • vor 1 Jahr

Keine weiteren Inhalte verfügbar