Andrew Carr 🤸's banner

Andrew Carr 🤸

@andrew_n_carr • 26,558 subscribers

co-founder leading science @getcartwheel co-founder advisor @arcade_ai Past: Codex @OpenAI, Brain @GoogleAI, world ranked Tetris player

Shorts

Disney's new research on neural rendering really upped the game. They start by path tracing and then running light gathering on those paths. Then they train a little network, kinda like a NERF, to produce those lighting results directly. It essentially keeps the lighting team from requiring a full (complex) re-render every-time they move a light. But it keeps the lighting team fully in the driver's seat creatively. Definitely a great use of AI for advanced storytelling and animation.

Disney's new research on neural rendering really upped the game. They start by path tracing and then running light gathering on those paths. Then they train a little network, kinda like a NERF, to produce those lighting results directly. It essentially keeps the lighting team from requiring a full (complex) re-render every-time they move a light. But it keeps the lighting team fully in the driver's seat creatively. Definitely a great use of AI for advanced storytelling and animation.

76,302 Aufrufe

One of the biggest challenges in video to motion is scale! Most of the time people think of it as distance to the camera, but when you add multiple people the scale between them almost matters more! At cartwheel - with our newest model - we're really proud to capture distance and character scale accurately

One of the biggest challenges in video to motion is scale! Most of the time people think of it as distance to the camera, but when you add multiple people the scale between them almost matters more! At cartwheel - with our newest model - we're really proud to capture distance and character scale accurately

24,414 Aufrufe

Huggingface has entered their node editor era with Daggr (DAG-based Gradio workflows). Really really cool and well done

Huggingface has entered their node editor era with Daggr (DAG-based Gradio workflows). Really really cool and well done

29,325 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

The term "markerless" gets thrown around a lot in motion capture. What does it mean? Well...surprise! There are still markers (we put them on you instead of you getting in a suit) When we capture motion from your videos, we still need to estimate important landmarks, we've just built a way to do it on a web camera instead of a $100k mocap stage. Multi person + scale aware with extremely good camera pose estimation. Try it out and let me know what you think

The term "markerless" gets thrown around a lot in motion capture. What does it mean? Well...surprise! There are still markers (we put them on you instead of you getting in a suit) When we capture motion from your videos, we still need to estimate important landmarks, we've just built a way to do it on a web camera instead of a $100k mocap stage. Multi person + scale aware with extremely good camera pose estimation. Try it out and let me know what you think

Andrew Carr 🤸

72,123 Aufrufe • vor 2 Monaten

Just a few months after releasing Scoot, which we feel redefined motion generation quality, our team has made substantial improvements in speed, quality, subtlety, and instruction following. This comes in concert with our newly scaled data collection and labeling efforts, compute increase, substantial architectural improvements, and more stable / scalable training dynamics. Swing is our new flagship movement model. It's live today in Cartwheel studio with infinite batch generation coming soon to our API. Treating Movement as a fundamentally new data type has really unlocked our ability to rapidly make improvements. As it turns out there are far more use cases than you might imagine from entertainment to robotics.

Just a few months after releasing Scoot, which we feel redefined motion generation quality, our team has made substantial improvements in speed, quality, subtlety, and instruction following. This comes in concert with our newly scaled data collection and labeling efforts, compute increase, substantial architectural improvements, and more stable / scalable training dynamics. Swing is our new flagship movement model. It's live today in Cartwheel studio with infinite batch generation coming soon to our API. Treating Movement as a fundamentally new data type has really unlocked our ability to rapidly make improvements. As it turns out there are far more use cases than you might imagine from entertainment to robotics.

Andrew Carr 🤸

150,288 Aufrufe • vor 5 Monaten

I recorded my screen, it took me less than 10 minutes to go from text -> 3d printed object. I brainstormed with Gemini, used Imagen 3.0 to create the image, used Trellis to turn it into a GLB, translated that into an STL and printed it with my wife's bambulabs printer. I've been dreaming about this for years, being able to create things from pure thought! We're getting closer.

I recorded my screen, it took me less than 10 minutes to go from text -> 3d printed object. I brainstormed with Gemini, used Imagen 3.0 to create the image, used Trellis to turn it into a GLB, translated that into an STL and printed it with my wife's bambulabs printer. I've been dreaming about this for years, being able to create things from pure thought! We're getting closer.

Andrew Carr 🤸

359,925 Aufrufe • vor 1 Jahr

animation is the past, present, and future of storytelling - but it can be painful and tedious. I'm pretty excited about this workflow cartwheel in blender! capture motion, edit, generate, repath, repose, retime - all in your DCC. we're testing this out, so let me know if you're interested (DMs open), we're hoping to launch a cleaned up version early next month

animation is the past, present, and future of storytelling - but it can be painful and tedious. I'm pretty excited about this workflow cartwheel in blender! capture motion, edit, generate, repath, repose, retime - all in your DCC. we're testing this out, so let me know if you're interested (DMs open), we're hoping to launch a cleaned up version early next month

Andrew Carr 🤸

31,256 Aufrufe • vor 1 Monat

EDIT MOTION IN VIDEOS!!! Quit prompting and start directing I've been shouting for YEARS about 3D as the control layer. Here it is, signs of life of our Universal Video Editor!!! The workflow is: take your video, capture with comic 4, edit with the motion editor, re-render with your favorite video to video model (e.g., Runway and Google Gemini have good ones) Here we have a fashion clip where we wanted our actress to high step and show a bit more pizzaz - but shoot day is over, and traditionally it would cost many thousands to reshoot. Watch the video to see how it works instead in cartwheel. cc Logan Kilpatrick Cristóbal Valenzuela 👀

EDIT MOTION IN VIDEOS!!! Quit prompting and start directing I've been shouting for YEARS about 3D as the control layer. Here it is, signs of life of our Universal Video Editor!!! The workflow is: take your video, capture with comic 4, edit with the motion editor, re-render with your favorite video to video model (e.g., Runway and Google Gemini have good ones) Here we have a fashion clip where we wanted our actress to high step and show a bit more pizzaz - but shoot day is over, and traditionally it would cost many thousands to reshoot. Watch the video to see how it works instead in cartwheel. cc Logan Kilpatrick Cristóbal Valenzuela 👀

Andrew Carr 🤸

11,622 Aufrufe • vor 1 Monat

motion is transferable!! capture, create, and craft on human - then retarget to ANY character. cartographer is our new labor of love, true retargeting for the masses - live today on cartwheel :)

motion is transferable!! capture, create, and craft on human - then retarget to ANY character. cartographer is our new labor of love, true retargeting for the masses - live today on cartwheel :)

Andrew Carr 🤸

10,689 Aufrufe • vor 2 Monaten

I'm pretty sure the "AI Mode" / "Generative Search" model is something unreleased. Time to figure out it's mmlu-pro score

I'm pretty sure the "AI Mode" / "Generative Search" model is something unreleased. Time to figure out it's mmlu-pro score

Andrew Carr 🤸

18,866 Aufrufe • vor 7 Monaten

Introducing Cartwheel 🤸 a text-to-animation tool!

Introducing Cartwheel 🤸 a text-to-animation tool!

Andrew Carr 🤸

40,019 Aufrufe • vor 2 Jahren

Keine weiteren Inhalte verfügbar