Skip navigation
Most trackers lose sight of an object once it changes shape…
0:00 / 1:24

Most trackers lose sight of an object once it changes shape…

Ilir Aliu

@IlirAliu_58K followers

Visit on X
305 likesDownloadOriginal post

18,124 views

Most trackers lose sight of an object once it changes shape… [👇Code & Dataset] an apple turns into slices, a caterpillar into a butterfly, and the model just gives up. Researchers at Cornell built a new system called Track Any State that does something different: it follows objects through their transformations while describing what actually changed. > Tracks objects even after transformation > Detects and describes new object states > Recovers missing tracks with TubeletGraph > State-of-the-art accuracy under transformations It’s a step toward models that understand how things evolve over time… not just where they move. 📍Paper: “Tracking and Understanding Object Transformations” (NeurIPS 2025) Code & Dataset: —— Weekly robotics and AI insights. Subscribe free:

5 Comments

Comments from the original post on X (Twitter)

  • Alexandru-Andrei Rotaru's profile picture

    @rotaruzaurul

    As cool as this is, the problem itself is "ill-posed". There are virtually unlimited ways to "transform" the object in pixel space (change angle/color, occlusion, etc.). Also, how do you track if you cook the thing you track?

    1 like

  • Saleh Aldwais's profile picture

    @SAldwais

    Good 👍

  • Igor Lessio - Robots/acc - AIFlow Labs's profile picture

    @AIFlow_ML

    Apple to slices is exactly where robot perception breaks in kitchens. If Track Any State keeps identity through shape changes, which manipulation task benefits first: cooking or assembly?

  • Dan Ghadiri's profile picture

    @danielghadiri

    Food plants need exactly this. Today a camera loses the potato the moment it becomes strips, so nobody can say whether the yield went to trim, slivers or rejects. Follow the product through the cut and yield stops being an end-of-shift guess.

  • Chen's profile picture

    @chenzhangreal

    track any state handling caterpillars turning into butterflies is wild. i didn't know that was a gap in tracking tech before.