Video yükleniyor...
Video Yüklenemedi
I find it wild that Physical Intelligence robotics models can work at all given that they only have a 1 second context length. As the robot is moving around a room and cleaning up a table, it only sees the current timestamp of images from the cameras (plus the... show more
126,335 görüntüleme • 1 yıl önce •via X (Twitter)
25 Yorum

Great clip. Yes, the robot model is doing system 1 thinking. Just like when we tie our shoelaces, we literally don’t think about it, we just do it, it’s a memorized subroutine. You realize this when you have to teach someone to tie a shoelace. Your conscious brain (system 2) has literally forgotten how to do it. So the first thing you do when teaching is watching yourself tie your own shoelace to relearn (in system 2) how to do it. And then once back again in system 2, you can talk about it, reason about it, etc. Btw, this human system 1 memorization is very flexible, just like a robotic neural net. It can generalize over many types of laces, shoes, poses, etc. Can’t wait for the podcast tomorrow!

@physical_int It's like memento every second?

@physical_int I don't find this odd our working memory is very short and we just keep moving forward chunk my chunk. We take very little data forward with us in a new area. We may have to look back many times and re track

@physical_int I was thinking more of Zeno's paradox for motion

@physical_int >If a human had to execute a many minutes long plan in order to accomplish a physical task, but had her memory reset every second, there's no way she could pull it off Replace "memory" with "attention" and this sums up ADHD pretty well.

@physical_int Bad take sort of, plumber even a well rehearsed one will never manage without extremely long context window

@physical_int Best guest ever

@physical_int yeah wild how constraints push innovation boundaries sometimes

@physical_int Ooooooh nice!!

@physical_int looking forward to watching this episode!

@physical_int I like unit expression 1 sec/context size. I am curious like how much @Tesla_Optimus have. I guess you have also separated context related to high level goal - clean table.

@physical_int Tuning in

@dwarkeshpodcast @physical_int I’m glad I came across your podcast.

@dwarkeshpodcast @physical_int need an editor? send a DM

@physical_int wild stuff, maybe robot just re-checks environment every second and stays reactive, paradoxx?

Short context windows in robotics pulling off complex tasks like room cleanup is mind blowing, shows how much the world state in the moment can drive smart actions without needing the full history. Peptides could mirror that efficiency in bio design, short chains that react to local signals for precise neural tweaks or muscle responses on the fly. Imagine peptide bots in cells sensing the immediate environment to execute healing protocols, keeping the system humming without overloading the memory banks.

@physical_int Yassssss

@physical_int wild that robots can operate on basically “1s memory loops” 😳 feels like living in eternal present but still able to clean, move, act. moravec’s paradox hitting again → what’s trivial for humans = hard for AI, what’s hard for humans = trivial for AI.

@physical_int The robot keeps a target game state (goal) in its head as well as the current game state n (= context window). "Memory" represents a subset of variables within the context window. 1/2

@physical_int The robotics model basically operates in 'flow'. Super interesting

@physical_int can’t wait to hear this one!

@physical_int Take a look at how humans walk. From what I have read, most processing is done in the spine. Crazy if true but fits that model.

@physical_int Excited for this one

@physical_int *Moravec's

@dwarkeshpodcast @physical_int Hey dwarkesh let's have a chat for your next podcast guest?????? Regards TwinMind
