The next 5 years will be wild. Knowing how to code and how these AI models work will give you infinite leverage. We integrated OpenAI's Whisper with Spot. We can now control the robot using our voice! Nothing is more rewarding than seeing your code walk on four legs.

We capture audio and transcribe it using Whisper. It's fast. We can react quickly to commands. We then map the transcription to individual functions that Spot understands using its SDK. It feels magic having the robot reacting to your voice!

This is just the start. The team @Levatas has been working with robots for a long time. Plans for the next year alone are crazy! Stay tuned. I'm working on a couple more experiments. They are wild. How long before robots become a big part of our lives?

@OpenAI I have 2 Spots at work. I’m scared of them enough as it is. 😆

@OpenAI Lol

@OpenAI This is a very cool application! 🚀 I can imagine trigger words to multi-step actions. Go get me a beer 🍻😜 Undock > locate fridge > open it > locate beer…

@OpenAI Using the world’s most advanced technologies to unlock human potential Love it!

@OpenAI Nice integration, @svpino! Say Hi to David and the rest of the team!

@OpenAI Happy to see the progress you are making integrating Spot with new communication ways. I still remember my son playing with Spot “the pet” in our offices at Levatas 5-6 years ago. Congrats.

@OpenAI That's very cool! Can the bot do complex commands like: "Undock then go measure something and then dock back"? or it does only short ones and you have to control the sequence?

@OpenAI Right now, only short commands. Not too hard to add support for multi-step commands.

@OpenAI I would say that GPT 4 knows how to code this. So, it is a question of to want and have the means to do what you want.

@OpenAI Eventually we can even control it with our minds! Awesome work!

@OpenAI Wow this is so cool 🚀

@OpenAI Nice 👍

@OpenAI @Susejlava

@OpenAI Me imagino un robot similar ayudando a astronautas en la luna al que simplemente hay que darle instrucciones de voz

@OpenAI Very nice integration ! I wonder how this could be implemented at scale !

@OpenAI Could sound stupid but could it misunderstand a command and obey right away something like “hit that human”?

@OpenAI Wow

@OpenAI Love this! The downstream applications of this are as exciting as they are numerous!

@OpenAI Pretty coool

@OpenAI Really cool implementation of Whisper. Nice to see it applied to hardware and not just a terminal/IDE output. 🤖

Now they listen, and according to this other work, with LLMs they can see and understand better. We are witnessing a revolution unlike any other in history: fast and global. The future is fascinating, may good fortune always accompany humanity to walk wise paths.

@OpenAI Progress!

@OpenAI Awesome 😎

@OpenAI Nice

@OpenAI Incredible. Remaining visual or motion commands for victims who need rescue and can not utter a word, some sort of life signature for spot to read and act on. Congratulations for this level.

@OpenAI We can now communicate with drones using a walkie talkie?

@OpenAI Wow!

@OpenAI I'm a retired engineer of 40 years. I'm a lifelong s. Floridian, I want to learn actual AI, what is the best educational tool you can recommend, I appreciate it. I have some fantastic virtual applications, ( in my cloud)

@OpenAI @sendvidbot

@OpenAI i can think about a few things more rewarding

@OpenAI imagine that dog have a gun.

@OpenAI So who had the emergence of skynet for 2023?

@OpenAI @BiswajoyChatte1 You did something like this several years ago with a laptop in the front...

@OpenAI @readwise save thread

@OpenAI Have you used GPT-3.5 or GPT-4 to translate natural language into spot sdk commands in this video?

What if we use AI? Let’s find out.