Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Time for the open-source AI robots revolution 🚀 We’ve been playing with a low-cost DJI robot controlled by 3 local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) & orchestrated by Dora-cs In comments a 250 lines code gist to build on top of it => enjoy!!

Thomas Wolf

121,763 subscribers

138,089 views • 2 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Comments

Thomas Wolf2 years ago

Gist 👇

Haixuan Xavier Tao2 years ago

@LeoTronchon Feel free to check the code: 😋

Kirk Kaiser2 years ago

@HaixuanT @LeoTronchon typo in the post. the models are orchestrated by dora-rs:

clem 🤗2 years ago

@HaixuanT @LeoTronchon so cool!

Damien C. Tanner2 years ago

@HaixuanT @LeoTronchon Absolutely brilliant! Can’t wait to play with these models. I’ve got a raspberry pi robot kit ready to build something similar with my kids.

Lalit Pagaria2 years ago

@HaixuanT @LeoTronchon @CaptVenk new toy for junior 🙂

Chuck Petras2 years ago

@HaixuanT @LeoTronchon @BrianRoemmele

Emile Cohen2 years ago

@HaixuanT @LeoTronchon That’s super cool ! Is it the DJI robomaster S1 ?

Noah Kasmanoff2 years ago

@HaixuanT @LeoTronchon No robotics here yet but hope to add something like you've shown someday! Using similar models to what you have here:

Saurabh Bhatnagar2 years ago

@HaixuanT @LeoTronchon HuggingToys

Related Videos

the conference is getting crazy over it today we're unveiling our 1st robot Hugging Face 🤝 Pollen Robotics a low-cost $250 open-source robot designed as an open-source platform for fun human computer interactions powered by HF Spaces-models-community >

the conference is getting crazy over it today we're unveiling our 1st robot Hugging Face 🤝 Pollen Robotics a low-cost $250 open-source robot designed as an open-source platform for fun human computer interactions powered by HF Spaces-models-community >

Thomas Wolf

104,852 views • 1 year ago

Run Cline on Local AI models with Atomic Chat! Cline is a coding agent trusted by 8M+ developers. Write, refactor, ship code securely on your own hardware with local models powered by atomic.chat — no cloud, private, free and open-source

Run Cline on Local AI models with Atomic Chat! Cline is a coding agent trusted by 8M+ developers. Write, refactor, ship code securely on your own hardware with local models powered by atomic.chat — no cloud, private, free and open-source

atomic.chat

43,940 views • 1 month ago

Open source AI is gaining traction due to the White House’s clampdown on Anthropic & OpenAI. “A lot of founders and developers have been burned by trying to build apps on top of these really advanced closed source models, like Fable for instance…” “… and then seeing those models get taken down or removed from the market just days later.” — Stephanie Palazzolo, AI Reporter

Open source AI is gaining traction due to the White House’s clampdown on Anthropic & OpenAI. “A lot of founders and developers have been burned by trying to build apps on top of these really advanced closed source models, like Fable for instance…” “… and then seeing those models get taken down or removed from the market just days later.” — Stephanie Palazzolo, AI Reporter

The Information

19,314 views • 1 month ago

🚀 Launching our open-source teleoperation device for full-body Vega robot control! 🔓 Open-source 💰 Low-cost 🎒 Portable 🦾 Whole-body control Control both real and simulated Vega robots! 🤖✨ 📍 Live Demo at #CoRL - See it in action with real and simulated Vega robots in Isaac Lab. Stop by booth #6 if you're attending! #PhysicalAI #Robotics #Teleoperation

🚀 Launching our open-source teleoperation device for full-body Vega robot control! 🔓 Open-source 💰 Low-cost 🎒 Portable 🦾 Whole-body control Control both real and simulated Vega robots! 🤖✨ 📍 Live Demo at #CoRL - See it in action with real and simulated Vega robots in Isaac Lab. Stop by booth #6 if you're attending! #PhysicalAI #Robotics #Teleoperation

Dexmate

14,087 views • 10 months ago

Thank you to Markku Räsänen, CEO of ConfidentialMind for sitting down with us and sharing his thoughts on: - Whether open source models are undervalued - Changes in AI infrastructure & inference - Power consumption & efficiency in Europe - The future of open source AI

Thank you to Markku Räsänen, CEO of ConfidentialMind for sitting down with us and sharing his thoughts on: - Whether open source models are undervalued - Changes in AI infrastructure & inference - Power consumption & efficiency in Europe - The future of open source AI

SambaNova

31,874 views • 1 year ago

Open Source AI only works if people trust it. At the EthDenver Open AGI Summit, Arman Aurobindo of Horizen moderated a discussion on “Privacy, Security, and Open Source AI” Joined by: Jake Salerno (Ø,G) of 0G Labs (Home of Infinite AI) Salman Avestimehr of ChainOpera AI Gabriel P. Andrade of gensyn Full panel in the comments 👇

Open Source AI only works if people trust it. At the EthDenver Open AGI Summit, Arman Aurobindo of Horizen moderated a discussion on “Privacy, Security, and Open Source AI” Joined by: Jake Salerno (Ø,G) of 0G Labs (Home of Infinite AI) Salman Avestimehr of ChainOpera AI Gabriel P. Andrade of gensyn Full panel in the comments 👇

Open AGI

13,252 views • 5 months ago

Yann LeCun says the real AI risk isn’t extinction or killer robots, it’s power concentration. If AI becomes our main source of information, whoever controls it controls reality. That’s why he argues for open-source AI. A free future can’t be built on black boxes owned by a few. Open source is digital free speech.

Yann LeCun says the real AI risk isn’t extinction or killer robots, it’s power concentration. If AI becomes our main source of information, whoever controls it controls reality. That’s why he argues for open-source AI. A free future can’t be built on black boxes owned by a few. Open source is digital free speech.

VraserX e/acc

71,246 views • 6 months ago

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 views • 14 days ago

Announcing CodeArena! Two LLMs build the same app, vote on which one did best, and see a live leaderboard of the best open source coding LLMs! 100% free & open source. Powered by Together AI & available today:

Announcing CodeArena! Two LLMs build the same app, vote on which one did best, and see a live leaderboard of the best open source coding LLMs! 100% free & open source. Powered by Together AI & available today:

Hassan

22,378 views • 1 year ago

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

Deepanshu Sharma

291,222 views • 1 year ago

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

Amos Gyamfi

79,756 views • 1 month ago

Time to democratize humanoid robots! Introducing ToddlerBot, a low-cost ($6K), open-source humanoid for robotics and AI research. Watch two ToddlerBots seamlessly chain their loco-manipulation skills to collaborate in tidying up after a toy session.

Time to democratize humanoid robots! Introducing ToddlerBot, a low-cost ($6K), open-source humanoid for robotics and AI research. Watch two ToddlerBots seamlessly chain their loco-manipulation skills to collaborate in tidying up after a toy session.

Haochen Shi

113,527 views • 1 year ago

Introducing Open TTS Tracker! 🗣️ *sound on* A one-stop shop to track all open access/ source TTS models! Ranging from XTTS to Pheme, OpenVoice to VITS, and more... ⚡ For each model, we compile: 1. Souce-code 2. Checkpoints 3. License 4. Fine-tuning code 5. Languages supported 6. Paper 7. Demo Help us make it more complete! Let's 2024 the year of open TTS models! ❤️

Introducing Open TTS Tracker! 🗣️ sound on A one-stop shop to track all open access/ source TTS models! Ranging from XTTS to Pheme, OpenVoice to VITS, and more... ⚡ For each model, we compile: 1. Souce-code 2. Checkpoints 3. License 4. Fine-tuning code 5. Languages supported 6. Paper 7. Demo Help us make it more complete! Let's 2024 the year of open TTS models! ❤️

Vaibhav (VB) Srivastav

68,037 views • 2 years ago

Introducing Open Lovable v3 - an open source AI design engineer 🔥 Enter a URL and agents will create an on brand clone you can build on top of. Powered by Gemini 3 Pro and 's new branding format. Try out the 100% open source example, link below!

Developers Digest

178,165 views • 9 months ago

Introducing Qwen 3 + Deep Research! We built a deep research agent with Qwen 3 and it performed better than most open source models that we've tried. the code is completely open source and free! built with 's Langgraph Together AI and uses Perplexity Tavily for search here's the code link:

Introducing Qwen 3 + Deep Research! We built a deep research agent with Qwen 3 and it performed better than most open source models that we've tried. the code is completely open source and free! built with 's Langgraph Together AI and uses Perplexity Tavily for search here's the code link:

Soham

34,566 views • 1 year ago

You can now clone any website just by writing a prompt. Just paste the website URL and Al agents will instantly create a working clone you can build on top of. 100% open source with major AI models👇

You can now clone any website just by writing a prompt. Just paste the website URL and Al agents will instantly create a working clone you can build on top of. 100% open source with major AI models👇

Alvaro Cintas

52,304 views • 11 months ago

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,025 views • 6 months ago

🚀 Watch how I connected Chrome's AI API to ollama, enabling ANY web app built for Chrome's local Gemini to seamlessly work with open-source LLMs! A🧵on making AI in Chrome more open and flexible...

🚀 Watch how I connected Chrome's AI API to ollama, enabling ANY web app built for Chrome's local Gemini to seamlessly work with open-source LLMs! A🧵on making AI in Chrome more open and flexible...

Andrei David

94,530 views • 1 year ago

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 views • 1 year ago

AI creators now have the economic infrastructure to build, deploy, and earn; it's 100% open-source and community-driven. OpenLedger offers unmatched transparency, flexibility, and the tools you need to build the future of AI on your terms. OpenLedger is a decentralized, open-source blockchain designed for sourcing, training, and monetizing AI models. Learn more about in this video 👇

AI creators now have the economic infrastructure to build, deploy, and earn; it's 100% open-source and community-driven. OpenLedger offers unmatched transparency, flexibility, and the tools you need to build the future of AI on your terms. OpenLedger is a decentralized, open-source blockchain designed for sourcing, training, and monetizing AI models. Learn more about in this video 👇

MosesMee

14,108 views • 1 year ago