Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🚨 New Open Source Release Today we are releasing Ego-OSCAR, an open-source head-mounted stereo-inertial capture device for egocentric data collection in the wild, together with a corresponding dataset of 550 hours captured across 100+ environments. Egocentric data is still an active research problem, and we believe an open and...

fpv_labs's profile picture

FPV Labs

1,275 subscribers

39,123 Aufrufe • vor 3 Tagen •via X (Twitter)

Wissenschaft & TechnologieBildungGesundheit & Wellness
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Open-Source Robotic Hand That Costs Just $300. California-based company TetherIA.ai has officially launched its open-source robotic hand, the Aero Hand Open. Designed to be the most capable at the lowest cost, this hand is a new tool for embodied AI research. In the clip, it demonstrates impressive dexterity by grasping an M5 screw, picking up an iPhone, and opening a soda can. Key Features: ► Price: $314.00 ► Open Source: CAD, electronics, and firmware are all open source. ► Actuation: 7 Active Degrees of Freedom (16 joints) with a tendon-driven design. ► Weight: Under 400 grams. ► Purpose: Built for embodied AI research to make dexterous manipulation accessible to all. For more details and to purchase:
2:12

Open-Source Robotic Hand That Costs Just $300. California-based company TetherIA.ai has officially launched its open-source robotic hand, the Aero Hand Open. Designed to be the most capable at the lowest cost, this hand is a new tool for embodied AI research. In the clip, it demonstrates impressive dexterity by grasping an M5 screw, picking up an iPhone, and opening a soda can. Key Features: ► Price: $314.00 ► Open Source: CAD, electronics, and firmware are all open source. ► Actuation: 7 Active Degrees of Freedom (16 joints) with a tendon-driven design. ► Weight: Under 400 grams. ► Purpose: Built for embodied AI research to make dexterous manipulation accessible to all. For more details and to purchase:

RoboHub🤖

45,830 Aufrufe • vor 11 Monaten

The $600 Open-Source Home Robot🤖 Meet AlohaMini, the new dual-arm mobile robot designed to make real-world manipulation and embodied AI research accessible. This bot is fully 3D-printable and aimed at home builders and research labs. Key Features: 💰 Cost: The Bill of Materials (BOM) totals around $600 (USD) for self-printed parts, making it highly accessible. 🦾 Hardware: Dual-arm mobile base with a motorized vertical lift (0–60 cm travel). 💻 Software: Completely open-source hardware and software, compatible out-of-the-box with the LeRobot framework. The platform supports a fully 3D-printed Mini and a stiffer Pro model (hybrid materials). It assembles in approximately 60 minutes. 🔗 GitHub Open-Source Code & Files:
0:53

The $600 Open-Source Home Robot🤖 Meet AlohaMini, the new dual-arm mobile robot designed to make real-world manipulation and embodied AI research accessible. This bot is fully 3D-printable and aimed at home builders and research labs. Key Features: 💰 Cost: The Bill of Materials (BOM) totals around $600 (USD) for self-printed parts, making it highly accessible. 🦾 Hardware: Dual-arm mobile base with a motorized vertical lift (0–60 cm travel). 💻 Software: Completely open-source hardware and software, compatible out-of-the-box with the LeRobot framework. The platform supports a fully 3D-printed Mini and a stiffer Pro model (hybrid materials). It assembles in approximately 60 minutes. 🔗 GitHub Open-Source Code & Files:

RoboHub🤖

41,670 Aufrufe • vor 9 Monaten

Human Archive (YC W26) is a leader in the physical AI data race. Today, alongside our latest research, we’re sharing how our business works to push the frontier. 0:40 — HA-SLAM: The strongest publicly benchmarked results for egocentric SLAM. 2:02 — HA-HAND: Millimeter-level 3D hand tracking from head-mounted stereo. 2:58 — HA-Ego-500: The largest open-source action annotation dataset, setting a new gold standard for annotation granularity and accuracy. This is just the beginning. Let’s learn from humans. Thread below.
4:46

Human Archive (YC W26) is a leader in the physical AI data race. Today, alongside our latest research, we’re sharing how our business works to push the frontier. 0:40 — HA-SLAM: The strongest publicly benchmarked results for egocentric SLAM. 2:02 — HA-HAND: Millimeter-level 3D hand tracking from head-mounted stereo. 2:58 — HA-Ego-500: The largest open-source action annotation dataset, setting a new gold standard for annotation granularity and accuracy. This is just the beginning. Let’s learn from humans. Thread below.

Raj Patel

41,563 Aufrufe • vor 6 Tagen

Let's build a dashboard to evaluate and monitor your Agentic and RAG apps! . . In this video, I'll guide you through creating an evaluation and observability pipeline for your AI apps using a 100% open-source tool! Tech Stack: - Comet's Opik to eval and monitor - LlamaIndex to build a RAG pipeline - Ragas for synthetic datagen You'll learn: - Setting up Opik - Building a RAG pipeline - Creating an eval dataset - Evaluating the RAG pipeline - Monitoring all activities during the process It's a hands on demo with code and step-by-step guide to do everything listed above. CometML's Opik is fully open-source, offering the most Pythonic and easiest way to monitor LLM apps. I have shared link to their repo in next tweet!
17:07

Let's build a dashboard to evaluate and monitor your Agentic and RAG apps! . . In this video, I'll guide you through creating an evaluation and observability pipeline for your AI apps using a 100% open-source tool! Tech Stack: - Comet's Opik to eval and monitor - LlamaIndex to build a RAG pipeline - Ragas for synthetic datagen You'll learn: - Setting up Opik - Building a RAG pipeline - Creating an eval dataset - Evaluating the RAG pipeline - Monitoring all activities during the process It's a hands on demo with code and step-by-step guide to do everything listed above. CometML's Opik is fully open-source, offering the most Pythonic and easiest way to monitor LLM apps. I have shared link to their repo in next tweet!

Akshay 🚀

20,058 Aufrufe • vor 1 Jahr

We built the open source alternative to the Meta Raybans: Last year, I dropped out of MIT This year, we raised $8 million to build open source smart glasses Now, we’re launching our first smart glasses for devs: open source, with a software development kit, and an app store. A canvas for makers to easily build the upgrades we dreamed of as kids. Tools at your fingertips to expand our minds and unlock new powers And we're just getting started. Peep the website and join the movement with MentraLabs
0:35

We built the open source alternative to the Meta Raybans: Last year, I dropped out of MIT This year, we raised $8 million to build open source smart glasses Now, we’re launching our first smart glasses for devs: open source, with a software development kit, and an app store. A canvas for makers to easily build the upgrades we dreamed of as kids. Tools at your fingertips to expand our minds and unlock new powers And we're just getting started. Peep the website and join the movement with MentraLabs

cayden 凯登

108,557 Aufrufe • vor 11 Monaten

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:20

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,361 Aufrufe • vor 2 Monaten

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n
1:28

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

Zhi (Leo) Wang

110,230 Aufrufe • vor 2 Monaten

we released our react package build an ai chat w/ interactive components in a few lines of code. add it to your app with: npx tambo full-send we support: - streaming for both messages and components - message history and message threads - state manage for generated components - suggested actions based on available components - component library that uses the react package the react package is open-source. server package will be open-sourced later this year.
1:01

we released our react package build an ai chat w/ interactive components in a few lines of code. add it to your app with: npx tambo full-send we support: - streaming for both messages and components - message history and message threads - state manage for generated components - suggested actions based on available components - component library that uses the react package the react package is open-source. server package will be open-sourced later this year.

Michael Magán

65,473 Aufrufe • vor 1 Jahr

We are now Cult.Repo. The original creators behind the iconic Open Source documentaries (Vue, React, GraphQL) are back together! Honeypot is now called Cult.Repo and is independently-owned. We are on a mission to document the complete history of every major open source language ever created. With 250K subscribers and over 15M views, we're building on our foundation as creators of the acclaimed Open Source Origin Story documentary format. Coming in 2025: Python Software Foundation, Vite ⚡ documentaries and much more. Our independence is core to our mission. We believe the human stories behind open source deserve authentic, in-depth storytelling. Our new model is powered directly by: - Community support from viewers - Sponsorships from organizations that champion open source This transition represents our commitment to independent, meaningful tech storytelling that honours the collaborative spirit of open source itself.
0:42

We are now Cult.Repo. The original creators behind the iconic Open Source documentaries (Vue, React, GraphQL) are back together! Honeypot is now called Cult.Repo and is independently-owned. We are on a mission to document the complete history of every major open source language ever created. With 250K subscribers and over 15M views, we're building on our foundation as creators of the acclaimed Open Source Origin Story documentary format. Coming in 2025: Python Software Foundation, Vite ⚡ documentaries and much more. Our independence is core to our mission. We believe the human stories behind open source deserve authentic, in-depth storytelling. Our new model is powered directly by: - Community support from viewers - Sponsorships from organizations that champion open source This transition represents our commitment to independent, meaningful tech storytelling that honours the collaborative spirit of open source itself.

Cult.Repo

71,217 Aufrufe • vor 1 Jahr

Earlier this week at GTC, we announced our partnership with Nvidia. We will work with Nvidia to build strong, American open-source models that are at the frontier of scientific reasoning. These models will be essential for the US to compete with China on science in the coming decades. Jensen is committing to spend tens of billions of dollars developing open-source models, and we are excited to be a partner with them in figuring out how to benchmark, train and use those agents to accelerate scientific research. We have already open-sourced some of the work we have done with them, and are looking forward to open-sourcing more. There are few things today that are more important. See our blog post below, and watch the video to learn more, narrated by the man himself.
1:44

Earlier this week at GTC, we announced our partnership with Nvidia. We will work with Nvidia to build strong, American open-source models that are at the frontier of scientific reasoning. These models will be essential for the US to compete with China on science in the coming decades. Jensen is committing to spend tens of billions of dollars developing open-source models, and we are excited to be a partner with them in figuring out how to benchmark, train and use those agents to accelerate scientific research. We have already open-sourced some of the work we have done with them, and are looking forward to open-sourcing more. There are few things today that are more important. See our blog post below, and watch the video to learn more, narrated by the man himself.

Sam Rodriques

23,763 Aufrufe • vor 5 Monaten

Today we are excited to open up Neuracore to the academic community! Neuracore is a new data foundation built to accelerate robot learning by removing one of the field’s biggest bottlenecks: capturing and working with high-fidelity multimodal robotics data. For the first time, researchers can store, view, and work with robotics data in a cloud-native system built specifically for large-scale learning, and we are making this core platform completely free for academia. The platform lets teams capture every sensor at its native rate, store and visualize data without loss, and then train and deploy models locally using our open-source code (Link in the comments). We are rolling out access to select academic institutions first. Anyone with an academic email can sign up, and if your institution is not part of the initial rollout, you will be able to join the waitlist directly. Beyond providing this infrastructure, we see an opportunity to build a global community where engineers and researchers can share, collaborate, and advance the frontier of robot learning together. Supported by our recent $3M pre-seed round led by Earlybird VC, we are excited to take this mission even further. Our long-term goal is for Neuracore to become the natural home for cutting-edge robot learning algorithms and real-world robotics experimentation, helping accelerate the next wave of Physical AI.
1:00

Today we are excited to open up Neuracore to the academic community! Neuracore is a new data foundation built to accelerate robot learning by removing one of the field’s biggest bottlenecks: capturing and working with high-fidelity multimodal robotics data. For the first time, researchers can store, view, and work with robotics data in a cloud-native system built specifically for large-scale learning, and we are making this core platform completely free for academia. The platform lets teams capture every sensor at its native rate, store and visualize data without loss, and then train and deploy models locally using our open-source code (Link in the comments). We are rolling out access to select academic institutions first. Anyone with an academic email can sign up, and if your institution is not part of the initial rollout, you will be able to join the waitlist directly. Beyond providing this infrastructure, we see an opportunity to build a global community where engineers and researchers can share, collaborate, and advance the frontier of robot learning together. Supported by our recent $3M pre-seed round led by Earlybird VC, we are excited to take this mission even further. Our long-term goal is for Neuracore to become the natural home for cutting-edge robot learning algorithms and real-world robotics experimentation, helping accelerate the next wave of Physical AI.

Neuracore

40,796 Aufrufe • vor 8 Monaten

Privacy-first research is the core of everything we do at Project Aria. 🛡️✨ We’re thrilled to release EgoBlur Gen 2—our next-gen open-source solution for preserving privacy in egocentric video. Key Features: ✅ Optimized for Gen 2! Tuned for high-res data & next-gen hardware ⚡️ ✅ Native for VRS, MP4, JPEG, and PNG EgoBlur Gen 2 helps you automatically detect and obscure faces and license plates on egocentric cameras from Aria Gen 2 with ease. 🔍 Dive into the models: 👉
0:25

Privacy-first research is the core of everything we do at Project Aria. 🛡️✨ We’re thrilled to release EgoBlur Gen 2—our next-gen open-source solution for preserving privacy in egocentric video. Key Features: ✅ Optimized for Gen 2! Tuned for high-res data & next-gen hardware ⚡️ ✅ Native for VRS, MP4, JPEG, and PNG EgoBlur Gen 2 helps you automatically detect and obscure faces and license plates on egocentric cameras from Aria Gen 2 with ease. 🔍 Dive into the models: 👉

Project Aria @Meta

20,069 Aufrufe • vor 3 Monaten

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 Aufrufe • vor 4 Monaten

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:
0:35

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,025 Aufrufe • vor 6 Monaten

💥 A 450M model just beat bigger VLAs on real robot tasks, and it’s 100% open source [📍 bookmark for later] Came across SmolVLA, a new vision-language-action model for robotics that’s compact, fast, and trained entirely on open community datasets from LeRobot via Hugging Face. What stood out to me is how it matches or outperforms much larger models like ACT using noisy, real-world community data instead of giant private datasets. Why it’s worth a look ✅ 26% performance boost from pretraining on open-source data ✅ Runs on consumer hardware, even a MacBook ✅ 30% faster responses with async inference and smart architecture tweaks ✅ Strong results across Meta-World, LIBERO, SO100, and SO101 ✅ Fully open source: weights, code, training pipeline, eval stack They also introduced smart efficiency tricks like using fewer visual tokens, pulling outputs from mid-layer, and separating perception from action to make it all run fast. SmolVLA is a strong case for what can happen when the robotics community shares data and builds in the open. Definitely worth keeping an eye on.
0:21

💥 A 450M model just beat bigger VLAs on real robot tasks, and it’s 100% open source [📍 bookmark for later] Came across SmolVLA, a new vision-language-action model for robotics that’s compact, fast, and trained entirely on open community datasets from LeRobot via Hugging Face. What stood out to me is how it matches or outperforms much larger models like ACT using noisy, real-world community data instead of giant private datasets. Why it’s worth a look ✅ 26% performance boost from pretraining on open-source data ✅ Runs on consumer hardware, even a MacBook ✅ 30% faster responses with async inference and smart architecture tweaks ✅ Strong results across Meta-World, LIBERO, SO100, and SO101 ✅ Fully open source: weights, code, training pipeline, eval stack They also introduced smart efficiency tricks like using fewer visual tokens, pulling outputs from mid-layer, and separating perception from action to make it all run fast. SmolVLA is a strong case for what can happen when the robotics community shares data and builds in the open. Definitely worth keeping an eye on.

Ilir Aliu - eu/acc

17,353 Aufrufe • vor 11 Monaten

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource
0:31

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

104,664 Aufrufe • vor 2 Monaten

Introducing Open-TeleVision: with Fully Autonomous policy video👇. We can conduct a long-horizon task with inserting 12 cans nonstop without any interruptions. We offer: 🤖 Highly precise and smooth bimanual manipulation. 📺 Active egocentric vision (with a moving neck) feedback. It is achieved by imitation learning from teleoperation: We propose a VR-based REAL-TIME teleoperation that streams the stereo video observation from the robot camera to the VR device. The robot neck moves as the human head moves, the robot hands move as the human hands move, offering the operator an intuitive experience as the human herself becomes the robot. The devils are all in the details, and how to implement things right: ✅How to perform IK/retargeting for smooth and precise control. ✅How to do all these and also stream stereo video without no latency, all in real time. We released our code here: Active head hardware design: 1/n
0:33

Introducing Open-TeleVision: with Fully Autonomous policy video👇. We can conduct a long-horizon task with inserting 12 cans nonstop without any interruptions. We offer: 🤖 Highly precise and smooth bimanual manipulation. 📺 Active egocentric vision (with a moving neck) feedback. It is achieved by imitation learning from teleoperation: We propose a VR-based REAL-TIME teleoperation that streams the stereo video observation from the robot camera to the VR device. The robot neck moves as the human head moves, the robot hands move as the human hands move, offering the operator an intuitive experience as the human herself becomes the robot. The devils are all in the details, and how to implement things right: ✅How to perform IK/retargeting for smooth and precise control. ✅How to do all these and also stream stereo video without no latency, all in real time. We released our code here: Active head hardware design: 1/n

Xiaolong Wang

25,572 Aufrufe • vor 2 Jahren

The Genesis Mission calls for new ways to accelerate scientific discovery. This is our contribution Multimodal search across 25M papers is a step toward science discovery that moves at the speed of curiosity. Releasing, - Visually indexed scientific paper dataset with open access 25M papers, 450M+ visually indexed pages. Total 175TB+. All on Deep Lake - Open-source scientific data agent that achieves 48% SOTA on Humanity's Last Exam with tools including the indexed scientific research dataset. Excited to see what discoveries you all uncover with this. Try it and share your most interesting findings.
0:20

The Genesis Mission calls for new ways to accelerate scientific discovery. This is our contribution Multimodal search across 25M papers is a step toward science discovery that moves at the speed of curiosity. Releasing, - Visually indexed scientific paper dataset with open access 25M papers, 450M+ visually indexed pages. Total 175TB+. All on Deep Lake - Open-source scientific data agent that achieves 48% SOTA on Humanity's Last Exam with tools including the indexed scientific research dataset. Excited to see what discoveries you all uncover with this. Try it and share your most interesting findings.

Davit

238,107 Aufrufe • vor 8 Monaten

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n
1:48

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

Zhi (Leo) Wang

50,541 Aufrufe • vor 1 Monat

.Josh Wolfe: Anybody Using DeepSeek App Is 'Absolute Fool' "Anybody using the DeepSeek app is an absolute fool. If you're using DeepSeek on companies like Together Compute, one of Lux's companies, which can get rid of the CCP censorship, then it's probably okay. But remember, the open-source movement is something we deeply believe in. Most great technologists, entrepreneurs, and venture capitalists are on the side of open source. The closed-source models that have consumed tens of billions of dollars are the ones that are really going to be at risk. When you look at Hugging Face, a major repository, or Together Compute, Runway ML, and a lot of Lux's companies, they have been pioneers in open source. Now, why am I not worried about open source, even with the DeepSeek model? As long as you don't have the CCP censorship on it, the models with their open weights allow people to run on their proprietary data. This means companies like pharma or defense companies that have their own siloed, proprietary data—think about Bloomberg with their proprietary longitudinal data, or Meta with their data—are the ones who will have the edge. Even as open source takes hold, these companies will still dominate. I’m not worried about open source being the problem. I’m more concerned about people overfunding closed models with no proprietary source. A lot of capital is going to be burned there, and we’re already seeing that with people worried about OpenAI in some aspects."
1:27

.Josh Wolfe: Anybody Using DeepSeek App Is 'Absolute Fool' "Anybody using the DeepSeek app is an absolute fool. If you're using DeepSeek on companies like Together Compute, one of Lux's companies, which can get rid of the CCP censorship, then it's probably okay. But remember, the open-source movement is something we deeply believe in. Most great technologists, entrepreneurs, and venture capitalists are on the side of open source. The closed-source models that have consumed tens of billions of dollars are the ones that are really going to be at risk. When you look at Hugging Face, a major repository, or Together Compute, Runway ML, and a lot of Lux's companies, they have been pioneers in open source. Now, why am I not worried about open source, even with the DeepSeek model? As long as you don't have the CCP censorship on it, the models with their open weights allow people to run on their proprietary data. This means companies like pharma or defense companies that have their own siloed, proprietary data—think about Bloomberg with their proprietary longitudinal data, or Meta with their data—are the ones who will have the edge. Even as open source takes hold, these companies will still dominate. I’m not worried about open source being the problem. I’m more concerned about people overfunding closed models with no proprietary source. A lot of capital is going to be burned there, and we’re already seeing that with people worried about OpenAI in some aspects."

Josh Caplan

40,039 Aufrufe • vor 1 Jahr