Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

D2E Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI

_akhaliq's profile picture

AK

510,718 subscribers

25,117 Aufrufe • vor 9 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

LingBot-Video is out on Hugging Face MoE-based video foundation model built for embodied intelligence 30B params, only 3B active at inference Augmented with 70K hours of embodied data on top of large-scale internet video pretraining
1:02

LingBot-Video is out on Hugging Face MoE-based video foundation model built for embodied intelligence 30B params, only 3B active at inference Augmented with 70K hours of embodied data on top of large-scale internet video pretraining

AK

39,945 Aufrufe • vor 4 Tagen

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel
3:44

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel

Galbot

38,131 Aufrufe • vor 2 Monaten

Can instruction tuning be used in robotics?🚨Excited to release LLARVA, our new Vision-Action Instruction-tuned LMM for robotics! Key aspects: • Perform vision-action instruction tuning • Align vision and action modalities • Pretrained on robotic instruction data Berkeley AI Research
1:00

Can instruction tuning be used in robotics?🚨Excited to release LLARVA, our new Vision-Action Instruction-tuned LMM for robotics! Key aspects: • Perform vision-action instruction tuning • Align vision and action modalities • Pretrained on robotic instruction data Berkeley AI Research

Roei Herzig

10,511 Aufrufe • vor 2 Jahren

here's Jeff Dean talking about how labs will do multi-epoch pretraining with heavy regularization to keep scaling even with limited data. no wonder slowrun gets so much attention from pretraining teams at big labs. pretraining is about to look very very different.
0:21

here's Jeff Dean talking about how labs will do multi-epoch pretraining with heavy regularization to keep scaling even with limited data. no wonder slowrun gets so much attention from pretraining teams at big labs. pretraining is about to look very very different.

Samip

127,068 Aufrufe • vor 3 Monaten

Excited to introduce 𝐋𝐀𝐏𝐀: the first unsupervised pretraining method for Vision-Language-Action models. Outperforms SOTA models trained with ground-truth actions 30x more efficient than conventional VLA pretraining 📝: 🧵 1/9
0:58

Excited to introduce 𝐋𝐀𝐏𝐀: the first unsupervised pretraining method for Vision-Language-Action models. Outperforms SOTA models trained with ground-truth actions 30x more efficient than conventional VLA pretraining 📝: 🧵 1/9

Joel Jang

46,018 Aufrufe • vor 1 Jahr

Today we open-source LingBot-Video — the first MoE-based video foundation model built for embodied intelligence. 🔹30B params, only 3B active at inference. 🔹Augmented with 70K hours of embodied data on top of large-scale internet video pretraining. 🔹Already outperforming Wan2.6, Seedance 1.5 Pro, and Cosmos3 Super on RBench. 🧵👇
1:32

Today we open-source LingBot-Video — the first MoE-based video foundation model built for embodied intelligence. 🔹30B params, only 3B active at inference. 🔹Augmented with 70K hours of embodied data on top of large-scale internet video pretraining. 🔹Already outperforming Wan2.6, Seedance 1.5 Pro, and Cosmos3 Super on RBench. 🧵👇

Robbyant

1,161,581 Aufrufe • vor 4 Tagen

Simulation is a key enabler for embodied AI. It allows us to massively scale up data collection in order to experience years in minutes. Nvidia's Isaac Lab allows for rapid learning of new skills in just a few days, which directly transfer to the real world.
0:46

Simulation is a key enabler for embodied AI. It allows us to massively scale up data collection in order to experience years in minutes. Nvidia's Isaac Lab allows for rapid learning of new skills in just a few days, which directly transfer to the real world.

RIVR

25,295 Aufrufe • vor 1 Jahr

Embodied intelligence can’t afford bad data. Perle Labs is building AI data infrastructure designed for this reality: → Human-verified, expert-validated work → On-chain auditability → Sovereign and enterprise-grade design Built to benefit everyone.
0:35

Embodied intelligence can’t afford bad data. Perle Labs is building AI data infrastructure designed for this reality: → Human-verified, expert-validated work → On-chain auditability → Sovereign and enterprise-grade design Built to benefit everyone.

Perle Labs

2,686,990 Aufrufe • vor 5 Monaten

What happens when vision🤝 robotics meet? Happy to share our new work on Pretraining Robotic Foundational Models!🔥 ARM4R is an Autoregressive Robotic Model that leverages low-level 4D Representations learned from human video data to yield a better robotic model. Berkeley AI Research😊
0:49

What happens when vision🤝 robotics meet? Happy to share our new work on Pretraining Robotic Foundational Models!🔥 ARM4R is an Autoregressive Robotic Model that leverages low-level 4D Representations learned from human video data to yield a better robotic model. Berkeley AI Research😊

Roei Herzig

62,711 Aufrufe • vor 1 Jahr

1/ Can AI scaling continue through 2030? We examine whether constraints on power, chip manufacturing, training data, or data center latencies might hinder AI growth. Our analysis suggests that AI scaling can likely continue its current trend through 2030.
1:00

1/ Can AI scaling continue through 2030? We examine whether constraints on power, chip manufacturing, training data, or data center latencies might hinder AI growth. Our analysis suggests that AI scaling can likely continue its current trend through 2030.

Epoch AI

1,507,995 Aufrufe • vor 1 Jahr

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.
2:00

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.

Microsoft Research

11,672 Aufrufe • vor 4 Monaten

Scaling embodied AI starts with automating the environments. Introducing SimWorld Studio: a self-evolving factory for endless interactive 3D environments where agents act, fail, and learn. With coding-agent + embodied-agent co-evolution, navigation success improves from 50% → 90%. 1/
1:36

Scaling embodied AI starts with automating the environments. Introducing SimWorld Studio: a self-evolving factory for endless interactive 3D environments where agents act, fail, and learn. With coding-agent + embodied-agent co-evolution, navigation success improves from 50% → 90%. 1/

Lianhui Qin@ACL2026

58,744 Aufrufe • vor 1 Monat

Introducing GEN-0, our latest 10B+ foundation model for robots ⏱️ built on Harmonic Reasoning, new architecture that can think & act seamlessly 📈 strong scaling laws: more pretraining & model size = better 🌍 unprecedented corpus of 270,000+ hrs of dexterous data Read more 👇
0:48

Introducing GEN-0, our latest 10B+ foundation model for robots ⏱️ built on Harmonic Reasoning, new architecture that can think & act seamlessly 📈 strong scaling laws: more pretraining & model size = better 🌍 unprecedented corpus of 270,000+ hrs of dexterous data Read more 👇

Generalist

483,864 Aufrufe • vor 8 Monaten

What if you could induce models to be more concise via pretraining data curation?
1:20

What if you could induce models to be more concise via pretraining data curation?

Matthew Leavitt

7,135,743 Aufrufe • vor 17 Tagen

Data ➡️ AI ➡️ Smarter, faster business decisions Watch the AI action on Salesforce+: #SalesforceAI
0:34

Data ➡️ AI ➡️ Smarter, faster business decisions Watch the AI action on Salesforce+: #SalesforceAI

Salesforce

77,286 Aufrufe • vor 2 Jahren

💡Why Vana? “Ultimately, AI models are only as good as their training data. So if you want to build the best AI, you need the best data.” shares the vision behind Vana’s mission, centered on DataDAOs that aggregate specific datasets, reward data owners for their contributions and level up AI models with high-quality data🏆
0:56

💡Why Vana? “Ultimately, AI models are only as good as their training data. So if you want to build the best AI, you need the best data.” shares the vision behind Vana’s mission, centered on DataDAOs that aggregate specific datasets, reward data owners for their contributions and level up AI models with high-quality data🏆

vana

108,354 Aufrufe • vor 1 Jahr

Introducing WALL-WM, our open-source World Model for embodied AI and the next piece of our open-source robotics stack. Carving World Action Modeling at the Event Joints Read the blog: Why it matters WALL-WM shifts robot world modeling from fixed-length action chunks to event-grounded video-action pretraining. It learns around events like reaching, contact, grasping, lifting, moving, and placing, so language, vision, and action align more naturally. Why you should care WALL-WM brings together: •Event-grounded VLA pretraining •Prior-aligned video-action architecture •Wan-based video tower + randomly initialized action DiT •Multi-view perception with sight-cone masking, tube patch masking, and Camera RoPE •Event Mode for variable-length execution •Unified Mode with Staircase Decoding •DMuon for large-scale training The goal: help robots learn what physically matters, not just what happens in the next fixed slice of time. Code (coming soon): #opensource #EmbodiedAI
1:45

Introducing WALL-WM, our open-source World Model for embodied AI and the next piece of our open-source robotics stack. Carving World Action Modeling at the Event Joints Read the blog: Why it matters WALL-WM shifts robot world modeling from fixed-length action chunks to event-grounded video-action pretraining. It learns around events like reaching, contact, grasping, lifting, moving, and placing, so language, vision, and action align more naturally. Why you should care WALL-WM brings together: •Event-grounded VLA pretraining •Prior-aligned video-action architecture •Wan-based video tower + randomly initialized action DiT •Multi-view perception with sight-cone masking, tube patch masking, and Camera RoPE •Event Mode for variable-length execution •Unified Mode with Staircase Decoding •DMuon for large-scale training The goal: help robots learn what physically matters, not just what happens in the next fixed slice of time. Code (coming soon): #opensource #EmbodiedAI

X Square Robot

41,569 Aufrufe • vor 1 Monat

Introducing the QUANXTA Zero Series, X Square Robot’s next-generation UMI data collection solution for embodied AI. The series includes three products: QUANXTA Zero-G0: VR headset + backpack + dual grippers QUANXTA Zero-G1: headband rig + dual grippers QUANXTA Zero-E0: headband rig Built for scalable embodied AI data production: Multimodal capture. Whole-body mobile manipulation. Real-robot replay. 1 ms synchronization. 100% frame-level alignment. From human demonstrations to trainable robot data. Learn more:
2:29

Introducing the QUANXTA Zero Series, X Square Robot’s next-generation UMI data collection solution for embodied AI. The series includes three products: QUANXTA Zero-G0: VR headset + backpack + dual grippers QUANXTA Zero-G1: headband rig + dual grippers QUANXTA Zero-E0: headband rig Built for scalable embodied AI data production: Multimodal capture. Whole-body mobile manipulation. Real-robot replay. 1 ms synchronization. 100% frame-level alignment. From human demonstrations to trainable robot data. Learn more:

X Square Robot

353,924 Aufrufe • vor 6 Tagen

Real results from real teams. 🛠️💡 AWS Data & AI Bytes brings you demos & insights from customers building generative AI apps, scaling data platforms & modernizing with AWS services. Learn more about AWS for Data. 👉
0:38

Real results from real teams. 🛠️💡 AWS Data & AI Bytes brings you demos & insights from customers building generative AI apps, scaling data platforms & modernizing with AWS services. Learn more about AWS for Data. 👉

Amazon Web Services

12,128 Aufrufe • vor 9 Monaten

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:
3:36

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:

The Humanoid Hub

196,055 Aufrufe • vor 1 Jahr