Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We are excited to announce CLIN 🤖: The first continually learning language agent that excels in both task adaptation and generalization to unseen tasks and environments in a pure zero-shot setup. Aristo Team at Ai2 Ai2 Website: Let's dive in 🧵 (1/n)

Bodhisattwa Majumder

2,595 subscribers

35,052 views • 2 years ago •via X (Twitter)

Science & Technology News & Politics Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Is it possible to build end-to-end autonomous discovery systems using Large Generative Models (LGMs)? 🧬 In this position paper, we argue: 🧵 (1/n) Ai2 Aristo Team at Ai2 Harshit Surana UMass Amherst University of Utah

Is it possible to build end-to-end autonomous discovery systems using Large Generative Models (LGMs)? 🧬 In this position paper, we argue: 🧵 (1/n) Ai2 Aristo Team at Ai2 Harshit Surana UMass Amherst University of Utah

Bodhisattwa Majumder

30,764 views • 2 years ago

Can LLMs help accelerate the discovery of data-driven scientific hypotheses? 🧬📊 We benchmark this in DiscoveryBench: 264 discovery tasks from 6 scientific domains, from humanities to biology: Ai2 Aristo Team at Ai2 Harshit Surana UMass Amherst

Can LLMs help accelerate the discovery of data-driven scientific hypotheses? 🧬📊 We benchmark this in DiscoveryBench: 264 discovery tasks from 6 scientific domains, from humanities to biology: Ai2 Aristo Team at Ai2 Harshit Surana UMass Amherst

Bodhisattwa Majumder

23,902 views • 1 year ago

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵

Google DeepMind

1,061,548 views • 2 years ago

For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦

For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦

Ai2

178,088 views • 1 year ago

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

Tony Zhao

2,044,045 views • 7 months ago

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Kun Lei

80,824 views • 8 months ago

Current robot learning methods are good at imitating tasks seen during training, but struggle to compose behaviors in new ways. When training imitation policies, we found something surprising—using temporally-aligned task representations enabled compositional generalization. 1/

Current robot learning methods are good at imitating tasks seen during training, but struggle to compose behaviors in new ways. When training imitation policies, we found something surprising—using temporally-aligned task representations enabled compositional generalization. 1/

Vivek Myers

39,442 views • 1 year ago

Excited to share our work on STEERing robot behavior! With structured language annotation of offline data, STEER exposes fundamental manipulation skills that can be modulated and combined to enable zero-shot adaptation to new situations and tasks.

Excited to share our work on STEERing robot behavior! With structured language annotation of offline data, STEER exposes fundamental manipulation skills that can be modulated and combined to enable zero-shot adaptation to new situations and tasks.

Laura Smith

25,259 views • 1 year ago

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇

Lerrel Pinto

42,555 views • 1 year ago

This is a single uncut video, showing a robot learning several tasks instantly, after just one demonstration each ... This is possible because we've now been able to achieve in-context learning for everyday robotics tasks, and I'm very excited to announce our latest paper: 🎆 Instant Policy: In-Context Imitation Learning via Graph Diffusion 🎆 (1/6) 🧵👇

This is a single uncut video, showing a robot learning several tasks instantly, after just one demonstration each ... This is possible because we've now been able to achieve in-context learning for everyday robotics tasks, and I'm very excited to announce our latest paper: 🎆 Instant Policy: In-Context Imitation Learning via Graph Diffusion 🎆 (1/6) 🧵👇

Edward Johns

74,663 views • 1 year ago

We are excited to announce that SatRepublic has raised $2.75M in funding as we prepare for the launch of SatGo - Bitcoin & Spark Wallet. SatRepublic aspires to be the global lead in mobile-first tooling and experiences for the Bitcoin 2.0 ecosystem. a thread 🧵

We are excited to announce that SatRepublic has raised $2.75M in funding as we prepare for the launch of SatGo - Bitcoin & Spark Wallet. SatRepublic aspires to be the global lead in mobile-first tooling and experiences for the Bitcoin 2.0 ecosystem. a thread 🧵

SatRepublic

28,491 views • 1 year ago

Excited to announce the newest Webflow app we've been building 🔥 Miyagi: An AI app for Webflow made up of 3 powerful agents: • Design Agent: Automate tasks in the Webflow Designer • Code Agent: Vibe code in Webflow • CMS Agent: Bulk edit and create content in the CMS Take a look at some more info & examples below 👇🧵

Excited to announce the newest Webflow app we've been building 🔥 Miyagi: An AI app for Webflow made up of 3 powerful agents: • Design Agent: Automate tasks in the Webflow Designer • Code Agent: Vibe code in Webflow • CMS Agent: Bulk edit and create content in the CMS Take a look at some more info & examples below 👇🧵

Bradford Huber

12,388 views • 11 months ago

Excited to announce AlphaEvolve A powerful AI coding agent developed by our team in Google DeepMind that is able to discover impactful new algorithms for important problems in Maths and Computing by combining the creativity of large language models with automated evaluators.

Excited to announce AlphaEvolve A powerful AI coding agent developed by our team in Google DeepMind that is able to discover impactful new algorithms for important problems in Maths and Computing by combining the creativity of large language models with automated evaluators.

Pushmeet Kohli

203,443 views • 1 year ago

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Jason Ma

98,090 views • 1 year ago

There seems to be some confusion around what “open source” AI means 🧐 At Ai2 it could not be clearer. We are not just open, we are More Than Open. Learn more: 🧵

There seems to be some confusion around what “open source” AI means 🧐 At Ai2 it could not be clearer. We are not just open, we are More Than Open. Learn more: 🧵

Ai2

123,701 views • 1 year ago

How to harness foundation models for *generalization in the wild* in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇

How to harness foundation models for generalization in the wild in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇

Wenlong Huang

293,876 views • 3 years ago

🛠 DIMENSIONALS DECONSTRUCT #1 🛠 We're building in public and our first sneak peak had a lot to unpack! DIMENSIONALS ARMY, let's dive in to understand to understand how we designed the game to grow to a $100bn franchise. A thread 👇🧵

🛠 DIMENSIONALS DECONSTRUCT #1 🛠 We're building in public and our first sneak peak had a lot to unpack! DIMENSIONALS ARMY, let's dive in to understand to understand how we designed the game to grow to a $100bn franchise. A thread 👇🧵

Sasha MacKinnon

35,840 views • 3 years ago

Hello everyone! This is a message from the SEAT team. We are excited to announce our newly restructured team! You can find the updated team members on our website and in the whitepaper. These characters are the upcoming SEAT NFTs! We plan to announce NFT-related business the future. Stay tuned! #SEAT #NFT #SeamansProject #TeamUpdate

Hello everyone! This is a message from the SEAT team. We are excited to announce our newly restructured team! You can find the updated team members on our website and in the whitepaper. These characters are the upcoming SEAT NFTs! We plan to announce NFT-related business the future. Stay tuned! #SEAT #NFT #SeamansProject #TeamUpdate

SEAMANS TEC

24,659 views • 1 year ago

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵

Google DeepMind

819,203 views • 1 year ago

INCREDIBLY excited to announce that soon you’ll be able to learn both math and music right in the Duolingo learning app! Register to Duocon to learn more on October 11:

INCREDIBLY excited to announce that soon you’ll be able to learn both math and music right in the Duolingo learning app! Register to Duocon to learn more on October 11:

Luis von Ahn

227,735 views • 2 years ago