Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

StreamVLN Streaming Vision-and-Language Navigation via SlowFast Context Modeling

AK

537,822 subscribers

26,697 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

2 Comments

AK1 year ago

discuss with author:

Chain Alpha1 year ago

Alpha tech, low cap potential

Related Videos

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!

CMU Robotics Institute

24,623 views • 1 year ago

🚨Excited to share: “𝗣𝗮𝗻𝗼𝗚𝗲𝗻: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation”!🚨 PanoGen creates diverse 360-degree panorama via recursive outpainting, achieving SotA on R2R, R4R, CVDN. Mohit Bansal @uncnlp 🧵

🚨Excited to share: “𝗣𝗮𝗻𝗼𝗚𝗲𝗻: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation”!🚨 PanoGen creates diverse 360-degree panorama via recursive outpainting, achieving SotA on R2R, R4R, CVDN. Mohit Bansal @uncnlp 🧵

Jialu Li

31,991 views • 3 years ago

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:

CMU Robotics Institute

18,611 views • 1 year ago

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Max Fu

40,466 views • 2 years ago

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Intel

15,931 views • 8 months ago

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.

Robots Digest 🤖

14,722 views • 5 months ago

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥

Jorge Castillo

285,740 views • 7 months ago

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.

Robots Digest 🤖

26,667 views • 10 months ago

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:

Nicholas Boffi

44,715 views • 8 months ago

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

Danny Driess

1,272,956 views • 3 years ago

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate *moving* objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate moving objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.

DailyPapers

16,396 views • 9 months ago

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

AK

254,490 views • 1 year ago

Honda made an in-shoe navigation system for people with low vision

Honda made an in-shoe navigation system for people with low vision

Mashable

24,848 views • 2 years ago

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

NVIDIA AI

14,273 views • 9 months ago

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Superteam UAE

33,841 views • 6 months ago

🔜🌟 A better, faster, easier to use and a more powerful date picker coming soon. Natural language support, keyboard navigation and more!

🔜🌟 A better, faster, easier to use and a more powerful date picker coming soon. Natural language support, keyboard navigation and more!

Beehive

53,964 views • 7 months ago

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page

Josh Miller

224,168 views • 3 years ago

Software can now understand human language and act on it, in real time. Introducing Sage2 - Extract: natural language in, structured data out. 166x cheaper than Opus 5.5, beats Cloudflare's Clairic - Decide: the first decision model with streaming. 3x faster, because it reads the context as it grows. Sage2 is a new primitive for developers. Get 20M tokens free 👇 Also available on NEAR AI and, for agents, via Machine Payments Protocol with Stripe cards and Tempo stables.

Software can now understand human language and act on it, in real time. Introducing Sage2 - Extract: natural language in, structured data out. 166x cheaper than Opus 5.5, beats Cloudflare's Clairic - Decide: the first decision model with streaming. 3x faster, because it reads the context as it grows. Sage2 is a new primitive for developers. Get 20M tokens free 👇 Also available on NEAR AI and, for agents, via Machine Payments Protocol with Stripe cards and Tempo stables.

Levanto Labs

31,681 views • 3 hours ago