Loading video...

Video Failed to Load

Go Home

StreamVLN Streaming Vision-and-Language Navigation via SlowFast Context Modeling

_akhaliq's profile picture

AK

524,983 subscribers

26,676 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

2 Comments

AK's profile picture
AK1 year ago

discuss with author:

Chain Alpha's profile picture
Chain Alpha1 year ago

Alpha tech, low cap potential

Related Videos

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!
0:29

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!

CMU Robotics Institute

24,623 views • 1 year ago

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:
0:45

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:

CMU Robotics Institute

18,592 views • 1 year ago

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]
0:25

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Max Fu

40,466 views • 2 years ago

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.
1:28

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Intel

15,931 views • 7 months ago

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.
2:52

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.

Robots Digest 🤖

14,722 views • 3 months ago

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥
0:28

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥

Jorge Castillo

285,740 views • 6 months ago

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.
0:45

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.

Robots Digest 🤖

26,667 views • 8 months ago

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:
0:23

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:

Nicholas Boffi

44,467 views • 6 months ago

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:
0:42

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

Danny Driess

1,272,806 views • 3 years ago

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate *moving* objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.
0:23

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate *moving* objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.

DailyPapers

16,357 views • 7 months ago

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.
0:52

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

AK

254,453 views • 1 year ago

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →
0:30

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

NVIDIA AI

14,273 views • 8 months ago

🔜🌟 A better, faster, easier to use and a more powerful date picker coming soon. Natural language support, keyboard navigation and more!
0:49

🔜🌟 A better, faster, easier to use and a more powerful date picker coming soon. Natural language support, keyboard navigation and more!

Beehive

53,937 views • 5 months ago

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗
0:40

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Superteam UAE

33,841 views • 5 months ago

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page
1:22

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page

Josh Miller

224,036 views • 3 years ago

Agentic Real2Sim is an interesting take on world modeling. Instead of learning physics directly from videos, it lets a Vision-Language Agent reconstruct a physics simulator from a single real-world video. The result is an editable, executable world model that can be queried, simulated, and improved.
4:14

Agentic Real2Sim is an interesting take on world modeling. Instead of learning physics directly from videos, it lets a Vision-Language Agent reconstruct a physics simulator from a single real-world video. The result is an editable, executable world model that can be queried, simulated, and improved.

Robots Digest 🤖

12,075 views • 1 month ago

Tired of guests messing with your Tesla Driver Profile setup? Protect your streaming logins, navigation history, and drive settings with this hack:
1:30

Tired of guests messing with your Tesla Driver Profile setup? Protect your streaming logins, navigation history, and drive settings with this hack:

Dispatch

11,683 views • 1 year ago