Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

StreamVLN Streaming Vision-and-Language Navigation via SlowFast Context Modeling

_akhaliq's profile picture

AK

502,568 subscribers

26,650 Aufrufe • vor 11 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!
0:29

As part of the ongoing Vision-Language-Autonomy project, CMU researchers have developed a general navigation platform with an onboard autonomy stack to support Vision-Language-Navigation. It functions in simulation and on real robots 🤖💥 Check it out!

CMU Robotics Institute

23,706 Aufrufe • vor 1 Jahr

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:
0:45

CMU Vision-Language-Autonomy update: The team just released SORT3D, the first general spatial relation toolbox for autonomous vision-language navigation that is fully integrated into real-robot systems! 🤖👀 Simulation and real-robot data is provided!:

CMU Robotics Institute

18,234 Aufrufe • vor 1 Jahr

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]
0:25

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Max Fu

40,392 Aufrufe • vor 1 Jahr

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.
1:28

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Intel

15,931 Aufrufe • vor 3 Monaten

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.
2:52

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.

Robots Digest 🤖

14,519 Aufrufe • vor 13 Tagen

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥
0:28

Google announces MCP for Android. AppFunctions lets Android apps expose capabilities directly to AI agents. Agents can discover and execute them via natural language. No app navigation needed ❤️‍🔥

Jorge Castillo

284,052 Aufrufe • vor 3 Monaten

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.
0:45

Robots forget because vision is expensive. AstraNav-Memory shows you can compress vision 20x and still remember hundreds of past frames, unlocking true lifelong navigation.

Robots Digest 🤖

26,667 Aufrufe • vor 5 Monaten

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:
0:23

We just brought flow maps to language modeling for one-step sequence generation 💥 Discrete diffusion is not necessary -- continuous flows over one-hot encodings achieve SoTA performance and ≥8.3× faster generation 🔥 We believe this is a major step forward for discrete generative modeling and language modeling alike. 🚀 Full thread from first author Chanhyuk Lee:

Nicholas Boffi

43,721 Aufrufe • vor 3 Monaten

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:
0:42

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

Danny Driess

1,272,447 Aufrufe • vor 3 Jahren

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate *moving* objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.
0:23

DynamicVLA A compact 0.4B Vision-Language-Action model that finally lets robots manipulate *moving* objects in real-time, closing the perception-execution gap with Continuous Inference and Latent-aware Action Streaming.

DailyPapers

16,291 Aufrufe • vor 4 Monaten

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.
0:52

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

AK

254,242 Aufrufe • vor 1 Jahr

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →
0:30

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

NVIDIA AI

14,273 Aufrufe • vor 4 Monaten

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗
0:40

Introducing → CodecFlow @CodecOpenFlow offers agent first infra powered by vision language models, making robotics and desktop operators simple Agents spin up compute, run models, and build autonomously with payments via x402 on @Solana 🔗

Superteam UAE

33,841 Aufrufe • vor 2 Monaten

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page
1:22

demo of a The Browser Company AI feature for Arc manipulate websites (via code) using natural language longer video with context on Browser Co YouTube page

Josh Miller

223,440 Aufrufe • vor 3 Jahren

LeVERB is a VLA framework for humanoid whole-body control, combining a vision-language model and a low-level controller via a shared latent action space, trained entirely in sim, deployed zero shot.
0:32

LeVERB is a VLA framework for humanoid whole-body control, combining a vision-language model and a low-level controller via a shared latent action space, trained entirely in sim, deployed zero shot.

The Humanoid Hub

10,233 Aufrufe • vor 11 Monaten

Geometric Context Transformer for Streaming 3D Reconstruction Contributions: • We introduce LingBot-Map, a streaming 3D foundation model built around Geometric Context Attention (GCA), which maintains three complementary context types – anchor, pose-reference window, and trajectory memory – for efficient and consistent long-sequence streaming inference. • We propose an efficient training recipe based on progressive training and context parallelism with a relative loss formulation for stable long-sequence optimization. • We demonstrate that LingBot-Map achieves state-of-the-art performance on multiple benchmarks (Oxford Spires, Tanks and Temples, ETH3D, and 7-Scenes), significantly outperforming existing streaming approaches in reconstruction quality and inference speed.
1:10

Geometric Context Transformer for Streaming 3D Reconstruction Contributions: • We introduce LingBot-Map, a streaming 3D foundation model built around Geometric Context Attention (GCA), which maintains three complementary context types – anchor, pose-reference window, and trajectory memory – for efficient and consistent long-sequence streaming inference. • We propose an efficient training recipe based on progressive training and context parallelism with a relative loss formulation for stable long-sequence optimization. • We demonstrate that LingBot-Map achieves state-of-the-art performance on multiple benchmarks (Oxford Spires, Tanks and Temples, ETH3D, and 7-Scenes), significantly outperforming existing streaming approaches in reconstruction quality and inference speed.

MrNeRF

24,549 Aufrufe • vor 1 Monat

My love language is streaming Premier League and #SNL50 on the same weekend.
0:30

My love language is streaming Premier League and #SNL50 on the same weekend.

Peacock

12,043 Aufrufe • vor 1 Jahr

More context via John Dorsey
1:51

More context via John Dorsey

FACELESS

492,084 Aufrufe • vor 3 Monaten

Tired of guests messing with your Tesla Driver Profile setup? Protect your streaming logins, navigation history, and drive settings with this hack:
1:30

Tired of guests messing with your Tesla Driver Profile setup? Protect your streaming logins, navigation history, and drive settings with this hack:

Dispatch

11,680 Aufrufe • vor 9 Monaten