Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Demo2: Multimodal Interactive Hybrid Agent

Alibaba_Qwen's profile picture

Qwen

243,003 subscribers

32,632 Aufrufe • vor 2 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition
1:02

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

AK

91,212 Aufrufe • vor 1 Jahr

Seeing, Listening, Remembering, and Reasoning A Multimodal Agent with Long-Term Memory
3:57

Seeing, Listening, Remembering, and Reasoning A Multimodal Agent with Long-Term Memory

AK

19,923 Aufrufe • vor 1 Jahr

demo2 is LIVE
0:23

demo2 is LIVE

Léonard Lemaitre

534,648 Aufrufe • vor 2 Monaten

👀 Seeing is just the beginning. With Qwen-MM-Plugins, turn your favorite agent harness multimodal-native — read images, videos & documents, edit videos, work with 3D/CAD, and more. From multimodal models → multimodal agents. 🚀 Watch it in action:
4:07

👀 Seeing is just the beginning. With Qwen-MM-Plugins, turn your favorite agent harness multimodal-native — read images, videos & documents, edit videos, work with 3D/CAD, and more. From multimodal models → multimodal agents. 🚀 Watch it in action:

Qwen

754,079 Aufrufe • vor 2 Tagen

can AI write engaging news that people can trust? introducing ✨Data2Story: a data journalist agent. give it raw data, it generate a verifiable, multimodal article. 🔍verifiable: every claim is evidence-grounded, traces back to data, code, or a cited source. 🔮multimodal: the article is a generative UI — images, videos, audio, interactive charts. not just readable, but trustworthy and playable. 🧵1/N
0:48

can AI write engaging news that people can trust? introducing ✨Data2Story: a data journalist agent. give it raw data, it generate a verifiable, multimodal article. 🔍verifiable: every claim is evidence-grounded, traces back to data, code, or a cited source. 🔮multimodal: the article is a generative UI — images, videos, audio, interactive charts. not just readable, but trustworthy and playable. 🧵1/N

Kevin Lin

32,968 Aufrufe • vor 1 Monat

Demo2：Audio-Visual Vibe Coding
2:47

Demo2：Audio-Visual Vibe Coding

Qwen

211,115 Aufrufe • vor 4 Monaten

Stagehand Agent just got way more powerful. We just added: • Agent Hybrid mode (DOM + vision) • Streaming output • Automatic web search (with Brave) Try the new agent with experimental flag.
0:24

Stagehand Agent just got way more powerful. We just added: • Agent Hybrid mode (DOM + vision) • Streaming output • Automatic web search (with Brave) Try the new agent with experimental flag.

Stagehand

16,726 Aufrufe • vor 7 Monaten

Our AI design agent is absolutely on fire 🤯 What if you get an UX agent can design, wireframe, remix? Gemini's true multimodal ability unleashed Try it on
0:59

Our AI design agent is absolutely on fire 🤯 What if you get an UX agent can design, wireframe, remix? Gemini's true multimodal ability unleashed Try it on

Jason Zhou

81,275 Aufrufe • vor 8 Monaten

Avatar Forcing: Real-time interactive head avatars for natural conversation, and it's not WAN. - handles both speaking & active listening + multimodal responsiveness; - 7x faster than baselines.
0:30

Avatar Forcing: Real-time interactive head avatars for natural conversation, and it's not WAN. - handles both speaking & active listening + multimodal responsiveness; - 7x faster than baselines.

Wildminder

58,506 Aufrufe • vor 7 Monaten

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.
0:20

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.

Shubham Saboo

36,596 Aufrufe • vor 1 Jahr

tldraw canvas ➡️ interactive theme UI Demonstrating visual context understanding in Antigravity, the agent read the canvas mockups and built interactive code fast with 3.6 Flash⚡
0:44

tldraw canvas ➡️ interactive theme UI Demonstrating visual context understanding in Antigravity, the agent read the canvas mockups and built interactive code fast with 3.6 Flash⚡

Google Antigravity

56,379 Aufrufe • vor 14 Tagen

Gemini 3 Flash can analyze high-fidelity images and use multimodal reasoning to determine next steps. See how the model understands complex visuals and generates layers of interactive elements.
0:28

Gemini 3 Flash can analyze high-fidelity images and use multimodal reasoning to determine next steps. See how the model understands complex visuals and generates layers of interactive elements.

Google AI Developers

47,280 Aufrufe • vor 7 Monaten

grep is multimodal now. performs better then apple photos and gives you and your agent perfect search. just run npm install -g @mixedbread/mgrep
0:35

grep is multimodal now. performs better then apple photos and gives you and your agent perfect search. just run npm install -g @mixedbread/mgrep

Aamir

49,631 Aufrufe • vor 8 Monaten

I built a multimodal AI Coding Agent team with multi-agents. It has 3 AI agents working together as a team to generate and execute the code: 1. Coding Agent using o-3 mini 2. Vision Agent using Gemini 3. Code Execution Agent using o-3 mini and E2B 100% Opensource Code.
1:36

I built a multimodal AI Coding Agent team with multi-agents. It has 3 AI agents working together as a team to generate and execute the code: 1. Coding Agent using o-3 mini 2. Vision Agent using Gemini 3. Code Execution Agent using o-3 mini and E2B 100% Opensource Code.

Shubham Saboo

42,277 Aufrufe • vor 1 Jahr

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.
2:21

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 Aufrufe • vor 2 Jahren

Excited to release: AgentUI > a fresh chat interface - natively multi-agent > agents coordinate via reports and figures > plug+play any open/closed model as sub-agent > agents specialise in code, web search, multimodal... Try it here:
2:01

Excited to release: AgentUI > a fresh chat interface - natively multi-agent > agents coordinate via reports and figures > plug+play any open/closed model as sub-agent > agents specialise in code, web search, multimodal... Try it here:

Leandro von Werra

41,087 Aufrufe • vor 4 Monaten

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,201 Aufrufe • vor 1 Jahr

I updated my interactive subagents to free up the main agent to be interactive as well (basically /btw but just a normal continuation) and the subagent asynchronously returns its result to the starting session
0:51

I updated my interactive subagents to free up the main agent to be interactive as well (basically /btw but just a normal continuation) and the subagent asynchronously returns its result to the starting session

Daniel Griesser

29,053 Aufrufe • vor 4 Monaten

II-Agent turns any prompt into an interactive classroom. The future of education is already here. Watch it in action.
0:53

II-Agent turns any prompt into an interactive classroom. The future of education is already here. Watch it in action.

Intelligent Internet

91,082 Aufrufe • vor 1 Jahr