Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Machine Mental Imagery Empower Multimodal Reasoning with Latent Visual Tokens

_akhaliq's profile picture

AK

524,670 subscribers

43,538 görüntüleme • 1 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

4 Yorum

AK profil fotoğrafı
AK1 yıl önce

discuss with author:

Tablo | AI Meeting Notes profil fotoğrafı
Tablo | AI Meeting Notes1 yıl önce

Multimodal reasoning's next frontier? Love seeing this exploration.

Gaëtan profil fotoğrafı
Gaëtan1 yıl önce

cool

Himanshu Kumar profil fotoğrafı
Himanshu Kumar1 yıl önce

Intriguing, could this unlock creativity we didn't know machines had?

Benzer Videolar

Empower powerful research and content creation with our new multimodal Gemini 2.5 researcher, built together with .
14:03

Empower powerful research and content creation with our new multimodal Gemini 2.5 researcher, built together with .

Google AI Developers

63,614 görüntüleme • 1 yıl önce

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.
0:20

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.

Shubham Saboo

36,596 görüntüleme • 1 yıl önce

What if robots could think longer on harder problems without saying a single word?🤔 We introduce RD-VLA (Recurrent-Depth VLA): a latent, iterative reasoning architecture for robot control. ❌No Chain-of-Thought tokens. ❌No extra memory overhead. ✅Just reasoning—directly in latent space. 🧠🤖 Project page: 👇🧵
1:22

What if robots could think longer on harder problems without saying a single word?🤔 We introduce RD-VLA (Recurrent-Depth VLA): a latent, iterative reasoning architecture for robot control. ❌No Chain-of-Thought tokens. ❌No extra memory overhead. ✅Just reasoning—directly in latent space. 🧠🤖 Project page: 👇🧵

Jiafei Duan

13,949 görüntüleme • 7 ay önce

co-seeing art with machine: an interactive demo where i browse the visual responses of a multimodal llm to prompts about the painting, from “who’s in here?” and to “what’s unusual about this painting?” the model replies not just with words, but with visual annotations as well.
0:24

co-seeing art with machine: an interactive demo where i browse the visual responses of a multimodal llm to prompts about the painting, from “who’s in here?” and to “what’s unusual about this painting?” the model replies not just with words, but with visual annotations as well.

Kat ⊷ the Poet Engineer

37,359 görüntüleme • 1 yıl önce

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable
1:26

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable

Chubby♨️

89,236 görüntüleme • 9 ay önce

Vision-language models (VLMs) can see well, but they struggle to reason. In this episode, Antonia Wüst (PhD researcher, TU Darmstadt) explains how combining VLMs with program synthesis yields more reliable visual reasoning, with fewer tokens than chain-of-thought.
0:46

Vision-language models (VLMs) can see well, but they struggle to reason. In this episode, Antonia Wüst (PhD researcher, TU Darmstadt) explains how combining VLMs with program synthesis yields more reliable visual reasoning, with fewer tokens than chain-of-thought.

Ndea

22,130 görüntüleme • 8 ay önce

The GeoAI Python package now supports interactive segmentation of remote sensing imagery with the Moondream AI Vision Language Models (VLMs), which provides powerful and efficient visual reasoning. A great alternative to Meta's SAM 3. GitHub: Notebook example: #GeoAI #geospatial #AI #opensource
0:59

The GeoAI Python package now supports interactive segmentation of remote sensing imagery with the Moondream AI Vision Language Models (VLMs), which provides powerful and efficient visual reasoning. A great alternative to Meta's SAM 3. GitHub: Notebook example: #GeoAI #geospatial #AI #opensource

Qiusheng Wu

11,655 görüntüleme • 9 ay önce

Gemini 3.7 Flash: "Play 1 round of Wordle" using my Android emulator via ADB. The latency and visual reasoning make Gemini 3.7 Flash exceptionally good for multimodal agentic use case like mobile control and Computer Use.
1:23

Gemini 3.7 Flash: "Play 1 round of Wordle" using my Android emulator via ADB. The latency and visual reasoning make Gemini 3.7 Flash exceptionally good for multimodal agentic use case like mobile control and Computer Use.

Philipp Schmid

18,290 görüntüleme • 1 ay önce

new Ox Alpha is kind of absurd One prompt, 64,745 output tokens, and no external assets: Ox Alpha generated the code for an entire Three.js dreamcore 3D scene/world in a single shot. AI/ML API ran this demo and they are also giving Ox Alpha free on aimlapi[.]com - 1M context window - Max output: ~131k tokens - Multimodal: text + image + video input → text output - Explicitly positioned as a reasoning model for coding, long-horizon/agentic software engineering, sustained production workloads, and tasks that mix text with visual context
0:22

new Ox Alpha is kind of absurd One prompt, 64,745 output tokens, and no external assets: Ox Alpha generated the code for an entire Three.js dreamcore 3D scene/world in a single shot. AI/ML API ran this demo and they are also giving Ox Alpha free on aimlapi[.]com - 1M context window - Max output: ~131k tokens - Multimodal: text + image + video input → text output - Explicitly positioned as a reasoning model for coding, long-horizon/agentic software engineering, sustained production workloads, and tasks that mix text with visual context

Rohan Paul

13,576 görüntüleme • 1 ay önce

Gemma 4 is live on Cerebras, the fastest multimodal inference ever! Running on Gemma 4 31B open-weight model at a blistering 1,500+ tokens/sec. That's a 15x speedup, unlocking real-time visual and agentic loops without the GPU lag.
1:33

Gemma 4 is live on Cerebras, the fastest multimodal inference ever! Running on Gemma 4 31B open-weight model at a blistering 1,500+ tokens/sec. That's a 15x speedup, unlocking real-time visual and agentic loops without the GPU lag.

Google Gemma

114,048 görüntüleme • 2 ay önce

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction
2:10

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction

BAAI

51,880 görüntüleme • 11 ay önce

Muse Spark 1.2 supports a broad range of multimodal tasks, from turning visuals into working code to translating perception into physical action. It also brings robust audio-visual understanding to enable video-heavy workflows common in real-world enterprise use. Today, we’re sharing new evals and demos that illustrate the breadth of the model’s visual understanding and reasoning capabilities. Let’s start with a demo that shows how Muse Spark parses multimodal observations and calls tools to guide a robot to navigate in an unstructured environment to find a rubber duck. 🧵👇
0:43

Muse Spark 1.2 supports a broad range of multimodal tasks, from turning visuals into working code to translating perception into physical action. It also brings robust audio-visual understanding to enable video-heavy workflows common in real-world enterprise use. Today, we’re sharing new evals and demos that illustrate the breadth of the model’s visual understanding and reasoning capabilities. Let’s start with a demo that shows how Muse Spark parses multimodal observations and calls tools to guide a robot to navigate in an unstructured environment to find a rubber duck. 🧵👇

AI at Meta

57,742 görüntüleme • 1 ay önce

Start building with Gemini 3 Pro, our most intelligent model with state-of-the-art reasoning and complex multimodal understanding, as well as powerful agentic and vibe coding capabilities. See more below:
0:20

Start building with Gemini 3 Pro, our most intelligent model with state-of-the-art reasoning and complex multimodal understanding, as well as powerful agentic and vibe coding capabilities. See more below:

Google AI Developers

104,898 görüntüleme • 10 ay önce