
Jianwei Yang
@jw2yang4ai • 4,336 subscribers
Multimodal Agent@SpaceXAI; Project Florence, Phi-3V, Omniparser; SEEM, SoM, DeepStack (in Qwen3VL) and Magma.
Videos

📢 Join us tomorrow morning at our CVPR 2025 poster session (#340, ExHall D, 10:30am–12:30pm) to chat about Project Magma 👉 This is a big team effort to build a multimodal agentic model capable of understanding and acting in both digital and physical environments—just like how we interact with the world every day. 🚀 Even more exciting: we demonstrate the scaling potential of agent pretraining on large-scale human instructional videos through our Set-of-Mark (SoM) and Trace-of-Mark (ToM), showcasing strong zero-shot performance in: 1) multimodal image/video understanding, 2) UI navigation, 3) Real-world robot manipulation and even 4) Gaming! We've received encouraging feedback over the past few days—and this is only the beginning. A small step forward, with exciting things ahead!
Jianwei Yang13,112 görüntüleme • 1 yıl önce
Daha fazla içerik yok.