正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Video Generation Models are General-Purpose Vision Learners

AK

514,063 subscribers

33,080 次观看 • 3 个月前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Despite having vision, most AI agents still struggle to see. General-purpose multimodal models are powerful, but they’re expensive for every visual task. We built something better: Perceptron's MCP gives any agent stronger vision capabilities through Isaac with far lower cost.

Despite having vision, most AI agents still struggle to see. General-purpose multimodal models are powerful, but they’re expensive for every visual task. We built something better: Perceptron's MCP gives any agent stronger vision capabilities through Isaac with far lower cost.

Perceptron AI

335,963 次观看 • 7 个月前

general purpose L2s are dead

general purpose L2s are dead

Raza

37,641 次观看 • 2 个月前

This video explains how diffusion models are overtaking Large Language Models for generation tasks like: 1. Code Generation 2. Image Generation 3. Video Generation 00:00 Agenda 00:20 How are they different from LLMs? 05:09 Internal Mechanism 10:09 How are vectors generated? 12:08 Conclusion 13:02 Opinion Piece AI Engineering Course: #Diffusion #AI #LLMs

This video explains how diffusion models are overtaking Large Language Models for generation tasks like: 1. Code Generation 2. Image Generation 3. Video Generation 00:00 Agenda 00:20 How are they different from LLMs? 05:09 Internal Mechanism 10:09 How are vectors generated? 12:08 Conclusion 13:02 Opinion Piece AI Engineering Course: #Diffusion #AI #LLMs

Gaurav Sen

28,027 次观看 • 1 年前

Intelligence Factory is building human intelligence for robots. They train general-purpose manipulation models on human demonstration data (vision, action, and touch), then deploy them in warehouses, grocery stores, and data centers. Congrats on the launch, Yash and Jalaj!

Intelligence Factory is building human intelligence for robots. They train general-purpose manipulation models on human demonstration data (vision, action, and touch), then deploy them in warehouses, grocery stores, and data centers. Congrats on the launch, Yash and Jalaj!

Y Combinator

44,842 次观看 • 5 个月前

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:

Physical Intelligence's π₀, a general-purpose robot foundation model that combines Internet-scale vision-language pretraining with robot interaction data to execute tasks. They aim "to develop foundation models that can control any robot to perform any task" Autonomous demos:

The Humanoid Hub

196,941 次观看 • 2 年前

Dreamix: Video Diffusion Models are General Video Editors abs: project page: present diffusion-based method that is able to perform text-based motion and appearance editing of general videos

Dreamix: Video Diffusion Models are General Video Editors abs: project page: present diffusion-based method that is able to perform text-based motion and appearance editing of general videos

AK

398,258 次观看 • 3 年前

Gymnastics is the Turing test of video generation models

Gymnastics is the Turing test of video generation models

Deedy

6,719,210 次观看 • 2 年前

Fireworks AI CEO Lin Qiao says we're just at the beginning of the AI revolution, and general-purpose intelligence models are not enough. 🤖 Here's why. Watch the full interview:

Fireworks AI CEO Lin Qiao says we're just at the beginning of the AI revolution, and general-purpose intelligence models are not enough. 🤖 Here's why. Watch the full interview:

Yahoo Finance

14,099 次观看 • 3 天前

Specialized AI models will outperform general purpose models long-term. That's the big bet our team is making with Silvia, the super-intelligent financial AI product we are personally using and building every day. Anthony Pompliano 🌪 explains why works.

Specialized AI models will outperform general purpose models long-term. That's the big bet our team is making with Silvia, the super-intelligent financial AI product we are personally using and building every day. Anthony Pompliano 🌪 explains why works.

Phil Rosen

23,691 次观看 • 3 个月前

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:

Hugging Models

35,935 次观看 • 8 个月前

Another video: What school is this and how are all learners great dancers lol

Another video: What school is this and how are all learners great dancers lol

Dj Zan-D

321,357 次观看 • 1 年前

The new AI video generation models are insane. Check out this prompt for “Gordon Ramsay makes a Beef Wellington for Christmas”. Unbelievable.

The new AI video generation models are insane. Check out this prompt for “Gordon Ramsay makes a Beef Wellington for Christmas”. Unbelievable.

Trung Phan

1,047,208 次观看 • 11 个月前

🚨These 3rd Generation ENVG-B Night Vision Systems Are INSANE! If these are publicly disclosed capabilities... What's classified?

🚨These 3rd Generation ENVG-B Night Vision Systems Are INSANE! If these are publicly disclosed capabilities... What's classified?

Jay Anderson

273,948 次观看 • 1 年前

📽️ Video generation is now live on Venice for all users Bring your imagination to life with state-of-the-art video generation models on Venice, including industry-leading models Sora 2 and Veo3.1

📽️ Video generation is now live on Venice for all users Bring your imagination to life with state-of-the-art video generation models on Venice, including industry-leading models Sora 2 and Veo3.1

Venice

80,623 次观看 • 1 年前

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)

Songyou Peng

291,646 次观看 • 6 个月前

One of the biggest surprises in AI over the last few years has been how well coding agents generalize beyond software. In a recent essay, MIT professor Philip Isola argued that we may be entering the era of robot-use agents: general-purpose models that can control different robots, write policies, and learn new physical tasks with little or no robot-specific training. In this episode of Decoded, we're joined by the founders of Waddle Labs and Robocurve PBC, two of the startups whose work helped drive this realization. They're working at the frontier of using general-purpose models to control robots, and their recent demos helped inspire the growing conversation around robot-use agents. Together, we dig into the research behind that idea, from code-as-policies and vision-language-action models to the harnesses and evals needed to make these systems work in the real world. 00:00 — What Are Robot-Use Agents? 02:11 — From Vision-Language-Action Models to General LLMs 04:07 — The Bitter Lesson for Robotics 07:04 — How Coding Agents Learned to Control Robots 10:41 — How Robots Learn From Experience 14:22 — The Harness as a Form of Robot Intelligence 16:14 — Watching Astra Control a Robot 20:55 — Why General Models May Win in Robotics 26:05 — How Close Are General-Purpose Robots?

One of the biggest surprises in AI over the last few years has been how well coding agents generalize beyond software. In a recent essay, MIT professor Philip Isola argued that we may be entering the era of robot-use agents: general-purpose models that can control different robots, write policies, and learn new physical tasks with little or no robot-specific training. In this episode of Decoded, we're joined by the founders of Waddle Labs and Robocurve PBC, two of the startups whose work helped drive this realization. They're working at the frontier of using general-purpose models to control robots, and their recent demos helped inspire the growing conversation around robot-use agents. Together, we dig into the research behind that idea, from code-as-policies and vision-language-action models to the harnesses and evals needed to make these systems work in the real world. 00:00 — What Are Robot-Use Agents? 02:11 — From Vision-Language-Action Models to General LLMs 04:07 — The Bitter Lesson for Robotics 07:04 — How Coding Agents Learned to Control Robots 10:41 — How Robots Learn From Experience 14:22 — The Harness as a Form of Robot Intelligence 16:14 — Watching Astra Control a Robot 20:55 — Why General Models May Win in Robotics 26:05 — How Close Are General-Purpose Robots?

Y Combinator

95,405 次观看 • 1 个月前

🚨These 3rd Generation ENVG-B Night Vision Systems Are INSANE! If these are publicly disclosed capabilities... What's classified? 👀

🚨These 3rd Generation ENVG-B Night Vision Systems Are INSANE! If these are publicly disclosed capabilities... What's classified? 👀

Jay Anderson

536,420 次观看 • 1 年前

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

Danny Driess

1,272,956 次观看 • 3 年前

Working with Physical Intelligence, we are bringing general purpose robotics models into the places that need them most —- the factories that make things we all need and use. 150 factories using Formic robots and counting!

Working with Physical Intelligence, we are bringing general purpose robotics models into the places that need them most —- the factories that make things we all need and use. 150 factories using Formic robots and counting!

Saman Farid

18,044 次观看 • 26 天前