正在加载视频...

视频加载失败

We are releasing 4M-21 with a permissive license, including its source code and trained models. It's a pretty effective multimodal model that solves 10s of tasks & modalities. See the demo code, sample results, and the tokenizers of diverse modalities on the website. IMO, the multitask learning aspect of...

69,603 次观看 • 2 年前 •via X (Twitter)

6 条评论

Amir Zamir 的头像
Amir Zamir2 年前

shoutout to @roman__bachmann, @oguzhanthefatih, @dmizrahi_ who led the work, along with @aligarjani, @mingfei_gao, David Griffiths, @hujm99, @afshin_dn, @zamir_ar.

Shikun Liu 的头像
Shikun Liu2 年前

Great work! And thanks for open-sourcing to the community. :)

Isaac Kargar 的头像
Isaac Kargar2 年前

No audio input?

Amir Zamir 的头像
Amir Zamir2 年前

It’s a matter of data. Otherwise IMO the method will work as-is.

Lele 的头像
Lele2 年前

massive

Puneet (Linkedin Top Voice | AI and Data speaker) 的头像
Puneet (Linkedin Top Voice | AI and Data speaker)2 年前

@zamir_ar You guys are nailing it! #multimodal #framework

相关视频

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 次观看 • 2 年前