Загрузка видео...

Не удалось загрузить видео

На главную

Meet Reka Core, our best and most capable multimodal language model yet. 🔮 It’s been a busy few months training this model and we are glad to finally ship it! 💪 Core has a lot of capabilities, and one of them is understanding video --- let’s see what Core...

757,957 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 10

Фото профиля Reka
Reka2 лет назад

We evaluate Core on standard benchmarks for both text and multimodal, along with a blind third-party human evaluation.

Фото профиля Reka
Reka2 лет назад

Along with Core, we have published a technical report detailing the training, architecture, data, and evaluation for the Reka models.

Фото профиля Reka
Reka2 лет назад

See some examples of outputs from Core in or try it yourself on

Фото профиля Reka
Reka2 лет назад

Check out the blogpost for more details.

Фото профиля dmitriy
dmitriy2 лет назад

Please familiarize it with big chungus

Фото профиля Matt Henderson
Matt Henderson2 лет назад

Flash to Core in two months! 📈

Фото профиля sridhar
sridhar2 лет назад

Congratulations, @DaniYogatama and @RekaAILabs team!!

Фото профиля Ben (e/treats)
Ben (e/treats)2 лет назад

congrats!!! please add pricing to your pricing page 👀 it's just a form right now

Фото профиля Reka
Reka2 лет назад

It's a bug and we are fixing it. Currently, Core is 10 bucks per million input tokens and 25 bucks per million output tokens.

Фото профиля djcows
djcows2 лет назад

nice. however, one small issue, no submariner

Похожие видео

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 просмотров • 1 год назад