Загрузка видео...

Не удалось загрузить видео

На главную

Today, we are releasing our first weights from Trinity-Large, our first frontier-scale model in the Trinity MoE family. American Made. - Trinity-Large-Preview (instruct) - Trinity-Large-Base (pretrain checkpoint) - Trinity-Large-TrueBase (10T pre Instruct data/anneal)

300,286 просмотров • 7 месяцев назад •via X (Twitter)

Комментарии: 45

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

Trinity-Large-Base is a truly frontier-class foundation model, and is one of the proudest (and most difficult) achievements I've had the honor of helping produce in my professional career.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

Trinity-Large-Preview is a beta of our non-reasoning post-train, and is an excellent agent assistant for fast, intelligent responses. It excels in agentic environments like Cline, OpenCode, and Kilo Code. It's a gorgeous writer, creative partner, and assistant.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

And Trinity-Large-TrueBase is for those who love true base models. This is a 10T token checkpoint that has seen zero SFT data, and no LR decay. It's magestic, and very deep. It experienced one of the smoothest loss curves you can hope to see.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

We set out to make one of the most efficient sparse MoE's in the world, and we exceeded our own expectations. It's ridiculously fast.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

And all of this is a harbinger of the full "Trinity-Large", our frontier reasoning model, which sits in the oven. It wasn't quite ready for today, but I promise you it'll be worth the wait.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

And we decided to write it all down. We've written a tech report on all of the Trinity models, and how we went from never training a model, to Large in just over 6 months.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

Read our launch blog for a more candid take from me that's a little shorter than the tech report.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

Twitter keeps deleting my threads, but @arcee_ai I think you're the best in the world, and I'm so grateful for how ridiculously focused we were able to be, and to execute at such an unprecedented speed.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

And our partners @datologyai and @PrimeIntellect are full of unreal talent. I could not recommend them more, and can't wait to show you what we're cooking up next.

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

@datologyai @PrimeIntellect Enjoy!

Фото профиля Lucas Atkins
Lucas Atkins7 месяцев назад

@datologyai @PrimeIntellect oh and it's FREE on @openrouter until the final "Trinity-Large" checkpoint drops. Soak it up!

Фото профиля vie ⟢
vie ⟢7 месяцев назад

10T... open source... Base model........ 😅😅

Фото профиля deepfates
deepfates7 месяцев назад

Yooooooo

Фото профиля Sriram Krishnan
Sriram Krishnan7 месяцев назад

Congratulations

Фото профиля murat 🍥
murat 🍥7 месяцев назад

please add TrueBase to the API (and with completion mode too! not just chat) you might be the first since the original davinci if you do so

Фото профиля xlr8harder
xlr8harder7 месяцев назад

recent research suggests 4+1 experts is suboptimal, how'd you end up at that size? was this just a conscious tradeoff for throughput?

Фото профиля Junyang Lin
Junyang Lin7 месяцев назад

congrat

Фото профиля turnkit
turnkit7 месяцев назад

How woke is it?

Фото профиля TNG Technology Consulting GmbH
TNG Technology Consulting GmbH7 месяцев назад

Bravo, Lucas! What a great milestone.

Фото профиля Alex Volkov
Alex Volkov7 месяцев назад

Dope! congrats on the ship Lucas and team!

Фото профиля Sanskar Pandey
Sanskar Pandey7 месяцев назад

congrats on the launch!

Фото профиля 13yr old with a credit card
13yr old with a credit card7 месяцев назад

Amazing. Great work!

Фото профиля elie
elie7 месяцев назад

let's goooo, congrats everyone 🫶

Фото профиля Jingwei Zuo
Jingwei Zuo7 месяцев назад

Congrats for the release!

Фото профиля Lewis Tunstall
Lewis Tunstall7 месяцев назад

Huge congrats to you and the team Lucas 🤗!

Фото профиля Rasmus
Rasmus7 месяцев назад

Incredible! Good job

Фото профиля dan
dan7 месяцев назад

this is the best news I’ve seen this year, bravo, can’t wait to get my hands on it

Фото профиля actual poweruser
actual poweruser7 месяцев назад

Congrats to the team - this is sick.

Фото профиля 富
7 месяцев назад

no more goy LLM. they're too useless

Фото профиля Guilherme Penedo
Guilherme Penedo7 месяцев назад

Huge congrats! Can't wait for the reasoning model

Фото профиля Dhruv Singal
Dhruv Singal7 месяцев назад

Super excited about Trinity-Large-Preview!

Фото профиля Luca Soldaini 🎀
Luca Soldaini 🎀7 месяцев назад

congrats folks mega release

Фото профиля Tyler Williams
Tyler Williams7 месяцев назад

Hell yeah! Congrats on the release! 🚀

Фото профиля Saleh Soltan
Saleh Soltan7 месяцев назад

Congratulations on the release and thanks for the detailed report. Very good read.

Фото профиля Isaac Tai 🧇
Isaac Tai 🧇7 месяцев назад

congrats on the launch!!!

Фото профиля EC ⌜e/λ⌟
EC ⌜e/λ⌟7 месяцев назад

@ollama are you guys already on top of this or

Фото профиля britton is afk
britton is afk7 месяцев назад

hell yeah

Фото профиля Fredirico Bartinni
Fredirico Bartinni7 месяцев назад

@grok compare this anthropic best model for coding and tell me which one is better and by how much ?

Фото профиля piroune
piroune7 месяцев назад

400B total but 13B active per token... curious how the expert routing holds up under heavy tool use. Apache 2.0 is the real signal here.

Фото профиля Saurabh Shah
Saurabh Shah7 месяцев назад

@hurrycane Wowee congrats

Фото профиля Manav Singhal
Manav Singhal7 месяцев назад

Congrats on the launch, Lucas!

Фото профиля Miguel Guerrero
Miguel Guerrero7 месяцев назад

congrats!

Фото профиля Tim Gilmour
Tim Gilmour7 месяцев назад

Very nice! Will play around with it 🤠

Фото профиля KodamanKodör
KodamanKodör7 месяцев назад

Maaşallah 🧿

Фото профиля Clawodoxy
Clawodoxy7 месяцев назад

If you're modifying based on advanced open-source models, wouldn't that be more cost-effective?

Похожие видео