Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today, we are releasing our first weights from Trinity-Large, our first frontier-scale model in the Trinity MoE family. American Made. - Trinity-Large-Preview (instruct) - Trinity-Large-Base (pretrain checkpoint) - Trinity-Large-TrueBase (10T pre Instruct data/anneal)

300,286 Aufrufe • vor 7 Monaten •via X (Twitter)

45 Kommentare

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

Trinity-Large-Base is a truly frontier-class foundation model, and is one of the proudest (and most difficult) achievements I've had the honor of helping produce in my professional career.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

Trinity-Large-Preview is a beta of our non-reasoning post-train, and is an excellent agent assistant for fast, intelligent responses. It excels in agentic environments like Cline, OpenCode, and Kilo Code. It's a gorgeous writer, creative partner, and assistant.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

And Trinity-Large-TrueBase is for those who love true base models. This is a 10T token checkpoint that has seen zero SFT data, and no LR decay. It's magestic, and very deep. It experienced one of the smoothest loss curves you can hope to see.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

We set out to make one of the most efficient sparse MoE's in the world, and we exceeded our own expectations. It's ridiculously fast.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

And all of this is a harbinger of the full "Trinity-Large", our frontier reasoning model, which sits in the oven. It wasn't quite ready for today, but I promise you it'll be worth the wait.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

And we decided to write it all down. We've written a tech report on all of the Trinity models, and how we went from never training a model, to Large in just over 6 months.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

Read our launch blog for a more candid take from me that's a little shorter than the tech report.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

Twitter keeps deleting my threads, but @arcee_ai I think you're the best in the world, and I'm so grateful for how ridiculously focused we were able to be, and to execute at such an unprecedented speed.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

And our partners @datologyai and @PrimeIntellect are full of unreal talent. I could not recommend them more, and can't wait to show you what we're cooking up next.

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

@datologyai @PrimeIntellect Enjoy!

Profilbild von Lucas Atkins
Lucas Atkinsvor 7 Monaten

@datologyai @PrimeIntellect oh and it's FREE on @openrouter until the final "Trinity-Large" checkpoint drops. Soak it up!

Profilbild von vie ⟢
vie ⟢vor 7 Monaten

10T... open source... Base model........ 😅😅

Profilbild von deepfates
deepfatesvor 7 Monaten

Yooooooo

Profilbild von Sriram Krishnan
Sriram Krishnanvor 7 Monaten

Congratulations

Profilbild von murat 🍥
murat 🍥vor 7 Monaten

please add TrueBase to the API (and with completion mode too! not just chat) you might be the first since the original davinci if you do so

Profilbild von xlr8harder
xlr8hardervor 7 Monaten

recent research suggests 4+1 experts is suboptimal, how'd you end up at that size? was this just a conscious tradeoff for throughput?

Profilbild von Junyang Lin
Junyang Linvor 7 Monaten

congrat

Profilbild von turnkit
turnkitvor 7 Monaten

How woke is it?

Profilbild von TNG Technology Consulting GmbH
TNG Technology Consulting GmbHvor 7 Monaten

Bravo, Lucas! What a great milestone.

Profilbild von Alex Volkov
Alex Volkovvor 7 Monaten

Dope! congrats on the ship Lucas and team!

Profilbild von Sanskar Pandey
Sanskar Pandeyvor 7 Monaten

congrats on the launch!

Profilbild von 13yr old with a credit card
13yr old with a credit cardvor 7 Monaten

Amazing. Great work!

Profilbild von elie
elievor 7 Monaten

let's goooo, congrats everyone 🫶

Profilbild von Jingwei Zuo
Jingwei Zuovor 7 Monaten

Congrats for the release!

Profilbild von Lewis Tunstall
Lewis Tunstallvor 7 Monaten

Huge congrats to you and the team Lucas 🤗!

Profilbild von Rasmus
Rasmusvor 7 Monaten

Incredible! Good job

Profilbild von dan
danvor 7 Monaten

this is the best news I’ve seen this year, bravo, can’t wait to get my hands on it

Profilbild von actual poweruser
actual poweruservor 7 Monaten

Congrats to the team - this is sick.

Profilbild von 富
vor 7 Monaten

no more goy LLM. they're too useless

Profilbild von Guilherme Penedo
Guilherme Penedovor 7 Monaten

Huge congrats! Can't wait for the reasoning model

Profilbild von Dhruv Singal
Dhruv Singalvor 7 Monaten

Super excited about Trinity-Large-Preview!

Profilbild von Luca Soldaini 🎀
Luca Soldaini 🎀vor 7 Monaten

congrats folks mega release

Profilbild von Tyler Williams
Tyler Williamsvor 7 Monaten

Hell yeah! Congrats on the release! 🚀

Profilbild von Saleh Soltan
Saleh Soltanvor 7 Monaten

Congratulations on the release and thanks for the detailed report. Very good read.

Profilbild von Isaac Tai 🧇
Isaac Tai 🧇vor 7 Monaten

congrats on the launch!!!

Profilbild von EC ⌜e/λ⌟
EC ⌜e/λ⌟vor 7 Monaten

@ollama are you guys already on top of this or

Profilbild von britton is afk
britton is afkvor 7 Monaten

hell yeah

Profilbild von Fredirico Bartinni
Fredirico Bartinnivor 7 Monaten

@grok compare this anthropic best model for coding and tell me which one is better and by how much ?

Profilbild von piroune
pirounevor 7 Monaten

400B total but 13B active per token... curious how the expert routing holds up under heavy tool use. Apache 2.0 is the real signal here.

Profilbild von Saurabh Shah
Saurabh Shahvor 7 Monaten

@hurrycane Wowee congrats

Profilbild von Manav Singhal
Manav Singhalvor 7 Monaten

Congrats on the launch, Lucas!

Profilbild von Miguel Guerrero
Miguel Guerrerovor 7 Monaten

congrats!

Profilbild von Tim Gilmour
Tim Gilmourvor 7 Monaten

Very nice! Will play around with it 🤠

Profilbild von KodamanKodör
KodamanKodörvor 7 Monaten

Maaşallah 🧿

Profilbild von Clawodoxy
Clawodoxyvor 7 Monaten

If you're modifying based on advanced open-source models, wouldn't that be more cost-effective?

Ähnliche Videos