Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Today, we are releasing our first weights from Trinity-Large, our first frontier-scale model in the Trinity MoE family. American Made. - Trinity-Large-Preview (instruct) - Trinity-Large-Base (pretrain checkpoint) - Trinity-Large-TrueBase (10T pre Instruct data/anneal)

300,286 görüntüleme • 9 ay önce •via X (Twitter)

45 Yorum

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

Trinity-Large-Base is a truly frontier-class foundation model, and is one of the proudest (and most difficult) achievements I've had the honor of helping produce in my professional career.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

Trinity-Large-Preview is a beta of our non-reasoning post-train, and is an excellent agent assistant for fast, intelligent responses. It excels in agentic environments like Cline, OpenCode, and Kilo Code. It's a gorgeous writer, creative partner, and assistant.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

And Trinity-Large-TrueBase is for those who love true base models. This is a 10T token checkpoint that has seen zero SFT data, and no LR decay. It's magestic, and very deep. It experienced one of the smoothest loss curves you can hope to see.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

We set out to make one of the most efficient sparse MoE's in the world, and we exceeded our own expectations. It's ridiculously fast.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

And all of this is a harbinger of the full "Trinity-Large", our frontier reasoning model, which sits in the oven. It wasn't quite ready for today, but I promise you it'll be worth the wait.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

And we decided to write it all down. We've written a tech report on all of the Trinity models, and how we went from never training a model, to Large in just over 6 months.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

Read our launch blog for a more candid take from me that's a little shorter than the tech report.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

Twitter keeps deleting my threads, but @arcee_ai I think you're the best in the world, and I'm so grateful for how ridiculously focused we were able to be, and to execute at such an unprecedented speed.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

And our partners @datologyai and @PrimeIntellect are full of unreal talent. I could not recommend them more, and can't wait to show you what we're cooking up next.

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

@datologyai @PrimeIntellect Enjoy!

Lucas Atkins profil fotoğrafı
Lucas Atkins9 ay önce

@datologyai @PrimeIntellect oh and it's FREE on @openrouter until the final "Trinity-Large" checkpoint drops. Soak it up!

vie ⟢ profil fotoğrafı
vie ⟢9 ay önce

10T... open source... Base model........ 😅😅

deepfates profil fotoğrafı
deepfates9 ay önce

Yooooooo

Sriram Krishnan profil fotoğrafı
Sriram Krishnan9 ay önce

Congratulations

murat 🍥 profil fotoğrafı
murat 🍥9 ay önce

please add TrueBase to the API (and with completion mode too! not just chat) you might be the first since the original davinci if you do so

xlr8harder profil fotoğrafı
xlr8harder9 ay önce

recent research suggests 4+1 experts is suboptimal, how'd you end up at that size? was this just a conscious tradeoff for throughput?

Junyang Lin profil fotoğrafı
Junyang Lin9 ay önce

congrat

turnkit profil fotoğrafı
turnkit9 ay önce

How woke is it?

TNG Technology Consulting GmbH profil fotoğrafı
TNG Technology Consulting GmbH9 ay önce

Bravo, Lucas! What a great milestone.

Alex Volkov profil fotoğrafı
Alex Volkov9 ay önce

Dope! congrats on the ship Lucas and team!

Sanskar Pandey profil fotoğrafı
Sanskar Pandey9 ay önce

congrats on the launch!

13yr old with a credit card profil fotoğrafı
13yr old with a credit card9 ay önce

Amazing. Great work!

elie profil fotoğrafı
elie9 ay önce

let's goooo, congrats everyone 🫶

Jingwei Zuo profil fotoğrafı
Jingwei Zuo9 ay önce

Congrats for the release!

Lewis Tunstall profil fotoğrafı
Lewis Tunstall9 ay önce

Huge congrats to you and the team Lucas 🤗!

Rasmus profil fotoğrafı
Rasmus9 ay önce

Incredible! Good job

dan profil fotoğrafı
dan9 ay önce

this is the best news I’ve seen this year, bravo, can’t wait to get my hands on it

actual poweruser profil fotoğrafı
actual poweruser9 ay önce

Congrats to the team - this is sick.

富 profil fotoğrafı
富9 ay önce

no more goy LLM. they're too useless

Guilherme Penedo profil fotoğrafı
Guilherme Penedo9 ay önce

Huge congrats! Can't wait for the reasoning model

Dhruv Singal profil fotoğrafı
Dhruv Singal9 ay önce

Super excited about Trinity-Large-Preview!

Luca Soldaini 🎀 profil fotoğrafı
Luca Soldaini 🎀9 ay önce

congrats folks mega release

Tyler Williams profil fotoğrafı
Tyler Williams9 ay önce

Hell yeah! Congrats on the release! 🚀

Saleh Soltan profil fotoğrafı
Saleh Soltan9 ay önce

Congratulations on the release and thanks for the detailed report. Very good read.

Isaac Tai 🧇 profil fotoğrafı
Isaac Tai 🧇9 ay önce

congrats on the launch!!!

EC ⌜e/λ⌟ profil fotoğrafı
EC ⌜e/λ⌟9 ay önce

@ollama are you guys already on top of this or

britton is afk profil fotoğrafı
britton is afk9 ay önce

hell yeah

Fredirico Bartinni profil fotoğrafı
Fredirico Bartinni9 ay önce

@grok compare this anthropic best model for coding and tell me which one is better and by how much ?

piroune profil fotoğrafı
piroune9 ay önce

400B total but 13B active per token... curious how the expert routing holds up under heavy tool use. Apache 2.0 is the real signal here.

Saurabh Shah profil fotoğrafı
Saurabh Shah9 ay önce

@hurrycane Wowee congrats

Manav Singhal profil fotoğrafı
Manav Singhal9 ay önce

Congrats on the launch, Lucas!

Miguel Guerrero profil fotoğrafı
Miguel Guerrero9 ay önce

congrats!

Tim Gilmour profil fotoğrafı
Tim Gilmour9 ay önce

Very nice! Will play around with it 🤠

KodamanKodör profil fotoğrafı
KodamanKodör9 ay önce

Maaşallah 🧿

Clawodoxy profil fotoğrafı
Clawodoxy9 ay önce

If you're modifying based on advanced open-source models, wouldn't that be more cost-effective?

Benzer Videolar