正在加载视频...

视频加载失败

Today, we are releasing our first weights from Trinity-Large, our first frontier-scale model in the Trinity MoE family. American Made. - Trinity-Large-Preview (instruct) - Trinity-Large-Base (pretrain checkpoint) - Trinity-Large-TrueBase (10T pre Instruct data/anneal)

300,286 次观看 • 7 个月前 •via X (Twitter)

45 条评论

Lucas Atkins 的头像
Lucas Atkins7 个月前

Trinity-Large-Base is a truly frontier-class foundation model, and is one of the proudest (and most difficult) achievements I've had the honor of helping produce in my professional career.

Lucas Atkins 的头像
Lucas Atkins7 个月前

Trinity-Large-Preview is a beta of our non-reasoning post-train, and is an excellent agent assistant for fast, intelligent responses. It excels in agentic environments like Cline, OpenCode, and Kilo Code. It's a gorgeous writer, creative partner, and assistant.

Lucas Atkins 的头像
Lucas Atkins7 个月前

And Trinity-Large-TrueBase is for those who love true base models. This is a 10T token checkpoint that has seen zero SFT data, and no LR decay. It's magestic, and very deep. It experienced one of the smoothest loss curves you can hope to see.

Lucas Atkins 的头像
Lucas Atkins7 个月前

We set out to make one of the most efficient sparse MoE's in the world, and we exceeded our own expectations. It's ridiculously fast.

Lucas Atkins 的头像
Lucas Atkins7 个月前

And all of this is a harbinger of the full "Trinity-Large", our frontier reasoning model, which sits in the oven. It wasn't quite ready for today, but I promise you it'll be worth the wait.

Lucas Atkins 的头像
Lucas Atkins7 个月前

And we decided to write it all down. We've written a tech report on all of the Trinity models, and how we went from never training a model, to Large in just over 6 months.

Lucas Atkins 的头像
Lucas Atkins7 个月前

Read our launch blog for a more candid take from me that's a little shorter than the tech report.

Lucas Atkins 的头像
Lucas Atkins7 个月前

Twitter keeps deleting my threads, but @arcee_ai I think you're the best in the world, and I'm so grateful for how ridiculously focused we were able to be, and to execute at such an unprecedented speed.

Lucas Atkins 的头像
Lucas Atkins7 个月前

And our partners @datologyai and @PrimeIntellect are full of unreal talent. I could not recommend them more, and can't wait to show you what we're cooking up next.

Lucas Atkins 的头像
Lucas Atkins7 个月前

@datologyai @PrimeIntellect Enjoy!

Lucas Atkins 的头像
Lucas Atkins7 个月前

@datologyai @PrimeIntellect oh and it's FREE on @openrouter until the final "Trinity-Large" checkpoint drops. Soak it up!

vie ⟢ 的头像
vie ⟢7 个月前

10T... open source... Base model........ 😅😅

deepfates 的头像
deepfates7 个月前

Yooooooo

Sriram Krishnan 的头像
Sriram Krishnan7 个月前

Congratulations

murat 🍥 的头像
murat 🍥7 个月前

please add TrueBase to the API (and with completion mode too! not just chat) you might be the first since the original davinci if you do so

xlr8harder 的头像
xlr8harder7 个月前

recent research suggests 4+1 experts is suboptimal, how'd you end up at that size? was this just a conscious tradeoff for throughput?

Junyang Lin 的头像
Junyang Lin7 个月前

congrat

turnkit 的头像
turnkit7 个月前

How woke is it?

TNG Technology Consulting GmbH 的头像
TNG Technology Consulting GmbH7 个月前

Bravo, Lucas! What a great milestone.

Alex Volkov 的头像
Alex Volkov7 个月前

Dope! congrats on the ship Lucas and team!

Sanskar Pandey 的头像
Sanskar Pandey7 个月前

congrats on the launch!

13yr old with a credit card 的头像
13yr old with a credit card7 个月前

Amazing. Great work!

elie 的头像
elie7 个月前

let's goooo, congrats everyone 🫶

Jingwei Zuo 的头像
Jingwei Zuo7 个月前

Congrats for the release!

Lewis Tunstall 的头像
Lewis Tunstall7 个月前

Huge congrats to you and the team Lucas 🤗!

Rasmus 的头像
Rasmus7 个月前

Incredible! Good job

dan 的头像
dan7 个月前

this is the best news I’ve seen this year, bravo, can’t wait to get my hands on it

actual poweruser 的头像
actual poweruser7 个月前

Congrats to the team - this is sick.

富 的头像
7 个月前

no more goy LLM. they're too useless

Guilherme Penedo 的头像
Guilherme Penedo7 个月前

Huge congrats! Can't wait for the reasoning model

Dhruv Singal 的头像
Dhruv Singal7 个月前

Super excited about Trinity-Large-Preview!

Luca Soldaini 🎀 的头像
Luca Soldaini 🎀7 个月前

congrats folks mega release

Tyler Williams 的头像
Tyler Williams7 个月前

Hell yeah! Congrats on the release! 🚀

Saleh Soltan 的头像
Saleh Soltan7 个月前

Congratulations on the release and thanks for the detailed report. Very good read.

Isaac Tai 🧇 的头像
Isaac Tai 🧇7 个月前

congrats on the launch!!!

EC ⌜e/λ⌟ 的头像
EC ⌜e/λ⌟7 个月前

@ollama are you guys already on top of this or

britton is afk 的头像
britton is afk7 个月前

hell yeah

Fredirico Bartinni 的头像
Fredirico Bartinni7 个月前

@grok compare this anthropic best model for coding and tell me which one is better and by how much ?

piroune 的头像
piroune7 个月前

400B total but 13B active per token... curious how the expert routing holds up under heavy tool use. Apache 2.0 is the real signal here.

Saurabh Shah 的头像
Saurabh Shah7 个月前

@hurrycane Wowee congrats

Manav Singhal 的头像
Manav Singhal7 个月前

Congrats on the launch, Lucas!

Miguel Guerrero 的头像
Miguel Guerrero7 个月前

congrats!

Tim Gilmour 的头像
Tim Gilmour7 个月前

Very nice! Will play around with it 🤠

KodamanKodör 的头像
KodamanKodör7 个月前

Maaşallah 🧿

Clawodoxy 的头像
Clawodoxy7 个月前

If you're modifying based on advanced open-source models, wouldn't that be more cost-effective?

相关视频