Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Today, we’re excited to launch the Datology Curation Studio, customizable frontier data curation for every team training its own models. Data quality is the ultimate compute multiplier, and Curation Studio makes it easy for everyone.

4,265,085 görüntüleme • 2 gün önce •via X (Twitter)

39 Yorum

DatologyAI profil fotoğrafı
DatologyAI2 gün önce

We built the strongest baseline we could by combining the best publicly curated datasets. Curated data led to meaningfully better models, with the baseline needing 6× the compute to match the same quality. That’s the Datology compute multiplier in action.

DatologyAI profil fotoğrafı
DatologyAI2 gün önce

We used the same 39 source datasets—including Nemotron, FineWeb, and The Stack v3—and identical pretraining and post-training recipes to make the most apples-to-apples comparison possible. The only change: data curation. Explore the setup and results:

DatologyAI profil fotoğrafı
DatologyAI2 gün önce

The gains persisted after post-training: our 30B-A3B model scored 46.8% vs. 37.7% for the baseline, averaged across benchmarks. A curated 12B-A1.4B model also beat the 30B-A3B baseline despite using roughly one-fifth of the pretraining compute.

DatologyAI profil fotoğrafı
DatologyAI2 gün önce

Curation Studio puts this process in your hands: Clean → Calibrate → Create → Compose. Bring your data, optimize for your tasks, and keep your data inside your VPC. See how it works:

DatologyAI profil fotoğrafı
DatologyAI2 gün önce

If you want to own your own intelligence, book a demo with our team, or join us live on October 27th to see Curation Studio in action and chat with the team behind the research. Save your seat here:

Vincent Weisser profil fotoğrafı
Vincent Weisser2 gün önce

huge congrats Ari and team!!

stochasm profil fotoğrafı
stochasm2 gün önce

congrats on the launch!!

Felicis profil fotoğrafı
Felicis2 gün önce

🧡🚀we love launch days!!

Astasia Myers profil fotoğrafı
Astasia Myers2 gün önce

So cool to see this out!

Leo profil fotoğrafı
Leo2 gün önce

this is nuts, congrats on the launch!!

z profil fotoğrafı
z2 gün önce

same data, same recipe, just better curation and it's 6x?? y'all cooked fr

Yağız Çalık profil fotoğrafı
Yağız Çalık2 gün önce

exciting, congrats!!

ari. profil fotoğrafı
ari.2 gün önce

so basically it’s not about how big the model is, it’s about what you feed it. kinda makes sense when you think about it

Alba profil fotoğrafı
Alba2 gün önce

Curious, how much does this change when you use a completely different base model?

maria profil fotoğrafı
maria2 gün önce

everyone's buying more gpus and y'all just fixed the data lol, love this

max profil fotoğrafı
max2 gün önce

does it work for fine-tuning too, or just pretraining?

Madeline 💌💐 profil fotoğrafı
Madeline 💌💐2 gün önce

What does “customizable” mean if you do not know what good data looks like?

Tiffany Luck profil fotoğrafı
Tiffany Luck2 gün önce

Big day for 'own your intelligence' -- congrats!!

Rodev profil fotoğrafı
Rodev2 gün önce

everyone wants a bigger model until they see the compute bill

rewind profil fotoğrafı
rewind2 gün önce

Congrats team

Ryoru 𒌐 profil fotoğrafı
Ryoru 𒌐2 gün önce

Does this mean a lot of models could perform better without getting any bigger?

rachit profil fotoğrafı
rachit2 gün önce

does the 6x hold for domain-specific data too or mostly general web?

jihyun profil fotoğrafı
jihyun2 gün önce

Congrats @datologyai team! This is the future 🙌

Vivi profil fotoğrafı
Vivi2 gün önce

6x from curation alone is wild

haytam profil fotoğrafı
haytam2 gün önce

Would this help a class project, or only a team already training models?

Pablo profil fotoğrafı
Pablo2 gün önce

Great launch guys🔥🙏🏻

nerea profil fotoğrafı
nerea2 gün önce

love that the data stays in your own vpc, that's the part most teams actually care about

Alegna profil fotoğrafı
Alegna2 gün önce

you guys COOKED

Kevin Moreira profil fotoğrafı
Kevin Moreira2 gün önce

Love the focus on data quality here

alex profil fotoğrafı
alex2 gün önce

the curated vs baseline chart is so clean, that gap says everything

lars profil fotoğrafı
lars2 gün önce

can you plug in your own quality filters?

said profil fotoğrafı
said2 gün önce

about time someone did this congrats guys!

Leila 👩🏻‍💻 profil fotoğrafı
Leila 👩🏻‍💻2 gün önce

Can a small team use this, or do you need a company setup?

carpe profil fotoğrafı
carpe2 gün önce

did the baseline really need six times the compute to match that quality?

Ulises profil fotoğrafı
Ulises2 gün önce

This is a major leap in quality.

liam. profil fotoğrafı
liam.2 gün önce

good models start with good data, couldn't agree more

robin. profil fotoğrafı
robin.2 gün önce

curation finally treated as a product and not a preprocessing script

Marco profil fotoğrafı
Marco2 gün önce

congrats guys w

Stefan Friedman profil fotoğrafı
Stefan Friedman2 gün önce

is there a minimum dataset size where this starts making sense? asking for a small team

Benzer Videolar

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 görüntüleme • 1 yıl önce