Loading video...

Video Failed to Load

Go Home

Today, we’re excited to launch the Datology Curation Studio, customizable frontier data curation for every team training its own models. Data quality is the ultimate compute multiplier, and Curation Studio makes it easy for everyone.

4,265,085 views • 2 days ago •via X (Twitter)

39 Comments

DatologyAI's profile picture
DatologyAI2 days ago

We built the strongest baseline we could by combining the best publicly curated datasets. Curated data led to meaningfully better models, with the baseline needing 6× the compute to match the same quality. That’s the Datology compute multiplier in action.

DatologyAI's profile picture
DatologyAI2 days ago

We used the same 39 source datasets—including Nemotron, FineWeb, and The Stack v3—and identical pretraining and post-training recipes to make the most apples-to-apples comparison possible. The only change: data curation. Explore the setup and results:

DatologyAI's profile picture
DatologyAI2 days ago

The gains persisted after post-training: our 30B-A3B model scored 46.8% vs. 37.7% for the baseline, averaged across benchmarks. A curated 12B-A1.4B model also beat the 30B-A3B baseline despite using roughly one-fifth of the pretraining compute.

DatologyAI's profile picture
DatologyAI2 days ago

Curation Studio puts this process in your hands: Clean → Calibrate → Create → Compose. Bring your data, optimize for your tasks, and keep your data inside your VPC. See how it works:

DatologyAI's profile picture
DatologyAI2 days ago

If you want to own your own intelligence, book a demo with our team, or join us live on October 27th to see Curation Studio in action and chat with the team behind the research. Save your seat here:

Vincent Weisser's profile picture
Vincent Weisser2 days ago

huge congrats Ari and team!!

stochasm's profile picture
stochasm2 days ago

congrats on the launch!!

Felicis's profile picture
Felicis2 days ago

🧡🚀we love launch days!!

Astasia Myers's profile picture
Astasia Myers2 days ago

So cool to see this out!

Leo's profile picture
Leo2 days ago

this is nuts, congrats on the launch!!

z's profile picture
z2 days ago

same data, same recipe, just better curation and it's 6x?? y'all cooked fr

Yağız Çalık's profile picture
Yağız Çalık2 days ago

exciting, congrats!!

ari.'s profile picture
ari.2 days ago

so basically it’s not about how big the model is, it’s about what you feed it. kinda makes sense when you think about it

Alba's profile picture
Alba2 days ago

Curious, how much does this change when you use a completely different base model?

maria's profile picture
maria2 days ago

everyone's buying more gpus and y'all just fixed the data lol, love this

max's profile picture
max2 days ago

does it work for fine-tuning too, or just pretraining?

Madeline 💌💐's profile picture
Madeline 💌💐2 days ago

What does “customizable” mean if you do not know what good data looks like?

Tiffany Luck's profile picture
Tiffany Luck2 days ago

Big day for 'own your intelligence' -- congrats!!

Rodev's profile picture
Rodev2 days ago

everyone wants a bigger model until they see the compute bill

rewind's profile picture
rewind2 days ago

Congrats team

Ryoru 𒌐's profile picture
Ryoru 𒌐2 days ago

Does this mean a lot of models could perform better without getting any bigger?

rachit's profile picture
rachit2 days ago

does the 6x hold for domain-specific data too or mostly general web?

jihyun's profile picture
jihyun2 days ago

Congrats @datologyai team! This is the future 🙌

Vivi's profile picture
Vivi2 days ago

6x from curation alone is wild

haytam's profile picture
haytam2 days ago

Would this help a class project, or only a team already training models?

Pablo's profile picture
Pablo2 days ago

Great launch guys🔥🙏🏻

nerea's profile picture
nerea2 days ago

love that the data stays in your own vpc, that's the part most teams actually care about

Alegna's profile picture
Alegna2 days ago

you guys COOKED

Kevin Moreira's profile picture
Kevin Moreira2 days ago

Love the focus on data quality here

alex's profile picture
alex2 days ago

the curated vs baseline chart is so clean, that gap says everything

lars's profile picture
lars2 days ago

can you plug in your own quality filters?

said's profile picture
said2 days ago

about time someone did this congrats guys!

Leila 👩🏻‍💻's profile picture
Leila 👩🏻‍💻2 days ago

Can a small team use this, or do you need a company setup?

carpe's profile picture
carpe2 days ago

did the baseline really need six times the compute to match that quality?

Ulises's profile picture
Ulises2 days ago

This is a major leap in quality.

liam.'s profile picture
liam.2 days ago

good models start with good data, couldn't agree more

robin.'s profile picture
robin.2 days ago

curation finally treated as a product and not a preprocessing script

Marco's profile picture
Marco2 days ago

congrats guys w

Stefan Friedman's profile picture
Stefan Friedman2 days ago

is there a minimum dataset size where this starts making sense? asking for a small team

Related Videos

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 views • 1 year ago