Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today, we’re excited to launch the Datology Curation Studio, customizable frontier data curation for every team training its own models. Data quality is the ultimate compute multiplier, and Curation Studio makes it easy for everyone.

4,269,249 Aufrufe • vor 3 Tagen •via X (Twitter)

39 Kommentare

Profilbild von DatologyAI
DatologyAIvor 3 Tagen

We built the strongest baseline we could by combining the best publicly curated datasets. Curated data led to meaningfully better models, with the baseline needing 6× the compute to match the same quality. That’s the Datology compute multiplier in action.

Profilbild von DatologyAI
DatologyAIvor 3 Tagen

We used the same 39 source datasets—including Nemotron, FineWeb, and The Stack v3—and identical pretraining and post-training recipes to make the most apples-to-apples comparison possible. The only change: data curation. Explore the setup and results:

Profilbild von DatologyAI
DatologyAIvor 3 Tagen

The gains persisted after post-training: our 30B-A3B model scored 46.8% vs. 37.7% for the baseline, averaged across benchmarks. A curated 12B-A1.4B model also beat the 30B-A3B baseline despite using roughly one-fifth of the pretraining compute.

Profilbild von DatologyAI
DatologyAIvor 3 Tagen

Curation Studio puts this process in your hands: Clean → Calibrate → Create → Compose. Bring your data, optimize for your tasks, and keep your data inside your VPC. See how it works:

Profilbild von DatologyAI
DatologyAIvor 3 Tagen

If you want to own your own intelligence, book a demo with our team, or join us live on October 27th to see Curation Studio in action and chat with the team behind the research. Save your seat here:

Profilbild von Vincent Weisser
Vincent Weisservor 3 Tagen

huge congrats Ari and team!!

Profilbild von stochasm
stochasmvor 3 Tagen

congrats on the launch!!

Profilbild von Felicis
Felicisvor 3 Tagen

🧡🚀we love launch days!!

Profilbild von Astasia Myers
Astasia Myersvor 3 Tagen

So cool to see this out!

Profilbild von Leo
Leovor 3 Tagen

this is nuts, congrats on the launch!!

Profilbild von z
zvor 3 Tagen

same data, same recipe, just better curation and it's 6x?? y'all cooked fr

Profilbild von Yağız Çalık
Yağız Çalıkvor 3 Tagen

exciting, congrats!!

Profilbild von ari.
ari.vor 3 Tagen

so basically it’s not about how big the model is, it’s about what you feed it. kinda makes sense when you think about it

Profilbild von Alba
Albavor 3 Tagen

Curious, how much does this change when you use a completely different base model?

Profilbild von maria
mariavor 3 Tagen

everyone's buying more gpus and y'all just fixed the data lol, love this

Profilbild von max
maxvor 3 Tagen

does it work for fine-tuning too, or just pretraining?

Profilbild von Madeline 💌💐
Madeline 💌💐vor 3 Tagen

What does “customizable” mean if you do not know what good data looks like?

Profilbild von Tiffany Luck
Tiffany Luckvor 3 Tagen

Big day for 'own your intelligence' -- congrats!!

Profilbild von Rodev
Rodevvor 3 Tagen

everyone wants a bigger model until they see the compute bill

Profilbild von rewind
rewindvor 3 Tagen

Congrats team

Profilbild von Ryoru 𒌐
Ryoru 𒌐vor 3 Tagen

Does this mean a lot of models could perform better without getting any bigger?

Profilbild von rachit
rachitvor 3 Tagen

does the 6x hold for domain-specific data too or mostly general web?

Profilbild von jihyun
jihyunvor 3 Tagen

Congrats @datologyai team! This is the future 🙌

Profilbild von Vivi
Vivivor 3 Tagen

6x from curation alone is wild

Profilbild von haytam
haytamvor 3 Tagen

Would this help a class project, or only a team already training models?

Profilbild von Pablo
Pablovor 3 Tagen

Great launch guys🔥🙏🏻

Profilbild von nerea
nereavor 3 Tagen

love that the data stays in your own vpc, that's the part most teams actually care about

Profilbild von Alegna
Alegnavor 3 Tagen

you guys COOKED

Profilbild von Kevin Moreira
Kevin Moreiravor 3 Tagen

Love the focus on data quality here

Profilbild von alex
alexvor 3 Tagen

the curated vs baseline chart is so clean, that gap says everything

Profilbild von lars
larsvor 3 Tagen

can you plug in your own quality filters?

Profilbild von said
saidvor 3 Tagen

about time someone did this congrats guys!

Profilbild von Leila 👩🏻‍💻
Leila 👩🏻‍💻vor 3 Tagen

Can a small team use this, or do you need a company setup?

Profilbild von carpe
carpevor 3 Tagen

did the baseline really need six times the compute to match that quality?

Profilbild von Ulises
Ulisesvor 3 Tagen

This is a major leap in quality.

Profilbild von liam.
liam.vor 3 Tagen

good models start with good data, couldn't agree more

Profilbild von robin.
robin.vor 3 Tagen

curation finally treated as a product and not a preprocessing script

Profilbild von Marco
Marcovor 3 Tagen

congrats guys w

Profilbild von Stefan Friedman
Stefan Friedmanvor 3 Tagen

is there a minimum dataset size where this starts making sense? asking for a small team

Ähnliche Videos

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 Aufrufe • vor 1 Jahr