Загрузка видео...

Не удалось загрузить видео

На главную

Today, we’re excited to launch the Datology Curation Studio, customizable frontier data curation for every team training its own models. Data quality is the ultimate compute multiplier, and Curation Studio makes it easy for everyone.

4,269,894 просмотров • 3 дней назад •via X (Twitter)

Комментарии: 39

Фото профиля DatologyAI
DatologyAI3 дней назад

We built the strongest baseline we could by combining the best publicly curated datasets. Curated data led to meaningfully better models, with the baseline needing 6× the compute to match the same quality. That’s the Datology compute multiplier in action.

Фото профиля DatologyAI
DatologyAI3 дней назад

We used the same 39 source datasets—including Nemotron, FineWeb, and The Stack v3—and identical pretraining and post-training recipes to make the most apples-to-apples comparison possible. The only change: data curation. Explore the setup and results:

Фото профиля DatologyAI
DatologyAI3 дней назад

The gains persisted after post-training: our 30B-A3B model scored 46.8% vs. 37.7% for the baseline, averaged across benchmarks. A curated 12B-A1.4B model also beat the 30B-A3B baseline despite using roughly one-fifth of the pretraining compute.

Фото профиля DatologyAI
DatologyAI3 дней назад

Curation Studio puts this process in your hands: Clean → Calibrate → Create → Compose. Bring your data, optimize for your tasks, and keep your data inside your VPC. See how it works:

Фото профиля DatologyAI
DatologyAI3 дней назад

If you want to own your own intelligence, book a demo with our team, or join us live on October 27th to see Curation Studio in action and chat with the team behind the research. Save your seat here:

Фото профиля Vincent Weisser
Vincent Weisser3 дней назад

huge congrats Ari and team!!

Фото профиля stochasm
stochasm3 дней назад

congrats on the launch!!

Фото профиля Felicis
Felicis3 дней назад

🧡🚀we love launch days!!

Фото профиля Astasia Myers
Astasia Myers3 дней назад

So cool to see this out!

Фото профиля Leo
Leo3 дней назад

this is nuts, congrats on the launch!!

Фото профиля z
z3 дней назад

same data, same recipe, just better curation and it's 6x?? y'all cooked fr

Фото профиля Yağız Çalık
Yağız Çalık3 дней назад

exciting, congrats!!

Фото профиля ari.
ari.3 дней назад

so basically it’s not about how big the model is, it’s about what you feed it. kinda makes sense when you think about it

Фото профиля Alba
Alba3 дней назад

Curious, how much does this change when you use a completely different base model?

Фото профиля maria
maria3 дней назад

everyone's buying more gpus and y'all just fixed the data lol, love this

Фото профиля max
max3 дней назад

does it work for fine-tuning too, or just pretraining?

Фото профиля Madeline 💌💐
Madeline 💌💐3 дней назад

What does “customizable” mean if you do not know what good data looks like?

Фото профиля Tiffany Luck
Tiffany Luck3 дней назад

Big day for 'own your intelligence' -- congrats!!

Фото профиля Rodev
Rodev3 дней назад

everyone wants a bigger model until they see the compute bill

Фото профиля rewind
rewind3 дней назад

Congrats team

Фото профиля Ryoru 𒌐
Ryoru 𒌐3 дней назад

Does this mean a lot of models could perform better without getting any bigger?

Фото профиля rachit
rachit3 дней назад

does the 6x hold for domain-specific data too or mostly general web?

Фото профиля jihyun
jihyun3 дней назад

Congrats @datologyai team! This is the future 🙌

Фото профиля Vivi
Vivi3 дней назад

6x from curation alone is wild

Фото профиля haytam
haytam3 дней назад

Would this help a class project, or only a team already training models?

Фото профиля Pablo
Pablo3 дней назад

Great launch guys🔥🙏🏻

Фото профиля nerea
nerea3 дней назад

love that the data stays in your own vpc, that's the part most teams actually care about

Фото профиля Alegna
Alegna3 дней назад

you guys COOKED

Фото профиля Kevin Moreira
Kevin Moreira3 дней назад

Love the focus on data quality here

Фото профиля alex
alex3 дней назад

the curated vs baseline chart is so clean, that gap says everything

Фото профиля lars
lars3 дней назад

can you plug in your own quality filters?

Фото профиля said
said3 дней назад

about time someone did this congrats guys!

Фото профиля Leila 👩🏻‍💻
Leila 👩🏻‍💻3 дней назад

Can a small team use this, or do you need a company setup?

Фото профиля carpe
carpe3 дней назад

did the baseline really need six times the compute to match that quality?

Фото профиля Ulises
Ulises3 дней назад

This is a major leap in quality.

Фото профиля liam.
liam.3 дней назад

good models start with good data, couldn't agree more

Фото профиля robin.
robin.3 дней назад

curation finally treated as a product and not a preprocessing script

Фото профиля Marco
Marco3 дней назад

congrats guys w

Фото профиля Stefan Friedman
Stefan Friedman3 дней назад

is there a minimum dataset size where this starts making sense? asking for a small team

Похожие видео

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 просмотров • 1 год назад