正在加载视频...

视频加载失败

Today, we’re excited to launch the Datology Curation Studio, customizable frontier data curation for every team training its own models. Data quality is the ultimate compute multiplier, and Curation Studio makes it easy for everyone.

4,265,085 次观看 • 2 天前 •via X (Twitter)

39 条评论

DatologyAI 的头像
DatologyAI2 天前

We built the strongest baseline we could by combining the best publicly curated datasets. Curated data led to meaningfully better models, with the baseline needing 6× the compute to match the same quality. That’s the Datology compute multiplier in action.

DatologyAI 的头像
DatologyAI2 天前

We used the same 39 source datasets—including Nemotron, FineWeb, and The Stack v3—and identical pretraining and post-training recipes to make the most apples-to-apples comparison possible. The only change: data curation. Explore the setup and results:

DatologyAI 的头像
DatologyAI2 天前

The gains persisted after post-training: our 30B-A3B model scored 46.8% vs. 37.7% for the baseline, averaged across benchmarks. A curated 12B-A1.4B model also beat the 30B-A3B baseline despite using roughly one-fifth of the pretraining compute.

DatologyAI 的头像
DatologyAI2 天前

Curation Studio puts this process in your hands: Clean → Calibrate → Create → Compose. Bring your data, optimize for your tasks, and keep your data inside your VPC. See how it works:

DatologyAI 的头像
DatologyAI2 天前

If you want to own your own intelligence, book a demo with our team, or join us live on October 27th to see Curation Studio in action and chat with the team behind the research. Save your seat here:

Vincent Weisser 的头像
Vincent Weisser2 天前

huge congrats Ari and team!!

stochasm 的头像
stochasm2 天前

congrats on the launch!!

Felicis 的头像
Felicis2 天前

🧡🚀we love launch days!!

Astasia Myers 的头像
Astasia Myers2 天前

So cool to see this out!

Leo 的头像
Leo2 天前

this is nuts, congrats on the launch!!

z 的头像
z2 天前

same data, same recipe, just better curation and it's 6x?? y'all cooked fr

Yağız Çalık 的头像
Yağız Çalık2 天前

exciting, congrats!!

ari. 的头像
ari.2 天前

so basically it’s not about how big the model is, it’s about what you feed it. kinda makes sense when you think about it

Alba 的头像
Alba2 天前

Curious, how much does this change when you use a completely different base model?

maria 的头像
maria2 天前

everyone's buying more gpus and y'all just fixed the data lol, love this

max 的头像
max2 天前

does it work for fine-tuning too, or just pretraining?

Madeline 💌💐 的头像
Madeline 💌💐2 天前

What does “customizable” mean if you do not know what good data looks like?

Tiffany Luck 的头像
Tiffany Luck2 天前

Big day for 'own your intelligence' -- congrats!!

Rodev 的头像
Rodev2 天前

everyone wants a bigger model until they see the compute bill

rewind 的头像
rewind2 天前

Congrats team

Ryoru 𒌐 的头像
Ryoru 𒌐2 天前

Does this mean a lot of models could perform better without getting any bigger?

rachit 的头像
rachit2 天前

does the 6x hold for domain-specific data too or mostly general web?

jihyun 的头像
jihyun2 天前

Congrats @datologyai team! This is the future 🙌

Vivi 的头像
Vivi2 天前

6x from curation alone is wild

haytam 的头像
haytam2 天前

Would this help a class project, or only a team already training models?

Pablo 的头像
Pablo2 天前

Great launch guys🔥🙏🏻

nerea 的头像
nerea2 天前

love that the data stays in your own vpc, that's the part most teams actually care about

Alegna 的头像
Alegna2 天前

you guys COOKED

Kevin Moreira 的头像
Kevin Moreira2 天前

Love the focus on data quality here

alex 的头像
alex2 天前

the curated vs baseline chart is so clean, that gap says everything

lars 的头像
lars2 天前

can you plug in your own quality filters?

said 的头像
said2 天前

about time someone did this congrats guys!

Leila 👩🏻‍💻 的头像
Leila 👩🏻‍💻2 天前

Can a small team use this, or do you need a company setup?

carpe 的头像
carpe2 天前

did the baseline really need six times the compute to match that quality?

Ulises 的头像
Ulises2 天前

This is a major leap in quality.

liam. 的头像
liam.2 天前

good models start with good data, couldn't agree more

robin. 的头像
robin.2 天前

curation finally treated as a product and not a preprocessing script

Marco 的头像
Marco2 天前

congrats guys w

Stefan Friedman 的头像
Stefan Friedman2 天前

is there a minimum dataset size where this starts making sense? asking for a small team

相关视频

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 次观看 • 1 年前