Loading video...

Video Failed to Load

Go Home

Agentic AI will transform every enterprise–but only if agents are trusted experts. The key: Evaluation & tuning on specialized, expert data. I’m excited to announce two new products to support this–Snorkel AI Evaluate & Expert Data-as-a-Service–along w/ our $100M Series D! --- Snorkel Evaluate is our new data-centric agentic...

50,780 views • 1 year ago •via X (Twitter)

12 Comments

Alex Ratner's profile picture
Alex Ratner1 year ago

📽️ For a deeper dive into Snorkel Evaluate & Expert Data-as-a-Service- check out our walkthrough of building an enterprise agentic AI system in insurance here:

Alex Ratner's profile picture
Alex Ratner1 year ago

📅 Join Snorkel AI and innovators from @Accenture, @Comcast, @Stanford , @QBE, @UWMadison, and more on June 26:

Alex Ratner's profile picture
Alex Ratner1 year ago

📊 Check out the open sourced benchmark dataset preview:

Alex Ratner's profile picture
Alex Ratner1 year ago

📜 And for more detail, read more about the announcement and what it means for the future of agentic AI:

Alex Ratner's profile picture
Alex Ratner1 year ago

🚀 Finally: Thank you to our investors, both existing and new - Addition, @GreylockVC, @Lightspeedvp @qbeventures, @bnyglobal, @prosperity7VC, and others - and launch partners @rox__ai @anthropicAI @awscloud!!

Greg Caplan 🚀's profile picture
Greg Caplan 🚀2 years ago

Stop wasting time following up with leads. Let our AI agents do it for you.

Sen Wu's profile picture
Sen Wu1 year ago

@SnorkelAI Congratulations, Alex and Snorkel team!

Stefano Ermon's profile picture
Stefano Ermon1 year ago

@SnorkelAI Congrats!

Farooq | zo.me's profile picture
Farooq | zo.me1 year ago

@SnorkelAI Agentic AI’s potential hinges on trust and trust starts with data. This move by Snorkel nails that foundation.

Khaled Saab's profile picture
Khaled Saab1 year ago

@SnorkelAI Much needed, especially in the medical domain! Congrats!

David Hendrickson's profile picture
David Hendrickson1 year ago

@SnorkelAI Do you generate more business cleaning data for users or building custom data agents? My clients prefer to learn how to clean their own data and build (& maintain) their own agents.

Alex Ratner's profile picture
Alex Ratner1 year ago

@SnorkelAI Our work is a mix but we love supporting customers in being self-serve via our platform- agree that's a powerful mode to be in!

Related Videos

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 views • 1 year ago