Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Agentic AI is exposing the limits of traditional LLM benchmarks—and forcing a rethink of how enterprise AI value is actually measured. Analysts Ryan Shrout & Mitch Lewis join Kamiwaza AI Platform Engineer JV Roig to unpack new research from Signal65 and Kamiwaza that demonstrates why legacy benchmarks miss real-world...

TheSixFiveMedia's profile picture

Six Five Media

4,347 subscribers

166,438 görüntüleme • 8 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Agentic AI will transform every enterprise–but only if agents are trusted experts. The key: Evaluation & tuning on specialized, expert data. I’m excited to announce two new products to support this–Snorkel AI Evaluate & Expert Data-as-a-Service–along w/ our $100M Series D! --- Snorkel Evaluate is our new data-centric agentic AI evaluation platform for specialized, mission-critical enterprise settings where vibe checks and out-of-the-box metrics driven by simple LLM prompts are not enough. Snorkel Expert Data-as-a-Service is our white glove service for expert-level AI datasets, powering frontier LLM developers in areas like expert knowledge, reasoning, agentic action and tool use, and more! Both built on top of Snorkel AI’s Data Development Platform, using our programmatic technology to drive higher-quality expert data, faster– for getting specialized AI to real production value. If you’re building enterprise AI and want to partner around the key ingredient in AI today–the data–book a demo and let's talk! Finally, see thread for details on 🧵👇 - 📽️ A walkthrough of Snorkel Evaluate and Expert Data-as-a-Service on an agentic AI enterprise task - 📅 An upcoming event on Enterprise Agentic AI with innovators from Accenture @BNY Comcast Stanford University QBE & others - 📊 An upcoming series of benchmark datasets and model artifact releases 👀 Want early access to the full agentic AI dataset? Retweet this post and we'll send you the link!
5:42

Agentic AI will transform every enterprise–but only if agents are trusted experts. The key: Evaluation & tuning on specialized, expert data. I’m excited to announce two new products to support this–Snorkel AI Evaluate & Expert Data-as-a-Service–along w/ our $100M Series D! --- Snorkel Evaluate is our new data-centric agentic AI evaluation platform for specialized, mission-critical enterprise settings where vibe checks and out-of-the-box metrics driven by simple LLM prompts are not enough. Snorkel Expert Data-as-a-Service is our white glove service for expert-level AI datasets, powering frontier LLM developers in areas like expert knowledge, reasoning, agentic action and tool use, and more! Both built on top of Snorkel AI’s Data Development Platform, using our programmatic technology to drive higher-quality expert data, faster– for getting specialized AI to real production value. If you’re building enterprise AI and want to partner around the key ingredient in AI today–the data–book a demo and let's talk! Finally, see thread for details on 🧵👇 - 📽️ A walkthrough of Snorkel Evaluate and Expert Data-as-a-Service on an agentic AI enterprise task - 📅 An upcoming event on Enterprise Agentic AI with innovators from Accenture @BNY Comcast Stanford University QBE & others - 📊 An upcoming series of benchmark datasets and model artifact releases 👀 Want early access to the full agentic AI dataset? Retweet this post and we'll send you the link!

Alex Ratner

50,555 görüntüleme • 1 yıl önce

Missed the live session? Watch the replay of Gemini Enterprise: APAC in Focus. Learn what Gemini Enterprise means for businesses, and how our new agentic AI platform will transform work ⤵️
1:01:44

Missed the live session? Watch the replay of Gemini Enterprise: APAC in Focus. Learn what Gemini Enterprise means for businesses, and how our new agentic AI platform will transform work ⤵️

Google Cloud India

10,870,985 görüntüleme • 10 ay önce

Building AI agents without technical skills is now a reality. Marc Revert, founder of Orga AI, shares how agentic AI is accessible to everyone. Move from chatbots to AI that autonomously executes actions. Automate workflows, manage calendars, and accelerate research. Redefine how you work.
0:39

Building AI agents without technical skills is now a reality. Marc Revert, founder of Orga AI, shares how agentic AI is accessible to everyone. Move from chatbots to AI that autonomously executes actions. Automate workflows, manage calendars, and accelerate research. Redefine how you work.

AWS Startups

59,524,516 görüntüleme • 5 ay önce

The ultimate local AI developer platform is here. AMD Ryzen AI Halo presale is now live! Built for #AMDevs, Ryzen AI Halo delivers the performance, memory, and AI capabilities needed to build, test, and run agentic AI, generative AI, LLM applications, and more locally. Reserve yours now:
1:24

The ultimate local AI developer platform is here. AMD Ryzen AI Halo presale is now live! Built for #AMDevs, Ryzen AI Halo delivers the performance, memory, and AI capabilities needed to build, test, and run agentic AI, generative AI, LLM applications, and more locally. Reserve yours now:

AI at AMD

19,563 görüntüleme • 3 ay önce

Agentic AI is only as strong as the search foundation beneath it. At AWS re:Invent 2025, Nick Patience and Elastic’s GM of Search Solutions, Steve Kearns (Steve Kearns), break down how enterprises are moving from classic RAG to autonomous, production-grade agentic systems—and how Elasticsearch is enabling more autonomous, reliable enterprise workflows.
16:32

Agentic AI is only as strong as the search foundation beneath it. At AWS re:Invent 2025, Nick Patience and Elastic’s GM of Search Solutions, Steve Kearns (Steve Kearns), break down how enterprises are moving from classic RAG to autonomous, production-grade agentic systems—and how Elasticsearch is enabling more autonomous, reliable enterprise workflows.

Six Five Media

223,766 görüntüleme • 9 ay önce

Google engineer: "Build self-learning agentic workflows that work for you 24/7 with loops and graphs - that's the new job! at Google, 90% of engineers are running at least 50 agentic workflows, that's the new "era of engineering" in 1-hour interview, a Google engineer explains how the future of AI engineering will look like worth more than 10 paid agentic courses watch it today, then read how to run a self-improving agentic system in the article below
55:34

Google engineer: "Build self-learning agentic workflows that work for you 24/7 with loops and graphs - that's the new job! at Google, 90% of engineers are running at least 50 agentic workflows, that's the new "era of engineering" in 1-hour interview, a Google engineer explains how the future of AI engineering will look like worth more than 10 paid agentic courses watch it today, then read how to run a self-improving agentic system in the article below

Movez

12,927 görüntüleme • 1 ay önce

The best way to understand Agentic AI isn’t by reading about it -> it’s by using it. Meet OptimAI Persona Agentic System - where your AI becomes you: it writes how you speak, thinks how you think, and acts with context, memory, and awareness. 👉 Not a chatbot. A digital extension of yourself. The world will soon run on Agentic AI. Early users won’t just use it, they’ll shape it.
0:31

The best way to understand Agentic AI isn’t by reading about it -> it’s by using it. Meet OptimAI Persona Agentic System - where your AI becomes you: it writes how you speak, thinks how you think, and acts with context, memory, and awareness. 👉 Not a chatbot. A digital extension of yourself. The world will soon run on Agentic AI. Early users won’t just use it, they’ll shape it.

OptimAI Network

20,547 görüntüleme • 9 ay önce

The agentic enterprise is here. We’re unveiling new innovations across AI agents, real-time data, governance, & interoperability to help enterprises build AI that can reason, automate, and drive action at scale. Check out the highlights 👇
3:17

The agentic enterprise is here. We’re unveiling new innovations across AI agents, real-time data, governance, & interoperability to help enterprises build AI that can reason, automate, and drive action at scale. Check out the highlights 👇

Snowflake

25,684 görüntüleme • 3 ay önce

Sat down with Kari Ann Briski, VP of Generative AI Software for Enterprise @ NVIDIA, to discuss NVIDIA’s Nemotron open models, how training data can be used for building agentic systems, and scaled AI enterprise adoption. Thank you to Kari NVIDIA AI Developer for taking the time!
10:17

Sat down with Kari Ann Briski, VP of Generative AI Software for Enterprise @ NVIDIA, to discuss NVIDIA’s Nemotron open models, how training data can be used for building agentic systems, and scaled AI enterprise adoption. Thank you to Kari NVIDIA AI Developer for taking the time!

amit

65,120 görüntüleme • 8 ay önce

Dell cut 900 internal AI projects to 13. The payoff: agentic AI helped decouple revenue growth from costs for the first time in its history. John Roese (John Roese), longtime CTO and AI Chief of Dell Technologies, opened our Summit’s AI Infrastructure Track at Six Five Summit, where he spoke w/ David Nicholson on to discuss how agentic AI is reshaping work across the company and actually moving the needle, in a big way. $DELL
25:43

Dell cut 900 internal AI projects to 13. The payoff: agentic AI helped decouple revenue growth from costs for the first time in its history. John Roese (John Roese), longtime CTO and AI Chief of Dell Technologies, opened our Summit’s AI Infrastructure Track at Six Five Summit, where he spoke w/ David Nicholson on to discuss how agentic AI is reshaping work across the company and actually moving the needle, in a big way. $DELL

Six Five Media

35,827 görüntüleme • 12 gün önce

Before founding Vals AI, Rayan Krishnan was a college radio host. We're thrilled to get him back in his element with Vivek Gopalan, this time talking all things benchmarks and evals. As AI capabilities compound, measuring them is becoming both harder and more important. What started as an academic exercise is quickly evolving into critical infrastructure for understanding what AI systems can actually do, and how they perform in the real world. Rayan and Vivek go deep on how benchmarks are evolving, measuring increasingly agentic systems, the weird and wonderful ways we test intelligence, the global AI race, and why evals sit on the critical path to ASI. 0:44 Importance and evolution of benchmarks 8:16 From academic artifact → real-world value 10:57 The next generation of benchmarks 13:34 Benchmarking models vs. agents 16:20 Building benchmarks for organizations 22:09 Weird and wonderful benchmarks 25:58 The AI arms race: US vs. China 31:02 Why evals are on the critical path to ASI 32:50 Vals Series A
34:33

Before founding Vals AI, Rayan Krishnan was a college radio host. We're thrilled to get him back in his element with Vivek Gopalan, this time talking all things benchmarks and evals. As AI capabilities compound, measuring them is becoming both harder and more important. What started as an academic exercise is quickly evolving into critical infrastructure for understanding what AI systems can actually do, and how they perform in the real world. Rayan and Vivek go deep on how benchmarks are evolving, measuring increasingly agentic systems, the weird and wonderful ways we test intelligence, the global AI race, and why evals sit on the critical path to ASI. 0:44 Importance and evolution of benchmarks 8:16 From academic artifact → real-world value 10:57 The next generation of benchmarks 13:34 Benchmarking models vs. agents 16:20 Building benchmarks for organizations 22:09 Weird and wonderful benchmarks 25:58 The AI arms race: US vs. China 31:02 Why evals are on the critical path to ASI 32:50 Vals Series A

8VC

105,337 görüntüleme • 1 ay önce

Text-to-SQL is dead 💀 The next generation of querying is agentic - and it’s already here. This paper ( introduces a type of agentic querying called 𝗙𝘂𝗻𝗰𝘁𝗶𝗼𝗻 𝗖𝗮𝗹𝗹𝗶𝗻𝗴 that uses an LLM to structure queries using predefined function calls in JSON format, with optional arguments for search, filters, aggregation, and grouping. Along with that, it also tests out a bunch of different models with a new dataset, DBGorilla, designed to evaluate agentic querying techniques on real-world use cases. Weaviate AI Database also just released a 𝗤𝘂𝗲𝗿𝘆 𝗔𝗴𝗲𝗻𝘁, designed based on some of the work in this paper, to handle advanced agentic querying out of the box, find out more here:
3:32

Text-to-SQL is dead 💀 The next generation of querying is agentic - and it’s already here. This paper ( introduces a type of agentic querying called 𝗙𝘂𝗻𝗰𝘁𝗶𝗼𝗻 𝗖𝗮𝗹𝗹𝗶𝗻𝗴 that uses an LLM to structure queries using predefined function calls in JSON format, with optional arguments for search, filters, aggregation, and grouping. Along with that, it also tests out a bunch of different models with a new dataset, DBGorilla, designed to evaluate agentic querying techniques on real-world use cases. Weaviate AI Database also just released a 𝗤𝘂𝗲𝗿𝘆 𝗔𝗴𝗲𝗻𝘁, designed based on some of the work in this paper, to handle advanced agentic querying out of the box, find out more here:

Victoria Slocum

189,664 görüntüleme • 1 yıl önce

Strong Q1 for Snowflake. ❄️ $1.33B product revenue, up 34% YoY. Accelerating from 30% last quarter and 26% a year ago. AI is strengthening Snowflake on multiple levels: → core platform growth accelerating as customers get their data AI-ready → AI products Snowflake Intelligence and CoCo seeing rapid adoption → use of AI products increasing overall platform consumption This is the flywheel of the Agentic Enterprise.
0:22

Strong Q1 for Snowflake. ❄️ $1.33B product revenue, up 34% YoY. Accelerating from 30% last quarter and 26% a year ago. AI is strengthening Snowflake on multiple levels: → core platform growth accelerating as customers get their data AI-ready → AI products Snowflake Intelligence and CoCo seeing rapid adoption → use of AI products increasing overall platform consumption This is the flywheel of the Agentic Enterprise.

sridhar

26,599 görüntüleme • 3 ay önce

There is a massive AI opportunity within the marketing category. Listen in on Checkmate's master plan to own the enterprise marketing stack for brands with agentic AI: cc: @law_and_rorder and Rho for the support
24:27

There is a massive AI opportunity within the marketing category. Listen in on Checkmate's master plan to own the enterprise marketing stack for brands with agentic AI: cc: @law_and_rorder and Rho for the support

Nichole Wischoff

12,229 görüntüleme • 7 ay önce

And this just in ... Snowflake and Anthropic are expanding our work across Snowflake Cortex AI – with Claude powering Snowflake Cortex Code and Snowflake Intelligence – as well as Claude Marketplace. 🚀 As more organizations use Anthropic Claude models directly inside Snowflake, demand continues to grow for governed, production-ready AI that delivers the security, observability, and scale enterprises require. Together, Snowflake and Anthropic are helping accelerate enterprise AI adoption and build the foundation for the agentic enterprise. See how we’re building it together, and how customers are using Snowflake and Anthropic to power real-world AI use cases across their organizations:
0:35

And this just in ... Snowflake and Anthropic are expanding our work across Snowflake Cortex AI – with Claude powering Snowflake Cortex Code and Snowflake Intelligence – as well as Claude Marketplace. 🚀 As more organizations use Anthropic Claude models directly inside Snowflake, demand continues to grow for governed, production-ready AI that delivers the security, observability, and scale enterprises require. Together, Snowflake and Anthropic are helping accelerate enterprise AI adoption and build the foundation for the agentic enterprise. See how we’re building it together, and how customers are using Snowflake and Anthropic to power real-world AI use cases across their organizations:

Snowflake

11,191 görüntüleme • 3 ay önce

Our CEO Jensen Huang and Dell Technologies Chairman & CEO Michael Dell kicked things off at #DellTechWorld in Las Vegas with a look at how the Dell AI Factory with NVIDIA is redefining how companies build, run, and scale AI. We saw NemoClaw powering agentic AI on-prem, robots demonstrating physical AI in the real world, and sessions packed with enterprise use cases.
0:30

Our CEO Jensen Huang and Dell Technologies Chairman & CEO Michael Dell kicked things off at #DellTechWorld in Las Vegas with a look at how the Dell AI Factory with NVIDIA is redefining how companies build, run, and scale AI. We saw NemoClaw powering agentic AI on-prem, robots demonstrating physical AI in the real world, and sessions packed with enterprise use cases.

NVIDIA

93,829 görüntüleme • 3 ay önce

Andrew Ng just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to agentic knowledge Graphs • 03:07 - Construction of agentic Graphs • 14:00 - Architecture of multi-agent systems • 23:00 - Building agentic graphs with Google ADK • 01:06:03 - Why Graphsare the future of agentic AI Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.
1:06:27

Andrew Ng just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to agentic knowledge Graphs • 03:07 - Construction of agentic Graphs • 14:00 - Architecture of multi-agent systems • 23:00 - Building agentic graphs with Google ADK • 01:06:03 - Why Graphsare the future of agentic AI Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.

Codez

467,586 görüntüleme • 2 ay önce

Building an AI factory is the next industrial revolution for the modern enterprise. In this episode of the NVIDIA AI Podcast, Justin Boitano, VP and GM of Enterprise Computing at NVIDIA, and Chris Wright, CTO and SVP of Global Engineering at Red Hat AI, break down the "five-layer cake" and the rise of autonomous agentic systems. 🎙️ Listen to the episode:
1:39

Building an AI factory is the next industrial revolution for the modern enterprise. In this episode of the NVIDIA AI Podcast, Justin Boitano, VP and GM of Enterprise Computing at NVIDIA, and Chris Wright, CTO and SVP of Global Engineering at Red Hat AI, break down the "five-layer cake" and the rise of autonomous agentic systems. 🎙️ Listen to the episode:

NVIDIA AI

11,297 görüntüleme • 6 ay önce