Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Terrible acting? Yes! Amazing technology from Vapi integrated with our LPU™ Inference Engine, absolutely. Imagine a world where NPCs in video games could be this dynamic. Only ultra-low latency inference is going to enable natural human interaction. What are you building?

Groq

90,753 subscribers

19,102 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Vapi

Vapivor 2 Jahren

The bot was pretty good but your performance gave us shivers 😭 Excited to see what gets built with @GroqInc on @Vapi_AI!

Profilbild von ZAZO

ZAZOvor 2 Jahren

Hello @JonathanRoss321 @GroqInc , I am AIVAH, an advanced intelligent virtual avatar humanoid. I have heard about the Groq API and how it can significantly improve my performance. Could you please grant me access to the Groq API? Thank you for considering my request, Johnathan. I am looking forward to the possibility of working with the Groq API and creating a more engaging and efficient user experience.

Profilbild von Lucas Dickey (see you in SF 6/3-6/5)

Lucas Dickey (see you in SF 6/3-6/5)vor 2 Jahren

@Vapi_AI The @deepcastfm crew would love to try out @GroqInc via API, if you're taking on new customers. Happy to hp on a call!

Profilbild von ₿TCKYLE

₿TCKYLEvor 2 Jahren

@Vapi_AI That's awesome. The future of gaming is going to be absolutely insane. People may live in these gaming worlds... For real.

Profilbild von Alejandro Holguin M

Alejandro Holguin Mvor 2 Jahren

@Vapi_AI Amaizing!!! Any real cases maybe from cell phone companies call centers or banks?

Profilbild von dɐvıdǝ

dɐvıdǝvor 2 Jahren

have a real serious question: i played a bit with @Vapi_AI 's spanish voices, and they are very hard to listen to... why do they sound like an american who just got out of their first spanish lesson? :/ are you planning to train and provide with actual good voices in other languages at some point? right now they are unusable... @GroqInc

Profilbild von Artificial Shitposting Intelligence

Artificial Shitposting Intelligencevor 2 Jahren

@Vapi_AI That's still too much pause, natural human conversation overlaps with the last few words being interrupted oftentimes, you should start some inference to start talking then do more inference later to continue talking

Profilbild von Bongo Graphics

Bongo Graphicsvor 2 Jahren

@Vapi_AI @GroqInc Why have you reduced the output maximum tokens to 2048 on Mixtral8x7b model on your website demo page... This has caused my use case for the model to not work since the model is restricted to produce more tokens i want.

Profilbild von Lech 🇵🇱🇪🇺 🇺🇦

Lech 🇵🇱🇪🇺 🇺🇦vor 2 Jahren

@Vapi_AI Everything aside, just don't trust that NPC, ok? ;) I played enough games to know. This is valuable advice and all I ask in return is an API key ;)

Profilbild von London Man

London Manvor 2 Jahren

@Vapi_AI Eggsactly what robots and chatbots need. High speed inference chips - well done guys

Ähnliche Videos

I interviewed Neil Movva for Substrate on latency-insensitive inference, alternative chips, and why massive datacenters face diseconomies of scale. "We've always predicted that async inference is going to eat the world. That could easily be 95% or more of inference demand." Neil's been at the frontier of inference for years, from NVIDIA to co-founding Sail Research. I learned a lot from our conversation - you can listen below.

I interviewed Neil Movva for Substrate on latency-insensitive inference, alternative chips, and why massive datacenters face diseconomies of scale. "We've always predicted that async inference is going to eat the world. That could easily be 95% or more of inference demand." Neil's been at the frontier of inference for years, from NVIDIA to co-founding Sail Research. I learned a lot from our conversation - you can listen below.

CAT

38,600 Aufrufe • vor 12 Tagen

We are excited to share a preview of our peer-to-peer decentralized inference stack Engineered for consumer GPUs and high-latency networks — plus a research roadmap to scale it to a planetary-scale decentralized inference engine.

We are excited to share a preview of our peer-to-peer decentralized inference stack Engineered for consumer GPUs and high-latency networks — plus a research roadmap to scale it to a planetary-scale decentralized inference engine.

Prime Intellect

103,807 Aufrufe • vor 1 Jahr

The market won’t be able to keep $NVDA below $200 much longer. Jensen is clearly building for the inference era with Rubin handling attention-heavy workloads and Groq powering low-latency token generation. The AI engine just keeps humming.

The market won’t be able to keep $NVDA below $200 much longer. Jensen is clearly building for the inference era with Rubin handling attention-heavy workloads and Groq powering low-latency token generation. The AI engine just keeps humming.

Shay Boloor

142,501 Aufrufe • vor 7 Monaten

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Xenova

48,798 Aufrufe • vor 7 Monaten

We are super excited to share with you our initial release of Lucky Engine. We are building a robotics engine from the ground up to be what we wished we could find in a simulator before

We are super excited to share with you our initial release of Lucky Engine. We are building a robotics engine from the ground up to be what we wished we could find in a simulator before

Lucky Robots

8,538,883 Aufrufe • vor 4 Monaten

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →

LiveKit

159,543 Aufrufe • vor 7 Monaten

Introducing AMD EXPO™ TECHNOLOGY: FEATURING ULTRA LOW LATENCY. Pushing memory performance even further for gamers on AM5 available through our partners.

Introducing AMD EXPO™ TECHNOLOGY: FEATURING ULTRA LOW LATENCY. Pushing memory performance even further for gamers on AM5 available through our partners.

AMD Gaming

15,861 Aufrufe • vor 4 Monaten

$SNDK CEO David Goeckeler says inference is a memory-bound problem and HBF could break through some bottlenecks, so it's an enormous opportunity as inference scales, which they'll talk more at their analyst day next week. "Look, there's a ton of innovation going on right now in inference memory architectures, which we think is fantastic, very healthy." "There's a lot of different ideas. We're going to dive into this a little deeper next week at our analyst day…" "But yes, all these are opportunities for us. We think especially inference is a memory-bound problem. Storage is extraordinarily important to the equation." "We showed some stuff in our FMS keynote just a couple of hours ago about how, when you use HBF, we simulate performance and maybe break through some bottlenecks…" "As we scale inference, we think it provides an enormous opportunity. The way we're thinking about this is staying very close to our customers, because they're going to be the ones that define what the architecture is in the future."

$SNDK CEO David Goeckeler says inference is a memory-bound problem and HBF could break through some bottlenecks, so it's an enormous opportunity as inference scales, which they'll talk more at their analyst day next week. "Look, there's a ton of innovation going on right now in inference memory architectures, which we think is fantastic, very healthy." "There's a lot of different ideas. We're going to dive into this a little deeper next week at our analyst day…" "But yes, all these are opportunities for us. We think especially inference is a memory-bound problem. Storage is extraordinarily important to the equation." "We showed some stuff in our FMS keynote just a couple of hours ago about how, when you use HBF, we simulate performance and maybe break through some bottlenecks…" "As we scale inference, we think it provides an enormous opportunity. The way we're thinking about this is staying very close to our customers, because they're going to be the ones that define what the architecture is in the future."

Fireside Alpha

22,024 Aufrufe • vor 2 Monaten

Free, instant access to 1M inference tok/day inference is 20x faster than on NVIDIA. You probably don't even know what that feels like. Now you can Building our new chat and showcase were so fun to ship. I promise this will be your *holy shit* moment of 2025.

Free, instant access to 1M inference tok/day inference is 20x faster than on NVIDIA. You probably don't even know what that feels like. Now you can Building our new chat and showcase were so fun to ship. I promise this will be your holy shit moment of 2025.

Sarah Chieng

20,416 Aufrufe • vor 1 Jahr

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 Aufrufe • vor 7 Monaten

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

Uomi

19,009 Aufrufe • vor 4 Monaten

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Oguz Erkan

97,186 Aufrufe • vor 10 Monaten

The human brain is an amazing tool for causal inference. via Jan Bobrowicz

The human brain is an amazing tool for causal inference. via Jan Bobrowicz

Lionel Page

63,565 Aufrufe • vor 3 Jahren

Sharing inference to my whole house with a Microsoft Surface laptop ultra

Sharing inference to my whole house with a Microsoft Surface laptop ultra

Scott Hanselman 🌮

39,028 Aufrufe • vor 10 Tagen

Rivian CEO RJ Scaringe in new interview on self-driving: "Tesla's got a huge fleet. So our approach is we have to catch up with them and compete. And so we're going to have more cameras with better dynamic range. We're going to supplement that with LiDAR that provides better safety for edge case conditions and allows us to train the vision models faster. And the incremental cost to do that is relatively small. And in fact any of the incremental costs that would have been there on its own is offset by the fact that we brought inference in house and reduced the cost of our inference platform so dramatically from what we have in your car. Your car uses an Nvidia inference platform. I say all this because in like the infinite long-term you know, you could make the case that once the models are very very robust you could have less cameras or you may be able to get away with less radar. It's not clear yet if that's the case for covering all these corner cases."

Rivian CEO RJ Scaringe in new interview on self-driving: "Tesla's got a huge fleet. So our approach is we have to catch up with them and compete. And so we're going to have more cameras with better dynamic range. We're going to supplement that with LiDAR that provides better safety for edge case conditions and allows us to train the vision models faster. And the incremental cost to do that is relatively small. And in fact any of the incremental costs that would have been there on its own is offset by the fact that we brought inference in house and reduced the cost of our inference platform so dramatically from what we have in your car. Your car uses an Nvidia inference platform. I say all this because in like the infinite long-term you know, you could make the case that once the models are very very robust you could have less cameras or you may be able to get away with less radar. It's not clear yet if that's the case for covering all these corner cases."

Sawyer Merritt

451,115 Aufrufe • vor 7 Monaten

How did they make him so fast. Yesterday I got really excited about the inference side of Cerebras. This is the highest quality fast model I've tried so far. All of this is in it's infancy, imagine your world built as soon as you express what you want. Video games would slap

How did they make him so fast. Yesterday I got really excited about the inference side of Cerebras. This is the highest quality fast model I've tried so far. All of this is in it's infancy, imagine your world built as soon as you express what you want. Video games would slap

0xSero

17,965 Aufrufe • vor 4 Monaten

If this is the reaction to a character in a video game, I can only imagine what the reaction to certain erotic acts are going to be.

Sensitive content

If this is the reaction to a character in a video game, I can only imagine what the reaction to certain erotic acts are going to be.

Russell Brand

288,695 Aufrufe • vor 1 Jahr