Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Here's my conversation with Philip Kiely. A deep dive into inference engineering, his book his available online for free, and it's worth reading. Inference is becoming more important to people and organisations by the day, learning about the topic will prepare you well.

0xSero's profile picture

0xSero

56,814 subscribers

24,290 Aufrufe • vor 8 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering
27:58

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 Aufrufe • vor 3 Monaten

The Rose Field by Philip Pullman is out today: the conclusion to The Book of Dust and His Dark Materials. I narrated the audiobook, and Philip and I had a conversation about the novels and their legacy, which you can hear in full at the end of it:
0:59

The Rose Field by Philip Pullman is out today: the conclusion to The Book of Dust and His Dark Materials. I narrated the audiobook, and Philip and I had a conversation about the novels and their legacy, which you can hear in full at the end of it:

michael sheen 💙

37,696 Aufrufe • vor 8 Monaten

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth
0:41

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

81,834 Aufrufe • vor 3 Monaten

Free, instant access to 1M inference tok/day is excited to launch Cerebras Supernova! Developers get 1M free inference toks/day, and if you're a startup, get up to 3 months FREE of increased context windows, rate limits, and 245M tok/day. All on the world's fastest inference provider. This is the most generous free tier that exists. It really is land of the free...(credits)🇺🇸
0:33

Free, instant access to 1M inference tok/day is excited to launch Cerebras Supernova! Developers get 1M free inference toks/day, and if you're a startup, get up to 3 months FREE of increased context windows, rate limits, and 245M tok/day. All on the world's fastest inference provider. This is the most generous free tier that exists. It really is land of the free...(credits)🇺🇸

Sarah Chieng

122,158 Aufrufe • vor 1 Jahr

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.
1:45

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Oguz Erkan

97,186 Aufrufe • vor 6 Monaten

ryeowook learning to play basketball by reading a book about it, so he could play and get closer with his hyungs will always be one of the cutest and most precious stories i've ever heard about him
0:38

ryeowook learning to play basketball by reading a book about it, so he could play and get closer with his hyungs will always be one of the cutest and most precious stories i've ever heard about him

mint

26,190 Aufrufe • vor 1 Jahr

"Juneteenth is a very important day and it's awesome that more people are learning about it.. Today is a great day and it's a celebration" Darius Butler #PMSLive
3:09

"Juneteenth is a very important day and it's awesome that more people are learning about it.. Today is a great day and it's a celebration" Darius Butler #PMSLive

Pat McAfee

369,846 Aufrufe • vor 21 Tagen

We recently had a Space with Warden to dive into our recent partnership and its role in bringing AI inference on-chain! 🫡 Here's a sneak peak into the Space with Warden Protocol CTO Antonio 👾🛡️ 👇
1:11

We recently had a Space with Warden to dive into our recent partnership and its role in bringing AI inference on-chain! 🫡 Here's a sneak peak into the Space with Warden Protocol CTO Antonio 👾🛡️ 👇

0G Labs (Ø,G) - AI L1

45,256 Aufrufe • vor 1 Jahr

t’s book season…..my book UNCOMMON FAVOR is ready for your learning reading, leisure reading, book club reading, audio listening and all the convenience of just hanging out with you and my book. Super excited to take you on this journey! Link in the bio! #BlackPrivilegePublishing Charlamagne Tha God Atria Books @SimonandSchuster
0:56

t’s book season…..my book UNCOMMON FAVOR is ready for your learning reading, leisure reading, book club reading, audio listening and all the convenience of just hanging out with you and my book. Super excited to take you on this journey! Link in the bio! #BlackPrivilegePublishing Charlamagne Tha God Atria Books @SimonandSchuster

dawnstaley

142,547 Aufrufe • vor 1 Jahr

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”
0:52

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

TBPN

17,057 Aufrufe • vor 10 Monaten

This is why Nvidia bought Groq. If Groq deploys a ton of low-cost inference chips, demand for training will increase massively. The more inference you have, the more training you need, and vice versa. Nvidia can keep its high margins selling chips for training forever.
0:35

This is why Nvidia bought Groq. If Groq deploys a ton of low-cost inference chips, demand for training will increase massively. The more inference you have, the more training you need, and vice versa. Nvidia can keep its high margins selling chips for training forever.

Lin

92,571 Aufrufe • vor 6 Monaten

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider
0:21

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider

Sarah Chieng

120,480 Aufrufe • vor 1 Jahr

Exciting news: I've written a book – and it's available for pre-order today! Visit to pre-order. “The Other Side of Change” is a deep dive into how we find meaning and opportunity in the tumult of change.
2:42

Exciting news: I've written a book – and it's available for pre-order today! Visit to pre-order. “The Other Side of Change” is a deep dive into how we find meaning and opportunity in the tumult of change.

Maya Shankar @ A Slight Change of Plans

26,546 Aufrufe • vor 1 Jahr

18 teens with a mission: to help shape a positive online ecosystem for future generations. See how our inaugural Council for Digital Well-Being tackled tough online safety topics and advanced an important conversation about digital-well being. Read more: and watch the full video:
0:44

18 teens with a mission: to help shape a positive online ecosystem for future generations. See how our inaugural Council for Digital Well-Being tackled tough online safety topics and advanced an important conversation about digital-well being. Read more: and watch the full video:

Snap Inc.

11,672 Aufrufe • vor 9 Monaten

The #NLCS matchup is set! #MLBTonight takes a deep dive into the Brewers and Dodgers as they prepare to battle for the pennant!
4:45

The #NLCS matchup is set! #MLBTonight takes a deep dive into the Brewers and Dodgers as they prepare to battle for the pennant!

MLB Network

45,049 Aufrufe • vor 9 Monaten

In pick the best model > improve your prompts > catch bugs with Braintrust and Cerebras inference. Avoid the AI deleting your entire codebase this halloween and remember, our free tier gets you 1M+ free toks/day per model.
1:16

In pick the best model > improve your prompts > catch bugs with Braintrust and Cerebras inference. Avoid the AI deleting your entire codebase this halloween and remember, our free tier gets you 1M+ free toks/day per model.

Cerebras

299,029 Aufrufe • vor 8 Monaten

The MLPerf results are in! We’re raising the bar with competitive solutions for your high-performance, high-efficiency deep learning inference needs — even on challenging LLMs. Read more about the results. #IntelXeon #IntelGaudi #Intel
0:30

The MLPerf results are in! We’re raising the bar with competitive solutions for your high-performance, high-efficiency deep learning inference needs — even on challenging LLMs. Read more about the results. #IntelXeon #IntelGaudi #Intel

Intel

26,425 Aufrufe • vor 2 Jahren

Henry Shevlin and I were thrilled to be joined by Anil Seth for the latest episode of our AI podcast. The conversation was a deep dive into Anil's very interesting views about consciousness, including his scepticism about the possibility of AI consciousness. (1/2)
1:57

Henry Shevlin and I were thrilled to be joined by Anil Seth for the latest episode of our AI podcast. The conversation was a deep dive into Anil's very interesting views about consciousness, including his scepticism about the possibility of AI consciousness. (1/2)

Dan Williams

13,924 Aufrufe • vor 4 Monaten

I have no idea where this video is from. I found it on Reddit, but this explains humanity so well. This man walks into a Chinese Restaurant for takeout. He immediately begins speaking perfect Chinese, with a perfect accent. He has a conversation with the staff, who calls him "one of us," and then they proceed to give him his food for free. This is humanity. Everyone should take a chance to learn about others, identify with others, and empathize with others. We often see more racist people in small towns rather than in large cities. This isn't necessarily their faults. This is because racism is mostly built on "the unknown" and people tend to fear the unknown. Once you get to know people and befriend people from other races, religions, sexual orientations, gender ideologies, and ethnicities, you have a tendency to better understand where they come from. This is why learning about other cultures, religions, and even languages is so important. It's why studying history, and sociology are important. Reach out to someone you don't identify well with and try to learn about them today. It will help humanity tomorrow.
1:24

I have no idea where this video is from. I found it on Reddit, but this explains humanity so well. This man walks into a Chinese Restaurant for takeout. He immediately begins speaking perfect Chinese, with a perfect accent. He has a conversation with the staff, who calls him "one of us," and then they proceed to give him his food for free. This is humanity. Everyone should take a chance to learn about others, identify with others, and empathize with others. We often see more racist people in small towns rather than in large cities. This isn't necessarily their faults. This is because racism is mostly built on "the unknown" and people tend to fear the unknown. Once you get to know people and befriend people from other races, religions, sexual orientations, gender ideologies, and ethnicities, you have a tendency to better understand where they come from. This is why learning about other cultures, religions, and even languages is so important. It's why studying history, and sociology are important. Reach out to someone you don't identify well with and try to learn about them today. It will help humanity tomorrow.

Ed Krassenstein

5,802,256 Aufrufe • vor 2 Jahren