Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Scale Python AI workloads from a single notebook to thousands of CPUs/GPUs. In #AzureFriday, Scott Hanselman 🌮 talks with Omar Shorbaji about building, training, and serving AI apps on Anyscale on Azure, powered by Ray, and running on AKS (without managing Kubernetes). Watch:

Microsoft Azure

1,068,362 subscribers

16,550 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

In this episode of #AzureFriday, Scott Hanselman 🌮 and Charles Feddersen explore Azure HorizonDB, covering performance and scale, AI Pipelines, and AI-powered PostgreSQL developer productivity using VS Code. Watch now:

In this episode of #AzureFriday, Scott Hanselman 🌮 and Charles Feddersen explore Azure HorizonDB, covering performance and scale, AI Pipelines, and AI-powered PostgreSQL developer productivity using VS Code. Watch now:

Microsoft Azure

14,581 views • 1 month ago

Scale PostgreSQL reads the easy way. In #AzureFriday, Scott Hanselman 🌮 and Paula Berenguel show how PostgreSQL on Azure uses read replicas and virtual endpoints to handle heavy read workloads, just like OpenAI powers ChatGPT on Postgres. Watch now:

Scale PostgreSQL reads the easy way. In #AzureFriday, Scott Hanselman 🌮 and Paula Berenguel show how PostgreSQL on Azure uses read replicas and virtual endpoints to handle heavy read workloads, just like OpenAI powers ChatGPT on Postgres. Watch now:

Microsoft Azure

31,099 views • 26 days ago

Building AI infrastructure at yotta-scale requires more than raw performance; it demands an open, modular rack design that can evolve across product generations, combining leadership compute engines with high-speed networking to connect thousands of accelerators into a single, unified system. Take a look at the Helios. Our rack-scale AI platform powered by MI455X GPUs and EPYC “Venice” CPUs and designed for trillion-parameter training.

Building AI infrastructure at yotta-scale requires more than raw performance; it demands an open, modular rack design that can evolve across product generations, combining leadership compute engines with high-speed networking to connect thousands of accelerators into a single, unified system. Take a look at the Helios. Our rack-scale AI platform powered by MI455X GPUs and EPYC “Venice” CPUs and designed for trillion-parameter training.

AMD

20,832 views • 7 months ago

Exciting to see the new RTX 50-series GPUs and Windows Subsystem for Linux powering models from Nvidia NIM and Azure AI Foundry on Windows 11 PCs. A game-changer for running AI on the edge.

Exciting to see the new RTX 50-series GPUs and Windows Subsystem for Linux powering models from Nvidia NIM and Azure AI Foundry on Windows 11 PCs. A game-changer for running AI on the edge.

Satya Nadella

235,041 views • 1 year ago

Dylan Patel: “CPUs are sold out.” $INTC earnings and conference call confirmed the looming CPU shortage. There are three main drivers: - Agentic systems, as CPUs do the planning and orchestration. - Increasing complexity of and demand for reinforcement learning environments that run on CPUs. - Increasing deployment of AI instilled apps. Models run on GPUs but apps themselves run on CPUs. Demand for all these will grow secularly as AI systems will only get more agentic, RL environments will only get more complex, and deployment will only accelerate. As a result, GPU-to-CPU ratio in AI workloads will move from 1:8 to 1:2 or maybe even 1:1 in the future. CPU supercycle is about to start. $AMD $INTC $ARM

Dylan Patel: “CPUs are sold out.” $INTC earnings and conference call confirmed the looming CPU shortage. There are three main drivers: - Agentic systems, as CPUs do the planning and orchestration. - Increasing complexity of and demand for reinforcement learning environments that run on CPUs. - Increasing deployment of AI instilled apps. Models run on GPUs but apps themselves run on CPUs. Demand for all these will grow secularly as AI systems will only get more agentic, RL environments will only get more complex, and deployment will only accelerate. As a result, GPU-to-CPU ratio in AI workloads will move from 1:8 to 1:2 or maybe even 1:1 in the future. CPU supercycle is about to start. $AMD $INTC $ARM

Oguz Erkan

93,419 views • 4 months ago

Today, we’re excited to announce and launch Reflex Cloud on Product Hunt! Reflex is an open-source framework for building and deploying data and AI web apps in pure Python. Frontend and Backend in Pure Python: No JavaScript required! With Reflex Cloud, you can now deploy, manage, and scale your Python apps with just a single command! If you're a Python developer, an upvote or a share would mean a lot to us :)💪❤️

Today, we’re excited to announce and launch Reflex Cloud on Product Hunt! Reflex is an open-source framework for building and deploying data and AI web apps in pure Python. Frontend and Backend in Pure Python: No JavaScript required! With Reflex Cloud, you can now deploy, manage, and scale your Python apps with just a single command! If you're a Python developer, an upvote or a share would mean a lot to us :)💪❤️

Reflex

55,040 views • 1 year ago

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

AMD

155,412 views • 1 month ago

At Google I/O, I sat down with Omar Sanseviero and 👩‍💻 Paige Bailey from Google DeepMind to talk about Gemma, open models, AI Studio, on-device AI, sovereign AI and the future of AI development. A great conversation on how building with AI is becoming more open, local and accessible.

At Google I/O, I sat down with Omar Sanseviero and 👩‍💻 Paige Bailey from Google DeepMind to talk about Gemma, open models, AI Studio, on-device AI, sovereign AI and the future of AI development. A great conversation on how building with AI is becoming more open, local and accessible.

Chubby♨️

13,741 views • 2 months ago

Today we announced our new Fairwater datacenter in Atlanta, connected with our first Fairwater site in Wisconsin and our broader Azure footprint to create the world’s first AI superfactory. Fairwater exemplifies our vision for a fungible fleet: infra that can serve any workload, anywhere, on fit-for-purpose accelerators and network paths, with maximum performance and efficiency. AI workloads have evolved beyond large-scale pre-training. Today, they encompass fine-tuning, reinforcement learning (RL), synthetic data generation, evaluation pipelines, and more. Fairwater is built to support this full lifecycle: Max density: Fairwater’s two-story design and liquid cooling system lets us place racks in three dimensions and pack them with GPUs as densely as possible, minimizing cable runs and improving latency and effective bandwidth. Fleet: Each Fairwater DC can integrate hundreds of thousands of the latest NVIDIA GPUs into a single coherent cluster. This provides flexible infra that can support the full spectrum of workloads, and ensure no GPU is left unnecessarily idle. And that’s on top of the more than 100,000 GB300s coming online this quarter alone for inference across the rest of our fleet. For us, it’s all about turning every gigawatt into the maximum number of useful tokens. Not every GW is created equal! Planet-scale: Every Fairwater DC will connect through our continent-spanning AI WAN to prior generations of AI supercomputers, forming a truly fungible pool of compute. This enables developers to scale beyond the capacity of a single site and dynamically land workloads on the right infra for their needs. Together, these innovations let us bring together different generations of silicon and AI systems across DCs and geos into a single elastic system that scales seamlessly across training and inference workloads And this elastic AI capacity is all available alongside all the other cloud services (compute, storage, databases, app services) that AI agents and workloads need. This is what we mean when we talk about building a fungible fleet – a single, unified platform that pushes the limits of performance per watt and per dollar. Read more:

Today we announced our new Fairwater datacenter in Atlanta, connected with our first Fairwater site in Wisconsin and our broader Azure footprint to create the world’s first AI superfactory. Fairwater exemplifies our vision for a fungible fleet: infra that can serve any workload, anywhere, on fit-for-purpose accelerators and network paths, with maximum performance and efficiency. AI workloads have evolved beyond large-scale pre-training. Today, they encompass fine-tuning, reinforcement learning (RL), synthetic data generation, evaluation pipelines, and more. Fairwater is built to support this full lifecycle: Max density: Fairwater’s two-story design and liquid cooling system lets us place racks in three dimensions and pack them with GPUs as densely as possible, minimizing cable runs and improving latency and effective bandwidth. Fleet: Each Fairwater DC can integrate hundreds of thousands of the latest NVIDIA GPUs into a single coherent cluster. This provides flexible infra that can support the full spectrum of workloads, and ensure no GPU is left unnecessarily idle. And that’s on top of the more than 100,000 GB300s coming online this quarter alone for inference across the rest of our fleet. For us, it’s all about turning every gigawatt into the maximum number of useful tokens. Not every GW is created equal! Planet-scale: Every Fairwater DC will connect through our continent-spanning AI WAN to prior generations of AI supercomputers, forming a truly fungible pool of compute. This enables developers to scale beyond the capacity of a single site and dynamically land workloads on the right infra for their needs. Together, these innovations let us bring together different generations of silicon and AI systems across DCs and geos into a single elastic system that scales seamlessly across training and inference workloads And this elastic AI capacity is all available alongside all the other cloud services (compute, storage, databases, app services) that AI agents and workloads need. This is what we mean when we talk about building a fungible fleet – a single, unified platform that pushes the limits of performance per watt and per dollar. Read more:

Satya Nadella

908,065 views • 9 months ago

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.

Six Five Media

131,501 views • 5 months ago

Scale your AI inference, graphics, and analytics workloads with the GPU power to get you there. Amazon EC2 G7 instances are now generally available—accelerated by @NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, first on AWS.

Scale your AI inference, graphics, and analytics workloads with the GPU power to get you there. Amazon EC2 G7 instances are now generally available—accelerated by @NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, first on AWS.

Amazon Web Services

1,960,434 views • 2 months ago

We sat down with EvolutionIQOfficial's Tomas Vykruta to talk about AI in the insurance industry, importance of compelling UI, convincing the first customer to share training data with a startup, and other learnings from building a successful AI-powered business.

We sat down with EvolutionIQOfficial's Tomas Vykruta to talk about AI in the insurance industry, importance of compelling UI, convincing the first customer to share training data with a startup, and other learnings from building a successful AI-powered business.

Artem Burachenok, CEO @alloy.cx

102,819 views • 3 years ago

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:

AMD

17,208 views • 3 months ago

$AMD is becoming a two-engine AI story with EPYC CPUs for the growing compute needed around agentic workloads and Instinct GPUs for hyperscalers that need a credible alternative to $NVDA. The CPU side still looks underappreciated as AI agents require more high-core-count server compute and 2nm Venice should help AMD keep taking share as $INTC works through roadmap and manufacturing challenges. The bridge is Helios where AMD can package EPYC CPUs, Instinct GPUs and Pensando networking into a full rack-scale AI platform backed by real demand from $META, $ORCL and OpenAI.

$AMD is becoming a two-engine AI story with EPYC CPUs for the growing compute needed around agentic workloads and Instinct GPUs for hyperscalers that need a credible alternative to $NVDA. The CPU side still looks underappreciated as AI agents require more high-core-count server compute and 2nm Venice should help AMD keep taking share as $INTC works through roadmap and manufacturing challenges. The bridge is Helios where AMD can package EPYC CPUs, Instinct GPUs and Pensando networking into a full rack-scale AI platform backed by real demand from $META, $ORCL and OpenAI.

Shay Boloor

89,204 views • 1 month ago

For over a decade, Intel and Microsoft Azure have partnered to build trust in the cloud. At Microsoft Build 2026, we spoke with Azure CTO Mark Russinovich on how Azure and Intel TDX work together to support confidential cloud workloads at scale with near-zero performance overhead and minimal effort. Watch the full interview:

For over a decade, Intel and Microsoft Azure have partnered to build trust in the cloud. At Microsoft Build 2026, we spoke with Azure CTO Mark Russinovich on how Azure and Intel TDX work together to support confidential cloud workloads at scale with near-zero performance overhead and minimal effort. Watch the full interview:

Intel Business

19,756 views • 1 month ago

The next generation of AI apps will be powered by agents that reason, act, and pay. Mentor Session #1 features Ben Greenberg from Arbitrum on Agentic Payment Flows and Private AI Inference using x402 & AP2. If you’re building for x402, this session is a must watch. App Layer FTW.

The next generation of AI apps will be powered by agents that reason, act, and pay. Mentor Session #1 features Ben Greenberg from Arbitrum on Agentic Payment Flows and Private AI Inference using x402 & AP2. If you’re building for x402, this session is a must watch. App Layer FTW.

Capx AI

41,278 views • 8 months ago

🌟Quilibrium’s AI Breakthrough: Encrypted Training on CPUs In her latest live stream ( - minute 14) Cassie unveiled a groundbreaking AI training method that allows models to be trained on encrypted data using CPUs while achieving performance comparable to Nvidia’s A100 GPU (blue line in the graph below). Traditionally, AI training requires expensive GPUs because matrix multiplications—the core of deep learning—are highly computational. Running these calculations on CPUs is painfully slow, often taking hours or days for even small models. The problem worsens when trying to train AI on encrypted data, as standard encryption methods add a massive computational burden. Quilibrium’s breakthrough removes this bottleneck. Instead of relying on traditional matrix multiplication, their method uses a completely different mathematical approach, allowing AI models to be trained securely and efficiently without exposing the raw data. Cassie didn’t reveal the exact technique, only hinting that it’s inspired by existing AI research and will be detailed in a future open-source AGPL-licensed paper. The key advantage? AI can now be trained at GPU speeds on standard CPUs, making privacy-preserving machine learning far more accessible. This innovation has major implications. It slashes AI infrastructure costs, allowing organizations to train powerful models without investing in expensive hardware. It also enables private AI training on personal or corporate data without revealing sensitive information, a game-changer for industries like healthcare and finance. If Quilibrium’s method delivers on its promise, it could reshape AI development, making privacy-first computing the new standard. $QUIL $wQUIL

🌟Quilibrium’s AI Breakthrough: Encrypted Training on CPUs In her latest live stream ( - minute 14) Cassie unveiled a groundbreaking AI training method that allows models to be trained on encrypted data using CPUs while achieving performance comparable to Nvidia’s A100 GPU (blue line in the graph below). Traditionally, AI training requires expensive GPUs because matrix multiplications—the core of deep learning—are highly computational. Running these calculations on CPUs is painfully slow, often taking hours or days for even small models. The problem worsens when trying to train AI on encrypted data, as standard encryption methods add a massive computational burden. Quilibrium’s breakthrough removes this bottleneck. Instead of relying on traditional matrix multiplication, their method uses a completely different mathematical approach, allowing AI models to be trained securely and efficiently without exposing the raw data. Cassie didn’t reveal the exact technique, only hinting that it’s inspired by existing AI research and will be detailed in a future open-source AGPL-licensed paper. The key advantage? AI can now be trained at GPU speeds on standard CPUs, making privacy-preserving machine learning far more accessible. This innovation has major implications. It slashes AI infrastructure costs, allowing organizations to train powerful models without investing in expensive hardware. It also enables private AI training on personal or corporate data without revealing sensitive information, a game-changer for industries like healthcare and finance. If Quilibrium’s method delivers on its promise, it could reshape AI development, making privacy-first computing the new standard. $QUIL $wQUIL

Quilibrium Community

18,919 views • 1 year ago

Amazon Redshift RG, powered by AWS Graviton, deliver better performance - running data warehouse and data lake workloads up to 2.4x as fast as previous generation RA3 at 30% lower cost per vCPU. Run SQL analytics across your data warehouse and data lake from a single engine — including on open formats such as Apache Iceberg and Apache Parquet. Built to meet the demands of today’s analytics and agentic AI workloads.

Amazon Redshift RG, powered by AWS Graviton, deliver better performance - running data warehouse and data lake workloads up to 2.4x as fast as previous generation RA3 at 30% lower cost per vCPU. Run SQL analytics across your data warehouse and data lake from a single engine — including on open formats such as Apache Iceberg and Apache Parquet. Built to meet the demands of today’s analytics and agentic AI workloads.

Amazon Web Services

13,468 views • 3 months ago

From training to inference at massive scale, delivering on the promise of AI depends on collaboration across open hardware and software. AMD and OpenAI are working together to tailor hardware like Instinct MI455X and Helios for where AI workloads are going, not just where they are today. Greg Brockman (Greg Brockman) on the power of our engineering partnership at #CES2026.

From training to inference at massive scale, delivering on the promise of AI depends on collaboration across open hardware and software. AMD and OpenAI are working together to tailor hardware like Instinct MI455X and Helios for where AI workloads are going, not just where they are today. Greg Brockman (Greg Brockman) on the power of our engineering partnership at #CES2026.

AMD

20,021 views • 7 months ago