Загрузка видео...

Не удалось загрузить видео

На главную

Learn how Inworld AI teamed up with Modular and Oracle Cloud to unlock hardware optionality across Nvidia and AMD GPUs for their groundbreaking TTS models, cutting total cost of model ownership by 70%.

Modular's profile picture

Modular

23,505 subscribers

23,338 просмотров • 11 месяцев назад •via X (Twitter)

Здоровье и велнесНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Mojo🔥 combines the usability of Python with the performance of C, unlocking unparalleled programmability of AI hardware and extensibility of AI models. Also, it's up to 35000x faster than Python 🤯 and … deploys 🏎
0:27

Mojo🔥 combines the usability of Python with the performance of C, unlocking unparalleled programmability of AI hardware and extensibility of AI models. Also, it's up to 35000x faster than Python 🤯 and … deploys 🏎

Modular

124,550 просмотров • 3 лет назад

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD
3:17

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD

Daniel

20,558 просмотров • 6 месяцев назад

Watch how NVIDIA & Inworld AI bring AI characters to life with NVIDIA ACE digital human technologies and the Inworld Engine in the latest technology demo, Covert Protocol. Learn More:
2:19

Watch how NVIDIA & Inworld AI bring AI characters to life with NVIDIA ACE digital human technologies and the Inworld Engine in the latest technology demo, Covert Protocol. Learn More:

NVIDIA GeForce

184,342 просмотров • 2 лет назад

“Our stack and models are now actively deployed on AMD.” Aidan Gomez of @Cohere shares how quickly they ported their latest model, CommandA, to the AMD platform and why Instinct GPUs are now their go-to for training at scale. #AdvancingAI
0:39

“Our stack and models are now actively deployed on AMD.” Aidan Gomez of @Cohere shares how quickly they ported their latest model, CommandA, to the AMD platform and why Instinct GPUs are now their go-to for training at scale. #AdvancingAI

AMD

21,349 просмотров • 1 год назад

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️
0:30

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️

NVIDIA AI Infrastructure

268,567 просмотров • 7 месяцев назад

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:
1:02

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:

AMD

17,208 просмотров • 3 месяцев назад

AI is reshaping the data center. Hear from Paul Turner, Chief Product Officer of the VMware Cloud Foundation Division at Broadcom, on how Broadcom and AMD are helping organizations build AI-ready infrastructure with VMware Cloud Foundation and AMD Instinct MI350P Series GPUs.
0:53

AI is reshaping the data center. Hear from Paul Turner, Chief Product Officer of the VMware Cloud Foundation Division at Broadcom, on how Broadcom and AMD are helping organizations build AI-ready infrastructure with VMware Cloud Foundation and AMD Instinct MI350P Series GPUs.

AMD

29,114 просмотров • 2 месяцев назад

📈 NVIDIA tops AI leaderboards and benchmarks with open models driven by extreme co-design across compute, networking, memory, storage, and software. This includes models for biology, AI physics, agentic AI, physical AI, robotics, and autonomous vehicles. By being vertically integrated and horizontally open, NVIDIA enables its ecosystem to scale agentic workflows at every layer of the stack with the lowest cost per token.
0:38

📈 NVIDIA tops AI leaderboards and benchmarks with open models driven by extreme co-design across compute, networking, memory, storage, and software. This includes models for biology, AI physics, agentic AI, physical AI, robotics, and autonomous vehicles. By being vertically integrated and horizontally open, NVIDIA enables its ecosystem to scale agentic workflows at every layer of the stack with the lowest cost per token.

NVIDIA

85,569 просмотров • 3 месяцев назад

Introducing Project Ceiba, a groundbreaking collaboration between #AWS and @NVIDIA, that aims to push the boundaries of #AI by constructing the largest AI supercomputer in the cloud. ☁️ ⚙️ 💻 Learn more. ➡️
0:58

Introducing Project Ceiba, a groundbreaking collaboration between #AWS and @NVIDIA, that aims to push the boundaries of #AI by constructing the largest AI supercomputer in the cloud. ☁️ ⚙️ 💻 Learn more. ➡️

Amazon Web Services

16,201 просмотров • 2 лет назад

Modular has acquired BentoML! 🤝 10K+ orgs use BentoML for production AI, including 50+ Fortune 500 companies. We're pairing their deployment platform with MAX + Mojo's hardware optimization. BentoML stays open source (Apache 2.0), and we’re doubling down on OSS in 2026. Ask BentoML founder Chaoyu Yang and Chris Lattner anything on Feb 17 at 9:30am PT. Get all the details:
0:45

Modular has acquired BentoML! 🤝 10K+ orgs use BentoML for production AI, including 50+ Fortune 500 companies. We're pairing their deployment platform with MAX + Mojo's hardware optimization. BentoML stays open source (Apache 2.0), and we’re doubling down on OSS in 2026. Ask BentoML founder Chaoyu Yang and Chris Lattner anything on Feb 17 at 9:30am PT. Get all the details:

Modular

28,702 просмотров • 6 месяцев назад

AWS has announced the general availability of its new Amazon EC2 R8a memory-optimized instances, powered by 5th Gen AMD EPYC processors with clock speeds up to 4.5 GHz. This means more speed and efficiency at a lower total cost of ownership, without having to change their cloud architecture. Read more from Amazon Web Services:
0:20

AWS has announced the general availability of its new Amazon EC2 R8a memory-optimized instances, powered by 5th Gen AMD EPYC processors with clock speeds up to 4.5 GHz. This means more speed and efficiency at a lower total cost of ownership, without having to change their cloud architecture. Read more from Amazon Web Services:

AMD EPYC

95,689 просмотров • 9 месяцев назад

📢 BREAKING: Nvidia, Microsoft, and Anthropic announce new strategic AI partnerships of roughly $45 Billion. They struck a 3-way deal where Anthropic commits $30B for Azure compute with capacity up to 1GW, and NVIDIA and Microsoft plan to invest up to $10B and $5B in Anthropic. Claude will scale on Azure using NVIDIA systems, which expands access for enterprises and makes Claude available across the major clouds. Anthropic and NVIDIA will co-design to tune both model stacks and future chips for performance, efficiency, and total cost of ownership, so the models run faster per dollar. The first wave targets NVIDIA Grace Blackwell and Vera Rubin systems, which pair high-bandwidth memory with dense interconnect to push training and inference throughput. Microsoft will expose Anthropic models in Azure AI Foundry, including Claude Sonnet 4.5, Claude Opus 4.1, and Claude Haiku 4.5, so teams can pick latency and cost profiles. Claude will also remain available across the Copilot family, which means coding, document automation, and workflow agents can call the same model line. The 1GW commitment signals many thousands of GPUs worth of capacity, which reduces queue times and stabilizes unit economics for long-running training runs. The joint optimization loop, models shaping chips and chips shaping models, typically yields double-digit efficiency gains over off-the-shelf deployments.
1:10

📢 BREAKING: Nvidia, Microsoft, and Anthropic announce new strategic AI partnerships of roughly $45 Billion. They struck a 3-way deal where Anthropic commits $30B for Azure compute with capacity up to 1GW, and NVIDIA and Microsoft plan to invest up to $10B and $5B in Anthropic. Claude will scale on Azure using NVIDIA systems, which expands access for enterprises and makes Claude available across the major clouds. Anthropic and NVIDIA will co-design to tune both model stacks and future chips for performance, efficiency, and total cost of ownership, so the models run faster per dollar. The first wave targets NVIDIA Grace Blackwell and Vera Rubin systems, which pair high-bandwidth memory with dense interconnect to push training and inference throughput. Microsoft will expose Anthropic models in Azure AI Foundry, including Claude Sonnet 4.5, Claude Opus 4.1, and Claude Haiku 4.5, so teams can pick latency and cost profiles. Claude will also remain available across the Copilot family, which means coding, document automation, and workflow agents can call the same model line. The 1GW commitment signals many thousands of GPUs worth of capacity, which reduces queue times and stabilizes unit economics for long-running training runs. The joint optimization loop, models shaping chips and chips shaping models, typically yields double-digit efficiency gains over off-the-shelf deployments.

Rohan Paul

39,781 просмотров • 9 месяцев назад

Introducing NVIDIA Nemotron 3 Ultra. A frontier smart open model built for long-running agents that need to plan, reason, use tools and keep working across complex coding, research and enterprise workflows. Up to 5x faster inference and up to 30% lower cost for agentic tasks. Learn more:
0:24

Introducing NVIDIA Nemotron 3 Ultra. A frontier smart open model built for long-running agents that need to plan, reason, use tools and keep working across complex coding, research and enterprise workflows. Up to 5x faster inference and up to 30% lower cost for agentic tasks. Learn more:

NVIDIA

228,735 просмотров • 2 месяцев назад

The #NVIDIAVeraRubin platform consists of five rack-scale systems for AI agents with a supply chain spanning over 350 factory sites across 30 countries with millions square feet of factory floor space.​ Vera Rubin is in full production, co-designed with NVIDIA DSX and DSX MaxLPS to deliver the lowest token cost and maximum tokens per watt.​ Congratulations to our partners who have their engineering racks up and running: CoreWeave, Dell Technologies, Microsoft, and Oracle Cloud.
1:14

The #NVIDIAVeraRubin platform consists of five rack-scale systems for AI agents with a supply chain spanning over 350 factory sites across 30 countries with millions square feet of factory floor space.​ Vera Rubin is in full production, co-designed with NVIDIA DSX and DSX MaxLPS to deliver the lowest token cost and maximum tokens per watt.​ Congratulations to our partners who have their engineering racks up and running: CoreWeave, Dell Technologies, Microsoft, and Oracle Cloud.

NVIDIA AI Infrastructure

16,701 просмотров • 1 месяц назад

Successfully deployed Deepseek R1 Distilled 70B (AWQ) across 8x NVIDIA RTX 3080 10G GPUs, achieving 60 tokens/s with full tensor parallelism via PCIe. Total hardware cost: $6,400 This demonstrates that consumer GPUs can deliver substantial ML inference capabilities at a fraction of the cost of datacenter hardware. For perspective, a single A100 80G costs $17,550, while a H100 80G runs $25,000. Our testing validates an often-overlooked opportunity: millions of idle crypto mining rigs could be repurposed into a powerful, distributed AI infrastructure. The performance-to-cost ratio of consumer GPUs, especially when properly optimized for tensor operations, presents a compelling case for decentralized AI compute. We're excited to share more insights as we continue pushing the boundaries of consumer hardware in AI workloads.
1:20

Successfully deployed Deepseek R1 Distilled 70B (AWQ) across 8x NVIDIA RTX 3080 10G GPUs, achieving 60 tokens/s with full tensor parallelism via PCIe. Total hardware cost: $6,400 This demonstrates that consumer GPUs can deliver substantial ML inference capabilities at a fraction of the cost of datacenter hardware. For perspective, a single A100 80G costs $17,550, while a H100 80G runs $25,000. Our testing validates an often-overlooked opportunity: millions of idle crypto mining rigs could be repurposed into a powerful, distributed AI infrastructure. The performance-to-cost ratio of consumer GPUs, especially when properly optimized for tensor operations, presents a compelling case for decentralized AI compute. We're excited to share more insights as we continue pushing the boundaries of consumer hardware in AI workloads.

TensorBlock

16,219 просмотров • 1 год назад

Open models are accelerating development and deployment across agentic AI, physical AI, and a growing range of industries. ✨ “We have billions of dollars of supercomputers in operation, so we can develop our open models,” said NVIDIA CEO Jensen Huang in a recent keynote. “That work is starting to attract attention across industries worldwide, as we build frontier AI models in many different domains.” This includes leading open models from NVIDIA, including: ⚙️ NVIDIA Nemotron for agentic AI ⚙️ NVIDIA Cosmos and GR00T for physical AI ⚙️ NVIDIA Alpamayo for autonomous vehicles ⚙️ NVIDIA Clara for biomedical AI Learn more about open source and AI ➡️
0:20

Open models are accelerating development and deployment across agentic AI, physical AI, and a growing range of industries. ✨ “We have billions of dollars of supercomputers in operation, so we can develop our open models,” said NVIDIA CEO Jensen Huang in a recent keynote. “That work is starting to attract attention across industries worldwide, as we build frontier AI models in many different domains.” This includes leading open models from NVIDIA, including: ⚙️ NVIDIA Nemotron for agentic AI ⚙️ NVIDIA Cosmos and GR00T for physical AI ⚙️ NVIDIA Alpamayo for autonomous vehicles ⚙️ NVIDIA Clara for biomedical AI Learn more about open source and AI ➡️

NVIDIA AI

19,296 просмотров • 6 месяцев назад

Together, Dell Technologies and AMD unlock the full potential of open-source frameworks, driving impact across industries. Built for flexibility, collaboration, and innovation, the Dell AI platform with AMD ROCm 7 supports AI workloads from development to deployment. 📺
0:35

Together, Dell Technologies and AMD unlock the full potential of open-source frameworks, driving impact across industries. Built for flexibility, collaboration, and innovation, the Dell AI platform with AMD ROCm 7 supports AI workloads from development to deployment. 📺

AMD

35,674 просмотров • 10 месяцев назад