Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

.NVIDIA hand delivered a pre-production unit of the Dell Technologies Pro Max with GB300 to my house. 100lbs beast with 750GB+ of unified memory to power the best open-source models in the world. What should I test first?

MatthewBerman's profile picture

Matthew Berman

131,815 subscribers

255,703 Aufrufe • vor 6 Monaten •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

We are getting 2 new devices from NVIDIA and Microsoft: 1. The DGX Station, with GB300 superchip and up to 748GB of memory. 2. The RTX Spark laptop, with 1 petaflop of AI performance and 128GB of unified memory. The hardware here is pretty bonkers! Think about it this way:
4:07

We are getting 2 new devices from NVIDIA and Microsoft: 1. The DGX Station, with GB300 superchip and up to 748GB of memory. 2. The RTX Spark laptop, with 1 petaflop of AI performance and 128GB of unified memory. The hardware here is pretty bonkers! Think about it this way:

Santiago

15,307 Aufrufe • vor 3 Monaten

Introducing Halo, the best framework for post-training of open-source models. Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format. Star us on GitHub:
0:42

Introducing Halo, the best framework for post-training of open-source models. Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format. Star us on GitHub:

White Circle

2,252,490 Aufrufe • vor 6 Tagen

Day 1 at Dell Technologies Technologies World. Great energy on the floor and a lot of strong conversations, looking forward to what the rest of the week brings. #DellTechWorld
0:55

Day 1 at Dell Technologies Technologies World. Great energy on the floor and a lot of strong conversations, looking forward to what the rest of the week brings. #DellTechWorld

IREN

78,629 Aufrufe • vor 4 Monaten

Paid Program with Dell Technologies and NVIDIA: “A lot comes down to the amount of data you’re able to train on.” Deepgram’s VP of Engineering Kris Efland explains why a well-designed technology infrastructure opens the door to innovation in voice AI.
0:23

Paid Program with Dell Technologies and NVIDIA: “A lot comes down to the amount of data you’re able to train on.” Deepgram’s VP of Engineering Kris Efland explains why a well-designed technology infrastructure opens the door to innovation in voice AI.

Custom Content from WSJ

22,561 Aufrufe • vor 2 Monaten

Armada presented a solution to bring Palantir solutions to the edge in partnership with NVIDIA and Dell Technologies at AIPCon earlier this week. Hear from Armada CEO Dan Wright and NVIDIA VP of Public Sector Solutions Alex Neefus about how the solution works and is enabling Foundry to be forward-deployed anywhere in the world.
8:10

Armada presented a solution to bring Palantir solutions to the edge in partnership with NVIDIA and Dell Technologies at AIPCon earlier this week. Hear from Armada CEO Dan Wright and NVIDIA VP of Public Sector Solutions Alex Neefus about how the solution works and is enabling Foundry to be forward-deployed anywhere in the world.

Armada

228,386 Aufrufe • vor 6 Monaten

"This is the time you want to be first!" 👏👏👏 Jensen Huang, CEO of NVIDIA, joins Michael Dell 🇺🇸 for a #DellTechWorld conversation, emphasizing the importance of early adoption in the age of AI innovation. Take hold of your AI opportunity now – read about the Dell AI Factory with NVIDIA:
0:20

"This is the time you want to be first!" 👏👏👏 Jensen Huang, CEO of NVIDIA, joins Michael Dell 🇺🇸 for a #DellTechWorld conversation, emphasizing the importance of early adoption in the age of AI innovation. Take hold of your AI opportunity now – read about the Dell AI Factory with NVIDIA:

Dell Technologies

19,339,970 Aufrufe • vor 1 Jahr

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.
1:24

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

kwindla

274,867 Aufrufe • vor 8 Monaten

The pilot phase of enterprise AI is ending. What separates the organizations that scale from those that stall is infrastructure, data readiness, and governance built before models are ever deployed. Patrick Moorhead and Daniel Newman sit down with Varun Chhabra of Dell Technologies and Jason Schroedl of NVIDIA at Dell Technologies World 2026 to break down new approaches to agentic AI deployment, investments in data readiness, and how enterprises can expand AI capabilities while maintaining control over security, costs and operations.
16:22

The pilot phase of enterprise AI is ending. What separates the organizations that scale from those that stall is infrastructure, data readiness, and governance built before models are ever deployed. Patrick Moorhead and Daniel Newman sit down with Varun Chhabra of Dell Technologies and Jason Schroedl of NVIDIA at Dell Technologies World 2026 to break down new approaches to agentic AI deployment, investments in data readiness, and how enterprises can expand AI capabilities while maintaining control over security, costs and operations.

Six Five Media

148,133 Aufrufe • vor 3 Monaten

Today at NVIDIA GTC, DigitalOcean & NVIDIA delivered the biggest AI infrastructure announcements of the year for teams building in production. 🤖🌩️🚀 More models, next-gen compute, a new US East region, & a workflow that takes you from #NVIDIA prototype to DigitalOcean production without the friction. 🌊
0:26

Today at NVIDIA GTC, DigitalOcean & NVIDIA delivered the biggest AI infrastructure announcements of the year for teams building in production. 🤖🌩️🚀 More models, next-gen compute, a new US East region, & a workflow that takes you from #NVIDIA prototype to DigitalOcean production without the friction. 🌊

DigitalOcean

13,026 Aufrufe • vor 6 Monaten

In 2016, Jensen Huang hand-delivered the world’s first AI supercomputer to a startup in San Francisco called OpenAI. The culmination of a decade of work from thousands of NVIDIA engineers, DGX-1 set the stage for a new industrial revolution.
0:30

In 2016, Jensen Huang hand-delivered the world’s first AI supercomputer to a startup in San Francisco called OpenAI. The culmination of a decade of work from thousands of NVIDIA engineers, DGX-1 set the stage for a new industrial revolution.

NVIDIA

61,439 Aufrufe • vor 1 Jahr

World Foundation Models (WFM) are the future of Physical AI, and we believe this future should be open-sourced. We are partnering with Valeo Group to build one of the largest open-source, multi-camera WFMs — redefining how Physical AI interacts with the real world.
0:33

World Foundation Models (WFM) are the future of Physical AI, and we believe this future should be open-sourced. We are partnering with Valeo Group to build one of the largest open-source, multi-camera WFMs — redefining how Physical AI interacts with the real world.

NATIX Network

262,141 Aufrufe • vor 8 Monaten

AI traffic in retail grew 800%, but customers are turning to answer engines first. Patrick Moorhead and Daniel Newman sat down with Gerri Tunnell, CMO at Dell Technologies at Dell Technologies World 2026 to discuss this shift. AI can only recommend what it can understand. Reviews, benchmarks, analyst relations, community signals. The things that earn trust in the real world earn trust in the models. The customer buying journey has already changed. The strategy needs to catch up.
0:44

AI traffic in retail grew 800%, but customers are turning to answer engines first. Patrick Moorhead and Daniel Newman sat down with Gerri Tunnell, CMO at Dell Technologies at Dell Technologies World 2026 to discuss this shift. AI can only recommend what it can understand. Reviews, benchmarks, analyst relations, community signals. The things that earn trust in the real world earn trust in the models. The customer buying journey has already changed. The strategy needs to catch up.

Six Five Media

56,868 Aufrufe • vor 3 Monaten

"All the frontier models are coming on-prem. That's a huge change, folks." — Michael Dell 🇺🇸, CEO at Dell Technologies Technologies OpenAI GPT-5.5. Reflection. Palantir. SpaceX AI. Open source. All landing where the valuable data already lives. For the first time, they don't have to choose between frontier capability and data sovereignty.
1:32

"All the frontier models are coming on-prem. That's a huge change, folks." — Michael Dell 🇺🇸, CEO at Dell Technologies Technologies OpenAI GPT-5.5. Reflection. Palantir. SpaceX AI. Open source. All landing where the valuable data already lives. For the first time, they don't have to choose between frontier capability and data sovereignty.

Six Five Media

184,401 Aufrufe • vor 4 Monaten

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike
1:20

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

Harry Stebbings

63,738 Aufrufe • vor 3 Monaten

I tested Gemma 4 12b on my Macbook Pro M5 Max with 128GB of unified memory. It runs VERY slow for a 12b parameter model. 44 tokens/second. The lava lamp that it produced was also terrible. I would stick to Qwen 3.6 27b or Qwen 3.6 35b. Google is still way behind, even with their local models.
1:36

I tested Gemma 4 12b on my Macbook Pro M5 Max with 128GB of unified memory. It runs VERY slow for a 12b parameter model. 44 tokens/second. The lava lamp that it produced was also terrible. I would stick to Qwen 3.6 27b or Qwen 3.6 35b. Google is still way behind, even with their local models.

BridgeMind

70,626 Aufrufe • vor 3 Monaten

We closed out NVIDIA GTC with a bang 💥. Innovation was on full display and the energy was unmatched. We're excited to continue the momentum with Jensen and @NVIDIA in May, live on the Dell Tech World stage. See you in Vegas. 🎰
0:25

We closed out NVIDIA GTC with a bang 💥. Innovation was on full display and the energy was unmatched. We're excited to continue the momentum with Jensen and @NVIDIA in May, live on the Dell Tech World stage. See you in Vegas. 🎰

Dell

15,455 Aufrufe • vor 6 Monaten

‼️ Apple put cheaper memory in the 1TB iPhone 18 Pro Max, and it gets as slow as an SD card under load. This is the video of HOMOLAB's test of the 1TB 18 Pro Max with cheaper, low-performing QLC memory, versus the cheaper 512GB model with TLC. We've added English subtitles.
4:41

‼️ Apple put cheaper memory in the 1TB iPhone 18 Pro Max, and it gets as slow as an SD card under load. This is the video of HOMOLAB's test of the 1TB 18 Pro Max with cheaper, low-performing QLC memory, versus the cheaper 512GB model with TLC. We've added English subtitles.

International Cyber Digest

151,208 Aufrufe • vor 6 Tagen