正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

"We were able to get the smallest, most efficient model, Nemotron-3-5 Lightning, to outperform our largest model, Nemotron-3 Ultra, and by a large gap." NVIDIA's Alex Neefus on their partnership with Palantir: "A small purpose-trained model will outperform the predictive correctness of the biggest model, 1-20x bigger."

Jawwwn

30,029 subscribers

12,528 次观看 • 3 天前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

1 条评论

TheMythicalRealm 的头像

TheMythicalRealm2 天前

@nvidia @alexneefus @NVIDIAAI @JensenHuang That's amazing. That's why SLMs are the key low tolen cost with far greater predetermined process efficiency

相关视频

We are excited to join Nvidia's Nemotron Coalition of leading AI labs working together to advance open frontier foundation models. To celebrate we have partnered with NVIDIA and Nebius Token Factory to provide 2 free weeks of the new Nemotron 3 Ultra model on the Nous Portal!

We are excited to join Nvidia's Nemotron Coalition of leading AI labs working together to advance open frontier foundation models. To celebrate we have partnered with NVIDIA and Nebius Token Factory to provide 2 free weeks of the new Nemotron 3 Ultra model on the Nous Portal!

Nous Research

1,501,639 次观看 • 3 个月前

Jensen on Nemotron 3 Ultra and it's role in the open ecosystem. It's great to have Nvidia leading on this, with so much turnover in open model providers in recent years. Super excited to see how the model turns out.

Jensen on Nemotron 3 Ultra and it's role in the open ecosystem. It's great to have Nvidia leading on this, with so much turnover in open model providers in recent years. Super excited to see how the model turns out.

Nathan Lambert

26,650 次观看 • 6 个月前

Meet Nemotron 3 Nano Omni 👋 Our latest addition to the Nemotron family is the highest efficiency, open multimodal model with leading accuracy. 30B parameters. 256K context length. 🧵👇

Meet Nemotron 3 Nano Omni 👋 Our latest addition to the Nemotron family is the highest efficiency, open multimodal model with leading accuracy. 30B parameters. 256K context length. 🧵👇

NVIDIA AI

460,782 次观看 • 4 个月前

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

NVIDIA AI Developer

140,800 次观看 • 1 年前

Red Hat AI just shipped DFlash speculator checkpoints for two of NVIDIA AI's most powerful open models: → Nemotron Ultra 550B → Nemotron Super 120B On math and reasoning: ~5 out of 7 draft tokens accepted on average. On code (HumanEval): ~3.4 out of 7. Both checkpoints trained with the open source Speculators library from vLLM. Apache 2.0. Validated on NVIDIA B200. One flag to enable in vLLM: --spec-model RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-speculator.dflash --spec-tokens 7 --spec-method dflash 🔗 Ultra 550B: 🔗 Super 120B:

Red Hat AI just shipped DFlash speculator checkpoints for two of NVIDIA AI's most powerful open models: → Nemotron Ultra 550B → Nemotron Super 120B On math and reasoning: ~5 out of 7 draft tokens accepted on average. On code (HumanEval): ~3.4 out of 7. Both checkpoints trained with the open source Speculators library from vLLM. Apache 2.0. Validated on NVIDIA B200. One flag to enable in vLLM: --spec-model RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-speculator.dflash --spec-tokens 7 --spec-method dflash 🔗 Ultra 550B: 🔗 Super 120B:

Red Hat AI

14,923 次观看 • 2 个月前

.Shyam Sankar says Palantir was able to make Nvidia's Nemotron Ultra model "better than frontier": "I literally almost felt gaslit when, within 24 hours of getting Nemotron up with no post-training, this is vanilla Nemotron Ultra, it did better than frontier." "If you just looked at the numbers, you would say, 'It's nowhere near the Frontier. That shouldn't even be possible.'" "But of course, the benchmarks are wrong. I mean, the benchmarks are right for what the benchmark's measuring, but that's not my business. Those are not the tasks my customers had that they were trying to solve."

.Shyam Sankar says Palantir was able to make Nvidia's Nemotron Ultra model "better than frontier": "I literally almost felt gaslit when, within 24 hours of getting Nemotron up with no post-training, this is vanilla Nemotron Ultra, it did better than frontier." "If you just looked at the numbers, you would say, 'It's nowhere near the Frontier. That shouldn't even be possible.'" "But of course, the benchmarks are wrong. I mean, the benchmarks are right for what the benchmark's measuring, but that's not my business. Those are not the tasks my customers had that they were trying to solve."

Jawwwn

372,239 次观看 • 1 个月前

ELON MUSK: "Grok 5 will be the largest model, a 6 trillion parameter model, whereas Grok 3 and 4 are based on a 3 trillion parameter model. Moreover, the 6 trillion parameters will have a much higher intelligence density per gigabyte. Its really going to feel Sentient."

ELON MUSK: "Grok 5 will be the largest model, a 6 trillion parameter model, whereas Grok 3 and 4 are based on a 3 trillion parameter model. Moreover, the 6 trillion parameters will have a much higher intelligence density per gigabyte. Its really going to feel Sentient."

DogeDesigner

322,371 次观看 • 10 个月前

Today we're shipping Nemotron 3 Ultra. A 550B MoE frontier-intelligence open model built for long-running agents. It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.

Today we're shipping Nemotron 3 Ultra. A 550B MoE frontier-intelligence open model built for long-running agents. It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.

NVIDIA AI

1,329,353 次观看 • 3 个月前

1/n We are excited to announce EchoPrime – the first echocardiography AI model capable of evaluating a full transthoracic echocardiogram study, identify the most relevant videos, and produce a comprehensive interpretation! Great work lead by Milos Vukadinovic, EchoPrime is the largest and most complex #echofirst AI model yet, trained on 10x the data of existing models.

1/n We are excited to announce EchoPrime – the first echocardiography AI model capable of evaluating a full transthoracic echocardiogram study, identify the most relevant videos, and produce a comprehensive interpretation! Great work lead by Milos Vukadinovic, EchoPrime is the largest and most complex #echofirst AI model yet, trained on 10x the data of existing models.

David Ouyang, MD

155,508 次观看 • 1 年前

NVIDIA is giving away free access to 140+ AI models for a full year > most people building AI agents are paying $50-200/month for API access NVIDIA just made that argument irrelevant models you get: GLM 5.2, MiniMax M3, Nemotron-3-Ultra-550B-A55B, Kimi K2.7, and 130+ more setup: > step 1 - get your free key > go to > register -> bind phone -> copy API key > step 2 - add to Hermes agent > open Settings -> Model Provider -> Custom base_url = " api_key = "nvapi-xxxxxxxxxxxxxxxxxxxx" > step 3 - pick a model model = "z-ai/glm-5.2" model = "minimaxai/minimax-m3" model = "nvidia/nemotron-3-ultra-550b-a55b" model = "moonshot-ai/kimi-k2.7" > Hermes already has NVIDIA set as default base_url > paste the key and you're running instantly > works the same in Cursor and OpenCode > cost: $0 > limit: 40 req/min > expires: 1 year while everyone is paying for API access, this is sitting there for free with this many models in one place, it is also the easiest way to test which one actually fits your agent before you commit to a paid provider

NVIDIA is giving away free access to 140+ AI models for a full year > most people building AI agents are paying $50-200/month for API access NVIDIA just made that argument irrelevant models you get: GLM 5.2, MiniMax M3, Nemotron-3-Ultra-550B-A55B, Kimi K2.7, and 130+ more setup: > step 1 - get your free key > go to > register -> bind phone -> copy API key > step 2 - add to Hermes agent > open Settings -> Model Provider -> Custom base_url = " api_key = "nvapi-xxxxxxxxxxxxxxxxxxxx" > step 3 - pick a model model = "z-ai/glm-5.2" model = "minimaxai/minimax-m3" model = "nvidia/nemotron-3-ultra-550b-a55b" model = "moonshot-ai/kimi-k2.7" > Hermes already has NVIDIA set as default base_url > paste the key and you're running instantly > works the same in Cursor and OpenCode > cost: $0 > limit: 40 req/min > expires: 1 year while everyone is paying for API access, this is sitting there for free with this many models in one place, it is also the easiest way to test which one actually fits your agent before you commit to a paid provider

Mr. Buzzoni

121,850 次观看 • 2 个月前

NVIDIA AI Releases Nemotron 3 Embed: An Open Embedding Collection Whose 8B Checkpoint Ranks #1 on RTEB Most RAG stacks treat the embedding model as a commodity — pick one, index, move on. Nemotron 3 Embed is NVIDIA's argument that the retrieval layer is where agent cost actually gets set. They released three open checkpoints — Nemotron-3-Embed-8B-BF16, 1B-BF16, and 1B-NVFP4 — built on Ministral bases, trained with bidirectional attention masking, pooled by averaging token-level representations, all taking 32,768-token inputs under OpenMDW-1.1. Here's what's actually interesting: → The 8B ranks #1 overall on RTEB: 78.46 avg NDCG@10, alongside 75.45 on MMTEB Retrieval and 60.60 on ViDoRe-V3 text → The 1B wasn't trained small. It was pruned from a 3B parent with ModelOpt mcore_minitron NAS, then distilled from the 8B teacher on COS + MSE loss — twice → That pipeline lands the 1.14B checkpoint at 72.38 RTEB, up 10.4 points on the prior-generation llama-nemotron-embed-vl-1b-v2 → NVFP4 costs 0.38 RTEB points (72.00 vs 72.38, ~99.5% retention) and buys up to 2x BF16 throughput on Blackwell Full Analysis: Model weight: Technical details: NVIDIA AI NVIDIA

NVIDIA AI Releases Nemotron 3 Embed: An Open Embedding Collection Whose 8B Checkpoint Ranks #1 on RTEB Most RAG stacks treat the embedding model as a commodity — pick one, index, move on. Nemotron 3 Embed is NVIDIA's argument that the retrieval layer is where agent cost actually gets set. They released three open checkpoints — Nemotron-3-Embed-8B-BF16, 1B-BF16, and 1B-NVFP4 — built on Ministral bases, trained with bidirectional attention masking, pooled by averaging token-level representations, all taking 32,768-token inputs under OpenMDW-1.1. Here's what's actually interesting: → The 8B ranks #1 overall on RTEB: 78.46 avg NDCG@10, alongside 75.45 on MMTEB Retrieval and 60.60 on ViDoRe-V3 text → The 1B wasn't trained small. It was pruned from a 3B parent with ModelOpt mcore_minitron NAS, then distilled from the 8B teacher on COS + MSE loss — twice → That pipeline lands the 1.14B checkpoint at 72.38 RTEB, up 10.4 points on the prior-generation llama-nemotron-embed-vl-1b-v2 → NVFP4 costs 0.38 RTEB points (72.00 vs 72.38, ~99.5% retention) and buys up to 2x BF16 throughput on Blackwell Full Analysis: Model weight: Technical details: NVIDIA AI NVIDIA

Marktechpost AI

32,352 次观看 • 1 个月前

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

493,268 次观看 • 9 个月前

.L3Harris says Palantir helped them beat frontier AI models in less than 2 days, at 95% lower cost: "When we fine-tuned open source models trained on our own data, we were able to outperform the frontier models in less than 48 hours." "The cost of our fine-tuned open source model was 95% lower than the frontier models we were using." "AI is a commodity. It's all about the data. We view our data as a corporate asset. It's our unique hard-earned knowledge." "We believe American defense companies should not be a vassal for frontier AI labs, handing over our data and institutional knowledge, hoping to rent back the intelligence it creates." " We own the model, we own the compute, we own the advantage."

.L3Harris says Palantir helped them beat frontier AI models in less than 2 days, at 95% lower cost: "When we fine-tuned open source models trained on our own data, we were able to outperform the frontier models in less than 48 hours." "The cost of our fine-tuned open source model was 95% lower than the frontier models we were using." "AI is a commodity. It's all about the data. We view our data as a corporate asset. It's our unique hard-earned knowledge." "We believe American defense companies should not be a vassal for frontier AI labs, handing over our data and institutional knowledge, hoping to rent back the intelligence it creates." " We own the model, we own the compute, we own the advantage."

Jawwwn

961,995 次观看 • 3 天前

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Santiago

84,747 次观看 • 2 年前

We're releasing Paris 2.0, which, to our knowledge, is the world's first decentralized trained video generation model. We benchmarked it against a monolithic model trained on the same data and compute budget, and Paris 2.0 outperformed the monolithic by ~2x on FVD benchmark.

We're releasing Paris 2.0, which, to our knowledge, is the world's first decentralized trained video generation model. We benchmarked it against a monolithic model trained on the same data and compute budget, and Paris 2.0 outperformed the monolithic by ~2x on FVD benchmark.

Bidhan Roy

457,399 次观看 • 3 个月前

#WATCH | Bengaluru, Karnataka: Co-founder, Sarvam AI, Pratyush Kumar says, "... It's been three years now. We started off building on top of the Llama model, which was the best open model at that time. Sarvam was the only company outside, or maybe in Asia, that contributed to the Llama 3 Series. We understood how to add language skills into models, and Llama 3 was reasonable in Indian languages. When the first set of GPUs arrived in India, we pre-trained from scratch a 2-billion model and worked with Infosys to make it useful for IT services. Then we recognised the importance of scaling up reinforcement learning and built a reasoning model called Sarvam M on top of Mistral's small model. Over the last year, we pre-trained from scratch in India on 4,000 Hopper Series GPUs a 100-billion-plus-parameter model..."

#WATCH | Bengaluru, Karnataka: Co-founder, Sarvam AI, Pratyush Kumar says, "... It's been three years now. We started off building on top of the Llama model, which was the best open model at that time. Sarvam was the only company outside, or maybe in Asia, that contributed to the Llama 3 Series. We understood how to add language skills into models, and Llama 3 was reasonable in Indian languages. When the first set of GPUs arrived in India, we pre-trained from scratch a 2-billion model and worked with Infosys to make it useful for IT services. Then we recognised the importance of scaling up reinforcement learning and built a reasoning model called Sarvam M on top of Mistral's small model. Over the last year, we pre-trained from scratch in India on 4,000 Hopper Series GPUs a 100-billion-plus-parameter model..."

ANI

163,060 次观看 • 1 个月前

Meet Waldo: Glean’s first agentic search model. Built on NVIDIA Nemotron 3 Nano and post-trained for search planning, Waldo figures out how to break down a query, which tools to call, what to read next, and when it has enough evidence to hand off.

Meet Waldo: Glean’s first agentic search model. Built on NVIDIA Nemotron 3 Nano and post-trained for search planning, Waldo figures out how to break down a query, which tools to call, what to read next, and when it has enough evidence to hand off.

Glean

98,637 次观看 • 4 个月前

You imagine it. We create it. 🎨 Introducing #PixelStudio, a first-of-its-kind image generator on #Pixel9 powered by an on-device diffusion model¹ running on Tensor G4 and our Imagen 3 text-to-image model in the cloud.

You imagine it. We create it. 🎨 Introducing #PixelStudio, a first-of-its-kind image generator on #Pixel9 powered by an on-device diffusion model¹ running on Tensor G4 and our Imagen 3 text-to-image model in the cloud.

Made by Google

28,283 次观看 • 2 年前

I trained a small model to do syntax highlighting in the browser with GPU. Meet gpu-lexer from Vercel Labs: Small (27.5KB), fast (runs on WebGPU), and language-agnostic (model guesses the syntax). It is experimental and built for learning!

I trained a small model to do syntax highlighting in the browser with GPU. Meet gpu-lexer from Vercel Labs: Small (27.5KB), fast (runs on WebGPU), and language-agnostic (model guesses the syntax). It is experimental and built for learning!

Shu

681,948 次观看 • 5 天前

We took a robot to RSS in LA running our new Gemini Robotics On-Device VLA model. People interacted with the model with new objects and instructions in a brand new environment and the results were amazing!

Ayzaan Wahid

19,710 次观看 • 1 年前