正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

NVIDIA silently released the Llama 3.1 70B Instruct Nemotron model which is topping leaderboards. You can try it here: I sat down with one of the researchers to learn how it performed so well and why they built this 🤙 Anything else I should ask him?

Nader Khalil🍊

12,443 subscribers

48,041 次观看 • 1 年前 •via X (Twitter)

新闻政治科学技术

Anya Rossi• Live Now

Private livecam show

11 条评论

Isaac 的头像

Isaac1 年前

As a Nvidia shareholder, I would like to vote for Nader for CMO

Tony Kam 的头像

Tony Kam1 年前

Nader for Nvidia CMO!

dar 的头像

dar1 年前

The stache strikes again

Nader Khalil🍊 的头像

Nader Khalil🍊1 年前

Put this on my tombstone 😂

Ozlem Peksoy Bishop 的头像

Ozlem Peksoy Bishop1 年前

not so quite anymore 🤓

Erika⚡️⚡️ 的头像

Erika⚡️⚡️1 年前

When the biggest technologists in the industry go direct. Long NVIDIA!!!

Dave Font 的头像

Dave Font1 年前

Can you do this with Jensen next!?

Oleksii Kuchaiev 的头像

Oleksii Kuchaiev1 年前

thanks for the great conversation! A key part of model’s recipe is hiring great interns (@AlexanderBukha1 ) who implement REINFORCE and actually train the model :)

Shadi Khalil 的头像

Shadi Khalil1 年前

🤙

Xander Dunn 的头像

Xander Dunn1 年前

By the way, your audio here is stereo right-only. With headphones, I hear it only in my right ear.

Nader Khalil🍊 的头像

Nader Khalil🍊1 年前

Ahh wow thanks for the heads up. I thought I fixed this. Will fix it for the next video

相关视频

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

NVIDIA AI Developer

140,699 次观看 • 1 年前

“There's two reasons why we're building Nemotron. The first is because it helps us build the GPUs and systems for the future.” The second reason is because trust is the foundation of impactful AI–and it starts with understanding. That’s why Nemotron was built open source at its core—so developers, researchers, and enterprises can build together. Hear from Bryan Catanzaro, VP of Applied Deep Learning Research at NVIDIA, on why making AI open benefits everyone. 👉

“There's two reasons why we're building Nemotron. The first is because it helps us build the GPUs and systems for the future.” The second reason is because trust is the foundation of impactful AI–and it starts with understanding. That’s why Nemotron was built open source at its core—so developers, researchers, and enterprises can build together. Hear from Bryan Catanzaro, VP of Applied Deep Learning Research at NVIDIA, on why making AI open benefits everyone. 👉

NVIDIA

64,807 次观看 • 9 个月前

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

Santiago

97,505 次观看 • 1 年前

You can now try Llama 3.1 405B for free (link below)! This is the largest open-source model out there, and for the first time, an open model is competitive with closed models. This time around, Meta did something new: Llama 3.1 has a license that allows developers to use it to enhance other models. For the first time, you can distill Llama 3.1 405B's capabilities into a smaller, more practical model for your use case. First, here is the link where you can play with Llama 3.1 for free: The model is hosted in Tune Studio, an end-to-end platform for developing applications using Large Language Models. They are sponsoring this post. Take a look at the attached video. It will show you how you can fine-tune a simple model using Llama 3.1 without leaving the platform: 1. You can create an empty dataset 2. Use the playground to generate and record interactions with Llama 3.1 3. Modify the dataset directly using the playground 4. Export the data and fine-tune a smaller model Fast and easy! As long as you have a web browser, you can start experimenting with fine-tuning and Llama 3.1. That's all it takes!

You can now try Llama 3.1 405B for free (link below)! This is the largest open-source model out there, and for the first time, an open model is competitive with closed models. This time around, Meta did something new: Llama 3.1 has a license that allows developers to use it to enhance other models. For the first time, you can distill Llama 3.1 405B's capabilities into a smaller, more practical model for your use case. First, here is the link where you can play with Llama 3.1 for free: The model is hosted in Tune Studio, an end-to-end platform for developing applications using Large Language Models. They are sponsoring this post. Take a look at the attached video. It will show you how you can fine-tune a simple model using Llama 3.1 without leaving the platform: 1. You can create an empty dataset 2. Use the playground to generate and record interactions with Llama 3.1 3. Modify the dataset directly using the playground 4. Export the data and fine-tune a smaller model Fast and easy! As long as you have a web browser, you can start experimenting with fine-tuning and Llama 3.1. That's all it takes!

Santiago

55,609 次观看 • 1 年前

so i'm at the central state museum of Kazakhstan, and they have this dombra exhibit. i notice that one of them is modern-looking and out of a case, so i ask one of the docents if i could try playing it. i sit down & start strumming away, basically playing it like a balalaika one of the other guests, a middle-aged Kazakh guy there with his family, is watching me, and i can recognize the antsy look of someone watching someone else butchering their instrument, so i hand it to him he pops off his shoes, sits down, and starts *wailing* on it after two songs, the docent is like "wait, sit here" and slides this table over to him, which has this little string attached. he slips it around his pinky, and… 🎶🐐🎶

so i'm at the central state museum of Kazakhstan, and they have this dombra exhibit. i notice that one of them is modern-looking and out of a case, so i ask one of the docents if i could try playing it. i sit down & start strumming away, basically playing it like a balalaika one of the other guests, a middle-aged Kazakh guy there with his family, is watching me, and i can recognize the antsy look of someone watching someone else butchering their instrument, so i hand it to him he pops off his shoes, sits down, and starts wailing on it after two songs, the docent is like "wait, sit here" and slides this table over to him, which has this little string attached. he slips it around his pinky, and… 🎶🐐🎶

iwsfutcmd

36,803 次观看 • 10 个月前

Ilya and David Chalmers, the same vibe.. "Anything which I can learn, anything which any one of you can learn, the AI could do as well. The reason is that all of us have a brain, and the brain is a biological computer. So why can't the digital computer, do the same things?"

Ilya and David Chalmers, the same vibe.. "Anything which I can learn, anything which any one of you can learn, the AI could do as well. The reason is that all of us have a brain, and the brain is a biological computer. So why can't the digital computer, do the same things?"

Rohan Paul

119,333 次观看 • 8 个月前

“if I could switch bodies with one of the members, I’d choose mark hyung. he’s done so many activities, so it must be exhausting. that’s why I want to experience for myself how hard it really is, so I can understand how well I should take care of him" - jeno

“if I could switch bodies with one of the members, I’d choose mark hyung. he’s done so many activities, so it must be exhausting. that’s why I want to experience for myself how hard it really is, so I can understand how well I should take care of him" - jeno

sam 💭

112,524 次观看 • 1 个月前

“Holiness is pure motives”. This break down of holiness is one of the reasons I beg people to try and study the etymology of a word so that you can truly understand weight and depths not the vibes and emotions built around it

“Holiness is pure motives”. This break down of holiness is one of the reasons I beg people to try and study the etymology of a word so that you can truly understand weight and depths not the vibes and emotions built around it

Dr. God Abeg ooo

33,378 次观看 • 4 个月前

One of the things I always ask people in political organizing is, “What is your why?” I sat down with Zayed Kadir, the chair of the High School Democrats of America, to hear what inspires him to do this work.

One of the things I always ask people in political organizing is, “What is your why?” I sat down with Zayed Kadir, the chair of the High School Democrats of America, to hear what inspires him to do this work.

Ken Martin

15,907 次观看 • 11 个月前

I would like to personally thank the Carolina Panthers for using this bouncing kickoff in the preseason Here is why I think it can work and why more teams should try it out:

I would like to personally thank the Carolina Panthers for using this bouncing kickoff in the preseason Here is why I think it can work and why more teams should try it out:

Shawn Syed

374,685 次观看 • 10 个月前

Dominion AI (Dominion AI) is a new, Christian-built alternative to mainstream AI models like ChatGPT and Claude. I had a conversation with the founders to learn about why they created it, what it can do, and who it's for. The full interview is now on X. Try Dominion here:

Dominion AI (Dominion AI) is a new, Christian-built alternative to mainstream AI models like ChatGPT and Claude. I had a conversation with the founders to learn about why they created it, what it can do, and who it's for. The full interview is now on X. Try Dominion here:

ZUBY:

18,040 次观看 • 29 天前

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

Ahmad Al-Dahle

866,426 次观看 • 1 年前

Loved this idea Dan Go , so I went ahead and built it. Here's a video of it in action and you can try it yourself here:

Loved this idea Dan Go , so I went ahead and built it. Here's a video of it in action and you can try it yourself here:

Matt Boyle

36,324 次观看 • 5 个月前

After analyzing 100+ OpenClaw mission controls, I cracked the code on building them. I built this one in one-prompt with Lovable. The full prompt for this is below. Give it a try in Lovable↓ I recorded an entire video on how to connect Lovable + OpenClaw which I'll include as well. PS. I'd usually gate-keep this but if you find it valuable - I'd just ask you show some love in the comments + follow.

After analyzing 100+ OpenClaw mission controls, I cracked the code on building them. I built this one in one-prompt with Lovable. The full prompt for this is below. Give it a try in Lovable↓ I recorded an entire video on how to connect Lovable + OpenClaw which I'll include as well. PS. I'd usually gate-keep this but if you find it valuable - I'd just ask you show some love in the comments + follow.

Jacob Klug

15,513 次观看 • 3 个月前

Greatness recognizes greatness. Kobe Bryant: “Elon Musk is I think a genius by all accounts, but his commitment and his work… like I asked him one time about how does he learn. And the amount of research and the amount of study that he does is unheard of, but he’ll always say the most important thing is imagination. So you can learn anything that you want to learn, you can study all these things that you have in a book, but if you don’t have the imagination to then take it to another level, it doesn’t mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy.” Interviewer: “So would you buy Tesla stock then?” Kobe Bryant: “I’ll buy into Elon.” The Mamba saw the vision early, a legend recognizing another one. One thing I’ve learned in life is that winners learn from winners. They study them. They spend time around them. They listen carefully to how they think. Losers in life usually do the opposite. They stay around other people who complain, make excuses, and stay stuck. That’s why people always say you become the average of the five people you spend the most time with. It’s real. If you surround yourself with greatness, ambition, and people who dream big, it starts to rub off on you. You begin to think bigger. Work harder. Expect more from yourself. It’s contagious. That’s why it matters so much who you listen to, who you follow, and who you choose to learn from. Greatness spreads. And once you’re around it long enough… it starts to become part of you.

Greatness recognizes greatness. Kobe Bryant: “Elon Musk is I think a genius by all accounts, but his commitment and his work… like I asked him one time about how does he learn. And the amount of research and the amount of study that he does is unheard of, but he’ll always say the most important thing is imagination. So you can learn anything that you want to learn, you can study all these things that you have in a book, but if you don’t have the imagination to then take it to another level, it doesn’t mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy.” Interviewer: “So would you buy Tesla stock then?” Kobe Bryant: “I’ll buy into Elon.” The Mamba saw the vision early, a legend recognizing another one. One thing I’ve learned in life is that winners learn from winners. They study them. They spend time around them. They listen carefully to how they think. Losers in life usually do the opposite. They stay around other people who complain, make excuses, and stay stuck. That’s why people always say you become the average of the five people you spend the most time with. It’s real. If you surround yourself with greatness, ambition, and people who dream big, it starts to rub off on you. You begin to think bigger. Work harder. Expect more from yourself. It’s contagious. That’s why it matters so much who you listen to, who you follow, and who you choose to learn from. Greatness spreads. And once you’re around it long enough… it starts to become part of you.

Teslaconomics

89,906 次观看 • 3 个月前

🚨 JUST IN: President Trump SHUTS DOWN CNN’s Kaitlan Collins’ attempts to corner him on nationalizing elections “I want to see elections be HONEST… [States] can administer the elections, but they have to do it HONESTLY.” “When you see some of these states with how HORRIBLY they run their elections and what a disgrace it is, the federal government should not allow that. The federal government should get involved, If they can't count votes legally and honestly, then somebody else should take over.” WHY IS THAT SUCH A CONTROVERSIAL ASK?!

🚨 JUST IN: President Trump SHUTS DOWN CNN’s Kaitlan Collins’ attempts to corner him on nationalizing elections “I want to see elections be HONEST… [States] can administer the elections, but they have to do it HONESTLY.” “When you see some of these states with how HORRIBLY they run their elections and what a disgrace it is, the federal government should not allow that. The federal government should get involved, If they can't count votes legally and honestly, then somebody else should take over.” WHY IS THAT SUCH A CONTROVERSIAL ASK?!

Nick Sortor

174,739 次观看 • 4 个月前

this guy is the antithesis of this, and I think of this video often (and before some angry guys get in here - it works both ways, both partners should be trying to do this) "I think one of the most important things is finding the tiniest and smallest things you can do to serve your significant other ... and so my job is to figure out what she needs and do it, and more importantly try to do that before someone has to ask you to do it... I'll be honest, it's the small things"

this guy is the antithesis of this, and I think of this video often (and before some angry guys get in here - it works both ways, both partners should be trying to do this) "I think one of the most important things is finding the tiniest and smallest things you can do to serve your significant other ... and so my job is to figure out what she needs and do it, and more importantly try to do that before someone has to ask you to do it... I'll be honest, it's the small things"

Vanessa Kade

41,232 次观看 • 1 年前

That’s how it looks and sounds here. So when someone is saying it’s a politics. Well I told in a video where you should go. Keep supporting Ukraine 🇺🇦 and just try to imagine in which circumstances MONTE ESPORTS 🇺🇦 will was built. #russiaisaterriststate

That’s how it looks and sounds here. So when someone is saying it’s a politics. Well I told in a video where you should go. Keep supporting Ukraine 🇺🇦 and just try to imagine in which circumstances MONTE ESPORTS 🇺🇦 will was built. #russiaisaterriststate

Sergiy LMBT Bezhanov

178,418 次观看 • 3 年前

Why is this happening and how I can fix it. So I can announce the winner.

Why is this happening and how I can fix it. So I can announce the winner.

Ducky Bhai

304,638 次观看 • 2 年前

The most important story of every business is the one about _why_ it exists. Pulling this story out of a business is hard to do well. I challenged our team to try anyway and I love what they came back with. *This* is why Shopify exists.

The most important story of every business is the one about _why_ it exists. Pulling this story out of a business is hard to do well. I challenged our team to try anyway and I love what they came back with. This is why Shopify exists.

tobi lutke

446,824 次观看 • 2 年前