Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

NVIDIA silently released the Llama 3.1 70B Instruct Nemotron model which is topping leaderboards. You can try it here: I sat down with one of the researchers to learn how it performed so well and why they built this 🤙 Anything else I should ask him?

Nader Khalil🍊

13,173 subscribers

48,344 views • 1 year ago •via X (Twitter)

News & Politics Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

Isaac1 year ago

As a Nvidia shareholder, I would like to vote for Nader for CMO

Tony Kam1 year ago

Nader for Nvidia CMO!

dar1 year ago

The stache strikes again

Nader Khalil🍊1 year ago

Put this on my tombstone 😂

Ozlem Peksoy Bishop1 year ago

not so quite anymore 🤓

Erika⚡️⚡️1 year ago

When the biggest technologists in the industry go direct. Long NVIDIA!!!

Dave Font1 year ago

Can you do this with Jensen next!?

Oleksii Kuchaiev1 year ago

thanks for the great conversation! A key part of model’s recipe is hiring great interns (@AlexanderBukha1 ) who implement REINFORCE and actually train the model :)

Shadi Khalil1 year ago

🤙

Xander Dunn1 year ago

By the way, your audio here is stereo right-only. With headphones, I hear it only in my right ear.

Nader Khalil🍊1 year ago

Ahh wow thanks for the heads up. I thought I fixed this. Will fix it for the next video

Related Videos

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

Our Llama-3.1-Nemotron-70B-Instruct model is a leading model on the 🏆 Arena Hard benchmark (85) from Arena. Arena Hard uses a data pipeline to build high-quality benchmarks from live data in Chatbot Arena, and is known for its predictive ability of Chatbot Arena Elo score as well as separability between helpful and less helpful models. Use our customized model Llama-3.1-Nemotron-70B to improve the helpfulness of LLM generated responses in your applications. 📥 Try on our API catalog: 📥 On GitHub: 📥 Or on Hugging Face:

NVIDIA AI Developer

140,800 views • 1 year ago

“There's two reasons why we're building Nemotron. The first is because it helps us build the GPUs and systems for the future.” The second reason is because trust is the foundation of impactful AI–and it starts with understanding. That’s why Nemotron was built open source at its core—so developers, researchers, and enterprises can build together. Hear from Bryan Catanzaro, VP of Applied Deep Learning Research at NVIDIA, on why making AI open benefits everyone. 👉

“There's two reasons why we're building Nemotron. The first is because it helps us build the GPUs and systems for the future.” The second reason is because trust is the foundation of impactful AI–and it starts with understanding. That’s why Nemotron was built open source at its core—so developers, researchers, and enterprises can build together. Hear from Bryan Catanzaro, VP of Applied Deep Learning Research at NVIDIA, on why making AI open benefits everyone. 👉

NVIDIA

64,826 views • 10 months ago

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

This is the fastest I've seen Llama 3.3 running anywhere! Llama 3.3 70B running at 652 t/s is lightning fast. And if you want Llama 3.1, here are the speeds I was able to get: • Llama 3.1 8B: 1006 t/s • Llama 3.1 70B: 709 t/s • Llama 3.1 405B: 206 t/s (You can access all of these models for free! See the link below.) This speed is incredible, but the interesting part is what's happening behind the scenes: These models aren't running on a GPU! In this video, I'm using the SambaNova cloud to access these models. They built a custom chip (SN40L) optimized for AI workflows. A single SN40L chip can hold hundreds of models (trillions of parameters) in memory! The speed alone is a huge deal, but the big advantage is for agentic workflows running multiple specialized models. A GPU can only host a single model and switch (unload and load) to a different model if necessary. An SN40L, on the other hand, can host every model at once, making it much faster. Here is the video where you can see how fast these chips are:

Santiago

97,543 views • 1 year ago

You can now try Llama 3.1 405B for free (link below)! This is the largest open-source model out there, and for the first time, an open model is competitive with closed models. This time around, Meta did something new: Llama 3.1 has a license that allows developers to use it to enhance other models. For the first time, you can distill Llama 3.1 405B's capabilities into a smaller, more practical model for your use case. First, here is the link where you can play with Llama 3.1 for free: The model is hosted in Tune Studio, an end-to-end platform for developing applications using Large Language Models. They are sponsoring this post. Take a look at the attached video. It will show you how you can fine-tune a simple model using Llama 3.1 without leaving the platform: 1. You can create an empty dataset 2. Use the playground to generate and record interactions with Llama 3.1 3. Modify the dataset directly using the playground 4. Export the data and fine-tune a smaller model Fast and easy! As long as you have a web browser, you can start experimenting with fine-tuning and Llama 3.1. That's all it takes!

You can now try Llama 3.1 405B for free (link below)! This is the largest open-source model out there, and for the first time, an open model is competitive with closed models. This time around, Meta did something new: Llama 3.1 has a license that allows developers to use it to enhance other models. For the first time, you can distill Llama 3.1 405B's capabilities into a smaller, more practical model for your use case. First, here is the link where you can play with Llama 3.1 for free: The model is hosted in Tune Studio, an end-to-end platform for developing applications using Large Language Models. They are sponsoring this post. Take a look at the attached video. It will show you how you can fine-tune a simple model using Llama 3.1 without leaving the platform: 1. You can create an empty dataset 2. Use the playground to generate and record interactions with Llama 3.1 3. Modify the dataset directly using the playground 4. Export the data and fine-tune a smaller model Fast and easy! As long as you have a web browser, you can start experimenting with fine-tuning and Llama 3.1. That's all it takes!

Santiago

55,609 views • 2 years ago

so i'm at the central state museum of Kazakhstan, and they have this dombra exhibit. i notice that one of them is modern-looking and out of a case, so i ask one of the docents if i could try playing it. i sit down & start strumming away, basically playing it like a balalaika one of the other guests, a middle-aged Kazakh guy there with his family, is watching me, and i can recognize the antsy look of someone watching someone else butchering their instrument, so i hand it to him he pops off his shoes, sits down, and starts *wailing* on it after two songs, the docent is like "wait, sit here" and slides this table over to him, which has this little string attached. he slips it around his pinky, and… 🎶🐐🎶

so i'm at the central state museum of Kazakhstan, and they have this dombra exhibit. i notice that one of them is modern-looking and out of a case, so i ask one of the docents if i could try playing it. i sit down & start strumming away, basically playing it like a balalaika one of the other guests, a middle-aged Kazakh guy there with his family, is watching me, and i can recognize the antsy look of someone watching someone else butchering their instrument, so i hand it to him he pops off his shoes, sits down, and starts wailing on it after two songs, the docent is like "wait, sit here" and slides this table over to him, which has this little string attached. he slips it around his pinky, and… 🎶🐐🎶

iwsfutcmd

36,803 views • 1 year ago

Ilya and David Chalmers, the same vibe.. "Anything which I can learn, anything which any one of you can learn, the AI could do as well. The reason is that all of us have a brain, and the brain is a biological computer. So why can't the digital computer, do the same things?"

Ilya and David Chalmers, the same vibe.. "Anything which I can learn, anything which any one of you can learn, the AI could do as well. The reason is that all of us have a brain, and the brain is a biological computer. So why can't the digital computer, do the same things?"

Rohan Paul

119,333 views • 9 months ago

"Elon Musk is a genius by all accounts. His commitment and his work, like I asked him one time about how does he learn. And the amount of research, the amount of study that he does is unheard of, but he'll always say the most important thing is imagination. You can learn anything that you want to learn. You can study all these things that you have in a book. If you don't have the imagination to take it to another level, it doesn't mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy." — Kobe Bryant

"Elon Musk is a genius by all accounts. His commitment and his work, like I asked him one time about how does he learn. And the amount of research, the amount of study that he does is unheard of, but he'll always say the most important thing is imagination. You can learn anything that you want to learn. You can study all these things that you have in a book. If you don't have the imagination to take it to another level, it doesn't mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy." — Kobe Bryant

DogeDesigner

241,985 views • 1 month ago

“Holiness is pure motives”. This break down of holiness is one of the reasons I beg people to try and study the etymology of a word so that you can truly understand weight and depths not the vibes and emotions built around it

“Holiness is pure motives”. This break down of holiness is one of the reasons I beg people to try and study the etymology of a word so that you can truly understand weight and depths not the vibes and emotions built around it

Dr. God Abeg ooo

33,516 views • 5 months ago

One of the things I always ask people in political organizing is, “What is your why?” I sat down with Zayed Kadir, the chair of the High School Democrats of America, to hear what inspires him to do this work.

One of the things I always ask people in political organizing is, “What is your why?” I sat down with Zayed Kadir, the chair of the High School Democrats of America, to hear what inspires him to do this work.

Ken Martin

15,911 views • 1 year ago

I would like to personally thank the Carolina Panthers for using this bouncing kickoff in the preseason Here is why I think it can work and why more teams should try it out:

I would like to personally thank the Carolina Panthers for using this bouncing kickoff in the preseason Here is why I think it can work and why more teams should try it out:

Shawn Syed

374,685 views • 1 year ago

one of the most beautiful things about OpenAI is that every employee really has a voice. i wanted to capture what it feels like to work here, what our mission means to me, and why you should join us. so i made this video with Codex, shared it with the team, and they felt it was worth producing and sharing with the world. this is our mission. and it’s why i’m here.

one of the most beautiful things about OpenAI is that every employee really has a voice. i wanted to capture what it feels like to work here, what our mission means to me, and why you should join us. so i made this video with Codex, shared it with the team, and they felt it was worth producing and sharing with the world. this is our mission. and it’s why i’m here.

jason

2,144,771 views • 17 days ago

Dominion AI (Dominion AI) is a new, Christian-built alternative to mainstream AI models like ChatGPT and Claude. I had a conversation with the founders to learn about why they created it, what it can do, and who it's for. The full interview is now on X. Try Dominion here:

Dominion AI (Dominion AI) is a new, Christian-built alternative to mainstream AI models like ChatGPT and Claude. I had a conversation with the founders to learn about why they created it, what it can do, and who it's for. The full interview is now on X. Try Dominion here:

ZUBY:

18,223 views • 2 months ago

Greatness recognizes greatness. Kobe Bryant: “Elon Musk is I think a genius by all accounts, but his commitment and his work… like I asked him one time about how does he learn. And the amount of research and the amount of study that he does is unheard of, but he’ll always say the most important thing is imagination. So you can learn anything that you want to learn, you can study all these things that you have in a book, but if you don’t have the imagination to then take it to another level, it doesn’t mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy.” Interviewer: “So would you buy Tesla stock then?” Kobe Bryant: “I’ll buy into Elon.” The Mamba saw the vision early, a legend recognizing another one. One thing I’ve learned in life is that winners learn from winners. They study them. They spend time around them. They listen carefully to how they think. Losers in life usually do the opposite. They stay around other people who complain, make excuses, and stay stuck. That’s why people always say you become the average of the five people you spend the most time with. It’s real. If you surround yourself with greatness, ambition, and people who dream big, it starts to rub off on you. You begin to think bigger. Work harder. Expect more from yourself. It’s contagious. That’s why it matters so much who you listen to, who you follow, and who you choose to learn from. Greatness spreads. And once you’re around it long enough… it starts to become part of you.

Greatness recognizes greatness. Kobe Bryant: “Elon Musk is I think a genius by all accounts, but his commitment and his work… like I asked him one time about how does he learn. And the amount of research and the amount of study that he does is unheard of, but he’ll always say the most important thing is imagination. So you can learn anything that you want to learn, you can study all these things that you have in a book, but if you don’t have the imagination to then take it to another level, it doesn’t mean anything. I sat down and spoke with Elon for a couple hours. It was really, really a joy.” Interviewer: “So would you buy Tesla stock then?” Kobe Bryant: “I’ll buy into Elon.” The Mamba saw the vision early, a legend recognizing another one. One thing I’ve learned in life is that winners learn from winners. They study them. They spend time around them. They listen carefully to how they think. Losers in life usually do the opposite. They stay around other people who complain, make excuses, and stay stuck. That’s why people always say you become the average of the five people you spend the most time with. It’s real. If you surround yourself with greatness, ambition, and people who dream big, it starts to rub off on you. You begin to think bigger. Work harder. Expect more from yourself. It’s contagious. That’s why it matters so much who you listen to, who you follow, and who you choose to learn from. Greatness spreads. And once you’re around it long enough… it starts to become part of you.

Teslaconomics

90,037 views • 5 months ago

After analyzing 100+ OpenClaw mission controls, I cracked the code on building them. I built this one in one-prompt with Lovable. The full prompt for this is below. Give it a try in Lovable↓ I recorded an entire video on how to connect Lovable + OpenClaw which I'll include as well. PS. I'd usually gate-keep this but if you find it valuable - I'd just ask you show some love in the comments + follow.

After analyzing 100+ OpenClaw mission controls, I cracked the code on building them. I built this one in one-prompt with Lovable. The full prompt for this is below. Give it a try in Lovable↓ I recorded an entire video on how to connect Lovable + OpenClaw which I'll include as well. PS. I'd usually gate-keep this but if you find it valuable - I'd just ask you show some love in the comments + follow.

Jacob Klug

15,564 views • 5 months ago

Loved this idea Dan Go , so I went ahead and built it. Here's a video of it in action and you can try it yourself here:

Loved this idea Dan Go , so I went ahead and built it. Here's a video of it in action and you can try it yourself here:

Matt Boyle

36,324 views • 7 months ago

🚨 JUST IN: President Trump SHUTS DOWN CNN’s Kaitlan Collins’ attempts to corner him on nationalizing elections “I want to see elections be HONEST… [States] can administer the elections, but they have to do it HONESTLY.” “When you see some of these states with how HORRIBLY they run their elections and what a disgrace it is, the federal government should not allow that. The federal government should get involved, If they can't count votes legally and honestly, then somebody else should take over.” WHY IS THAT SUCH A CONTROVERSIAL ASK?!

🚨 JUST IN: President Trump SHUTS DOWN CNN’s Kaitlan Collins’ attempts to corner him on nationalizing elections “I want to see elections be HONEST… [States] can administer the elections, but they have to do it HONESTLY.” “When you see some of these states with how HORRIBLY they run their elections and what a disgrace it is, the federal government should not allow that. The federal government should get involved, If they can't count votes legally and honestly, then somebody else should take over.” WHY IS THAT SUCH A CONTROVERSIAL ASK?!

Nick Sortor

174,739 views • 6 months ago

this guy is the antithesis of this, and I think of this video often (and before some angry guys get in here - it works both ways, both partners should be trying to do this) "I think one of the most important things is finding the tiniest and smallest things you can do to serve your significant other ... and so my job is to figure out what she needs and do it, and more importantly try to do that before someone has to ask you to do it... I'll be honest, it's the small things"

this guy is the antithesis of this, and I think of this video often (and before some angry guys get in here - it works both ways, both partners should be trying to do this) "I think one of the most important things is finding the tiniest and smallest things you can do to serve your significant other ... and so my job is to figure out what she needs and do it, and more importantly try to do that before someone has to ask you to do it... I'll be honest, it's the small things"

Vanessa Kade

41,232 views • 1 year ago

That’s how it looks and sounds here. So when someone is saying it’s a politics. Well I told in a video where you should go. Keep supporting Ukraine 🇺🇦 and just try to imagine in which circumstances MONTE ESPORTS 🇺🇦 will was built. #russiaisaterriststate

That’s how it looks and sounds here. So when someone is saying it’s a politics. Well I told in a video where you should go. Keep supporting Ukraine 🇺🇦 and just try to imagine in which circumstances MONTE ESPORTS 🇺🇦 will was built. #russiaisaterriststate

Sergiy LMBT Bezhanov

178,454 views • 3 years ago

I tried to tell y’all how it works when I’m on the beach or in a tourists trap. I see these guys walking around with icy drinks and since everything else in the country was cheaper than they are here I would assume his drinks would be too. These guys will come by and even take your “order” if I don’t see something I want, he will say he can make it for me. These women fell for this and ordered 3 drinks from him. One of the ladies was so thirsty she immediately started drinking it until he told them they owed him $75. Mind you these are adult drinks, the cups look to be a decent size so is it worth it or are they just tripping out? I am on the fence with this one, if it’s clean and good quality, I may say this is a fair price but the only one I’m questioning is the one who tried to give it back after she already drank out of it. Rarely will I side with a street merchant because I feel like they’ve ripped me off quite a few times. But I think his price is valid for this. I’ve paid close to the same price for much less when I was at the beach. Most of the time I can tell they are well drinks that they tell me are too shelf. Many people can’t tell the difference but I can. I only drink certain brands and I am very used to what they taste like. This kind of interaction is why I now only buy from restaurants and bars like I mentioned before. I am not going to get into an argument with someone over something I ordered but failed to check the price first. That old saying, “if you have to ask them you can’t afford it.” That doesn’t apply here because if I have to ask then it means they should have listed the price up front.

I tried to tell y’all how it works when I’m on the beach or in a tourists trap. I see these guys walking around with icy drinks and since everything else in the country was cheaper than they are here I would assume his drinks would be too. These guys will come by and even take your “order” if I don’t see something I want, he will say he can make it for me. These women fell for this and ordered 3 drinks from him. One of the ladies was so thirsty she immediately started drinking it until he told them they owed him $75. Mind you these are adult drinks, the cups look to be a decent size so is it worth it or are they just tripping out? I am on the fence with this one, if it’s clean and good quality, I may say this is a fair price but the only one I’m questioning is the one who tried to give it back after she already drank out of it. Rarely will I side with a street merchant because I feel like they’ve ripped me off quite a few times. But I think his price is valid for this. I’ve paid close to the same price for much less when I was at the beach. Most of the time I can tell they are well drinks that they tell me are too shelf. Many people can’t tell the difference but I can. I only drink certain brands and I am very used to what they taste like. This kind of interaction is why I now only buy from restaurants and bars like I mentioned before. I am not going to get into an argument with someone over something I ordered but failed to check the price first. That old saying, “if you have to ask them you can’t afford it.” That doesn’t apply here because if I have to ask then it means they should have listed the price up front.

SonnyBoy🇺🇸

289,573 views • 1 month ago

Why is this happening and how I can fix it. So I can announce the winner.

Why is this happening and how I can fix it. So I can announce the winner.

Ducky Bhai

304,902 views • 2 years ago