Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Instant Intelligence is wild with Llama 3.1 8B + Groq 🤯

Min Choi

376,817 subscribers

692,931 views • 1 year ago •via X (Twitter)

Education News & Politics Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

Min Choi1 year ago

Check out all the key features of Llama 3.1 and how to access 👇

Min Choi1 year ago

Also Kling AI is now available globally, check out wild AI videos 👇

Court Reinland1 year ago

The best timeline

Min Choi1 year ago

🙏

Halim Alrasihi1 year ago

It feels like magic

Min Choi1 year ago

Magically fast

Jasper 🤘🌪️1 year ago

We supported Llama 3.1 405B model on our distributed GPU network at @hyperbolic_labs. Come and use the API for FREE at

DeweyDNguyen1 year ago

Next level

Min Choi1 year ago

Pretty insane speed

Moe Saleh1 year ago

I always get confused with groq and grok.

Min Choi1 year ago

You aren't the only one 😅

Related Videos

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

Jonathan Ross

179,815 views • 1 year ago

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 views • 1 year ago

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times

kwindla

386,493 views • 1 year ago

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

FlowiseAI

48,208 views • 1 year ago

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)

Vaibhav (VB) Srivastav

82,126 views • 1 year ago

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.

Alvaro Cintas

29,902 views • 2 years ago

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯

Hassan

35,133 views • 1 year ago

$Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:$

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:

Matt Shumer

278,384 views • 1 year ago

Stagehand is getting really fast ... See how Llama 3 70b on Groq Inc outperforms OpenAI 4o in speed on this form fill 54.48 seconds for groq VS 62.75 for 4o🤯

Stagehand is getting really fast ... See how Llama 3 70b on Groq Inc outperforms OpenAI 4o in speed on this form fill 54.48 seconds for groq VS 62.75 for 4o🤯

Kyle Jeong

26,095 views • 1 year ago

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Alvaro Cintas

665,067 views • 2 years ago

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

Hatice Ozen

44,675 views • 1 year ago

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

kwindla

58,649 views • 1 year ago

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond

Satvik Paramkusham

162,848 views • 1 year ago

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI

AMD

39,130 views • 2 years ago

deepseek-r1-distill-llama-70b on groq

deepseek-r1-distill-llama-70b on groq

Developers Digest

143,277 views • 1 year ago

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

Ray Fernando

54,028 views • 1 year ago

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

Ahmad Al-Dahle

866,426 views • 1 year ago

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀

Daniel San

263,015 views • 1 year ago