Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Instant Intelligence is wild with Llama 3.1 8B + Groq 🤯

minchoi's profile picture

Min Choi

376,221 subscribers

692,936 Aufrufe • vor 2 Jahren •via X (Twitter)

BildungNachrichten & PolitikWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Min Choi
Min Choivor 2 Jahren

Check out all the key features of Llama 3.1 and how to access 👇

Profilbild von Min Choi
Min Choivor 2 Jahren

Also Kling AI is now available globally, check out wild AI videos 👇

Profilbild von Court Reinland
Court Reinlandvor 2 Jahren

The best timeline

Profilbild von Min Choi
Min Choivor 2 Jahren

🙏

Profilbild von Halim Alrasihi
Halim Alrasihivor 2 Jahren

It feels like magic

Profilbild von Min Choi
Min Choivor 2 Jahren

Magically fast

Profilbild von Jasper 🤘🌪️
Jasper 🤘🌪️vor 2 Jahren

We supported Llama 3.1 405B model on our distributed GPU network at @hyperbolic_labs. Come and use the API for FREE at

Profilbild von DeweyDNguyen
DeweyDNguyenvor 2 Jahren

Next level

Profilbild von Min Choi
Min Choivor 2 Jahren

Pretty insane speed

Profilbild von Moe Saleh
Moe Salehvor 2 Jahren

I always get confused with groq and grok.

Profilbild von Min Choi
Min Choivor 2 Jahren

You aren't the only one 😅

Ähnliche Videos

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉
0:39

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

Jonathan Ross

179,815 Aufrufe • vor 1 Jahr

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.
0:20

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 Aufrufe • vor 2 Jahren

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)
0:30

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Daniel San

359,968 Aufrufe • vor 2 Jahren

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times
1:52

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times

kwindla

386,505 Aufrufe • vor 2 Jahren

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b
0:41

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

FlowiseAI

48,208 Aufrufe • vor 2 Jahren

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)
0:32

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)

Vaibhav (VB) Srivastav

82,126 Aufrufe • vor 1 Jahr

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯
0:21

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯

Hassan

35,133 Aufrufe • vor 1 Jahr

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.
0:22

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.

Alvaro Cintas

29,902 Aufrufe • vor 2 Jahren

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:
0:24

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:

Matt Shumer

278,396 Aufrufe • vor 2 Jahren

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:
0:44

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Alvaro Cintas

665,082 Aufrufe • vor 2 Jahren

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁
0:34

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

Hatice Ozen

44,675 Aufrufe • vor 1 Jahr

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI
1:48

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

kwindla

58,720 Aufrufe • vor 1 Jahr

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond
1:22

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond

Satvik Paramkusham

162,848 Aufrufe • vor 2 Jahren

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI
1:00

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI

AMD

39,130 Aufrufe • vor 2 Jahren

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.
1:06

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

Ray Fernando

54,028 Aufrufe • vor 1 Jahr

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.
2:57

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

Ahmad Al-Dahle

866,615 Aufrufe • vor 2 Jahren

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀
0:32

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀

Daniel San

263,015 Aufrufe • vor 2 Jahren