Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Instant Intelligence is wild with Llama 3.1 8B + Groq 🤯

minchoi's profile picture

Min Choi

380,045 subscribers

693,014 görüntüleme • 2 yıl önce •via X (Twitter)

EğitimHaberler & PolitikaBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Min Choi profil fotoğrafı
Min Choi2 yıl önce

Check out all the key features of Llama 3.1 and how to access 👇

Min Choi profil fotoğrafı
Min Choi2 yıl önce

Also Kling AI is now available globally, check out wild AI videos 👇

Court Reinland profil fotoğrafı
Court Reinland2 yıl önce

The best timeline

Min Choi profil fotoğrafı
Min Choi2 yıl önce

🙏

Halim Alrasihi profil fotoğrafı
Halim Alrasihi2 yıl önce

It feels like magic

Min Choi profil fotoğrafı
Min Choi2 yıl önce

Magically fast

Jasper 🤘🌪️ profil fotoğrafı
Jasper 🤘🌪️2 yıl önce

We supported Llama 3.1 405B model on our distributed GPU network at @hyperbolic_labs. Come and use the API for FREE at

DeweyDNguyen profil fotoğrafı
DeweyDNguyen2 yıl önce

Next level

Min Choi profil fotoğrafı
Min Choi2 yıl önce

Pretty insane speed

Moe Saleh profil fotoğrafı
Moe Saleh2 yıl önce

I always get confused with groq and grok.

Min Choi profil fotoğrafı
Min Choi2 yıl önce

You aren't the only one 😅

Benzer Videolar

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉
0:39

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

Jonathan Ross

179,815 görüntüleme • 1 yıl önce

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.
0:20

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 görüntüleme • 2 yıl önce

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)
0:30

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Daniel San

359,980 görüntüleme • 2 yıl önce

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times
1:52

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times

kwindla

386,548 görüntüleme • 2 yıl önce

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b
0:41

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

FlowiseAI

48,208 görüntüleme • 2 yıl önce

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)
0:32

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)

Vaibhav (VB) Srivastav

82,126 görüntüleme • 1 yıl önce

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯
0:21

Llama 3.3 70B is now available on LlamaCoder through the Together AI API! Achieves similar performance to Llama 3.1 405B 🤯

Hassan

35,133 görüntüleme • 1 yıl önce

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.
0:22

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.

Alvaro Cintas

29,902 görüntüleme • 2 yıl önce

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:
0:24

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:

Matt Shumer

278,396 görüntüleme • 2 yıl önce

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:
0:44

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Alvaro Cintas

665,082 görüntüleme • 2 yıl önce

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁
0:34

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

Hatice Ozen

44,675 görüntüleme • 1 yıl önce

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI
1:48

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

kwindla

58,764 görüntüleme • 1 yıl önce

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond
1:22

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond

Satvik Paramkusham

162,863 görüntüleme • 2 yıl önce

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI
1:00

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI

AMD

39,130 görüntüleme • 2 yıl önce

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.
1:06

HOLY FUNIONS! Groq makes DeepSeek R1 feel instant! Cooked up a chatbot using their Distill Llama 70B. Releasing the repo tomorrow. You control your data flow.

Ray Fernando

54,028 görüntüleme • 1 yıl önce

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.
2:57

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

Ahmad Al-Dahle

866,703 görüntüleme • 2 yıl önce

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀
0:32

Llama 3.1 Now Available in VSCode as a Code Assistant via Groq Inc 🚨 You can now use this new AI at Meta model directly in VSCode using the CodeGPT extension My first impression: The model is incredible 🚀

Daniel San

263,015 görüntüleme • 2 yıl önce