正在加载视频...

视频加载失败

返回首页

Instant Intelligence is wild with Llama 3.1 8B + Groq 🤯

minchoi's profile picture

Min Choi

380,045 subscribers

693,014 次观看 • 2 年前 •via X (Twitter)

教育新闻政治科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

11 条评论

Min Choi 的头像
Min Choi2 年前

Check out all the key features of Llama 3.1 and how to access 👇

Min Choi 的头像
Min Choi2 年前

Also Kling AI is now available globally, check out wild AI videos 👇

Court Reinland 的头像
Court Reinland2 年前

The best timeline

Min Choi 的头像
Min Choi2 年前

🙏

Halim Alrasihi 的头像
Halim Alrasihi2 年前

It feels like magic

Min Choi 的头像
Min Choi2 年前

Magically fast

Jasper 🤘🌪️ 的头像
Jasper 🤘🌪️2 年前

We supported Llama 3.1 405B model on our distributed GPU network at @hyperbolic_labs. Come and use the API for FREE at

DeweyDNguyen 的头像
DeweyDNguyen2 年前

Next level

Min Choi 的头像
Min Choi2 年前

Pretty insane speed

Moe Saleh 的头像
Moe Saleh2 年前

I always get confused with groq and grok.

Min Choi 的头像
Min Choi2 年前

You aren't the only one 😅

相关视频

To illustrate the type of tech we now have access to, I built a Streamlit app that uses Groq Inc instant LLama 3.1 8B and new 2.5 turbo model. We now have cheap, instant voice AI. ⚡️ Imagine the amazing things you can build. But I'll let Richard say more.
0:23

To illustrate the type of tech we now have access to, I built a Streamlit app that uses Groq Inc instant LLama 3.1 8B and new 2.5 turbo model. We now have cheap, instant voice AI. ⚡️ Imagine the amazing things you can build. But I'll let Richard say more.

Pietro Schirano

74,612 次观看 • 2 年前

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉
0:39

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

Jonathan Ross

179,815 次观看 • 1 年前

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.
0:20

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 次观看 • 2 年前

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)
0:30

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Daniel San

359,980 次观看 • 2 年前

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times
1:52

Very, very fast voice bots. Llama 3.1 running on Groq Inc. 🚀 500ms voice-to-voice response times

kwindla

386,550 次观看 • 2 年前

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b
0:41

Running multi agents on open source models has always been a hit or miss until... Llama 3.1 on Groq Inc with 405b and 70b

FlowiseAI

48,208 次观看 • 2 年前

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)
0:32

Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥 > WhisperSpeech X Llama 3.1 8B > Trained on 50K hours of speech (7 languages) > Continually trained on 45hrs 10x A1000s > MLS -> WhisperVQ tokens -> Llama 3.1 > Instruction tuned on 1.89M samples > 70% speech, 20% transcription, 10% text > Apache 2.0 licensed ⚡ Architecture: > WhisperSpeech/ VQ for Semantic Tokens > Llama 3.1 8B Instruct for Text backbone > Early fusion (Chameleon) I'm super bullish on Homebrew to Menlo and early fusion, audio and text, multimodal models! (P.S. Play with the demo on Hugging Face)

Vaibhav (VB) Srivastav

82,126 次观看 • 1 年前

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.
0:22

Apple Intelligence looks amazing, but we can’t try it until later this year. So I created an iPhone shortcut that uses Llama 3 with Groq completely for free, and check out how fast it is 🤯 Full video tutorial in the comments.

Alvaro Cintas

29,902 次观看 • 2 年前

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:
0:24

Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source:

Matt Shumer

278,396 次观看 • 2 年前

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:
0:44

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Alvaro Cintas

665,082 次观看 • 2 年前

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁
0:34

PSA: DeepSeek R1 Distill Llama 70B speculative decoding version is now live on Groq Inc for Dev Tier. We just made fast even faster for instant reasoning. 🏁

Hatice Ozen

44,675 次观看 • 1 年前

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI
1:48

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

kwindla

58,764 次观看 • 1 年前

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond
1:22

🤯🤯 You can now create a chatbot on ANY GitHub repo using the Llama 3.1 405B model with Hugging Face assistants -- FOR FREE! 💰 This is insane! 🚀 Link: clem 🤗 Julien Chaumond

Satvik Paramkusham

162,863 次观看 • 2 年前

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI
1:00

CPU Demo In Action: Meta Llama 3 8b Instruct With AMD Ryzen AI

AMD

39,226 次观看 • 2 年前

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.
2:57

With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here.

Ahmad Al-Dahle

866,703 次观看 • 2 年前