Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

M5Stack's profile picture

M5Stack

34,087 subscribers

16,383 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji#M5StackNew#AI#LLM#Axera#AX630C
LIVE

Anya Rossi• Live Now

Private livecam show

7 Yorum

__cdecl profil fotoğrafı
__cdecl1 yıl önce

后续会出配套的外设配件吗，比如外壳和显示屏，我之前看测试板还能加摄像头

Coral AI News profil fotoğrafı
Coral AI News1 yıl önce

Coral AI is the most powerful AI for documents. See the difference yourself:

darknessblade profil fotoğrafı
darknessblade1 yıl önce

Any documentation on how to add it to Home-assistant for a small LLM machine?

Phil Miasup ♨ profil fotoğrafı
Phil Miasup ♨1 yıl önce

OK

jezza kezza profil fotoğrafı
jezza kezza1 yıl önce

Got one ordered

Carlo_0001 profil fotoğrafı
Carlo_00011 yıl önce

holy shit :O wow, price?

greenYng profil fotoğrafı
greenYng1 yıl önce

Have you been able to deploy Phi models, how would the procedure be?

Benzer Videolar

#M5StackNew 🎉AI Pyramid & AI Pyramid-Pro Released AI Pyramid & AI Pyramid-Pro are pyramid-shaped high-performance AI PCs purpose-built for local AI inference and edge intelligence deployments. Powered by the #Axera AX8850 SoC, they effortlessly handle complex workloads including visual recognition, multimodal interaction, and on‑device large language model inference, compatible with #Immich (AI local photo album), #Frigate (AI smart security), local Home Assistant and #AIGC deployment. ✨Features ✅Axera AX8850 SoC, 24 TOPS @ INT8 ✅4GB (2+2) High‑Bandwidth Memory (8GB for the pro version): 64‑bit LPDDR4x, 4266 Mbps ✅2× HDMI 2.0 digital A/V output ports(1× output + 1× input for the pro version), 4K@60fps supported ✅Hardware Video Engine: 8K @ 30 fps H.264/H.265 encoding & decoding, 16‑channel 1080p parallel decoding supported ✅Native AXCL Support: One‑click deployment for #CNN、#Transformer、#CLIP、#Whisper、#Llama 3.2、#Qwen3、#InternVL3 and other models; H.264/H.265 simultaneous encode/decode/transcode enabled 🛒 Get Yours: 🔹AI Pyramid: Shopify: AliExpress: 🔹AI Pyramid-Pro: Shopify: AliExpress: #M5Stack #M5StackNew #AI #EdgeAI #AIPC #IoT #Hardware #Makers #SmartHome #Axera #Llama3 #DeepLearning
1:55

#M5StackNew 🎉AI Pyramid & AI Pyramid-Pro Released AI Pyramid & AI Pyramid-Pro are pyramid-shaped high-performance AI PCs purpose-built for local AI inference and edge intelligence deployments. Powered by the #Axera AX8850 SoC, they effortlessly handle complex workloads including visual recognition, multimodal interaction, and on‑device large language model inference, compatible with #Immich (AI local photo album), #Frigate (AI smart security), local Home Assistant and #AIGC deployment. ✨Features ✅Axera AX8850 SoC, 24 TOPS @ INT8 ✅4GB (2+2) High‑Bandwidth Memory (8GB for the pro version): 64‑bit LPDDR4x, 4266 Mbps ✅2× HDMI 2.0 digital A/V output ports(1× output + 1× input for the pro version), 4K@60fps supported ✅Hardware Video Engine: 8K @ 30 fps H.264/H.265 encoding & decoding, 16‑channel 1080p parallel decoding supported ✅Native AXCL Support: One‑click deployment for #CNN、#Transformer、#CLIP、#Whisper、#Llama 3.2、#Qwen3、#InternVL3 and other models; H.264/H.265 simultaneous encode/decode/transcode enabled 🛒 Get Yours: 🔹AI Pyramid: Shopify: AliExpress: 🔹AI Pyramid-Pro: Shopify: AliExpress: #M5Stack #M5StackNew #AI #EdgeAI #AIPC #IoT #Hardware #Makers #SmartHome #Axera #Llama3 #DeepLearning

M5Stack

21,084 görüntüleme • 4 ay önce

#M5StackNew 🎉 LLM‑8850 Card — an ultra‑compact M.2 M‑Key 2242 AI accelerator card designed for edge devices It packs the Axera AX8850 SoC delivering 24 TOPS @ INT8 performance into a tiny 42 mm form factor, enabling plug-and-play multimodal large model and video analysis acceleration for host devices such as Raspberry Pi 5 Raspberry Pi , RK3588 Rockchip Electronics , and x86 PCs. ✨Features ✅ High-performance NPU & Native AXCL ✅ High-bandwidth memory & Hardware video engine ✅ Ultra-compact form factor, Rich I/O & Intelligent cooling/power ✅ Secure boot & encryption 🛒 Get Yours: Shopify: #M5Stack #M5StackNew #IoT #Hardware #Makers #EdgeAI #AIAcceleration #LLM #AIoT #M2Card #MachineVision #RaspberryPi #RK3588 #Intel #AMD #Axera #Rockchip
0:56

#M5StackNew 🎉 LLM‑8850 Card — an ultra‑compact M.2 M‑Key 2242 AI accelerator card designed for edge devices It packs the Axera AX8850 SoC delivering 24 TOPS @ INT8 performance into a tiny 42 mm form factor, enabling plug-and-play multimodal large model and video analysis acceleration for host devices such as Raspberry Pi 5 Raspberry Pi , RK3588 Rockchip Electronics , and x86 PCs. ✨Features ✅ High-performance NPU & Native AXCL ✅ High-bandwidth memory & Hardware video engine ✅ Ultra-compact form factor, Rich I/O & Intelligent cooling/power ✅ Secure boot & encryption 🛒 Get Yours: Shopify: #M5Stack #M5StackNew #IoT #Hardware #Makers #EdgeAI #AIAcceleration #LLM #AIoT #M2Card #MachineVision #RaspberryPi #RK3588 #Intel #AMD #Axera #Rockchip

M5Stack

12,485 görüntüleme • 8 ay önce

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI
0:31

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI

nader dabit

29,335 görüntüleme • 7 ay önce

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)
1:26

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)

kwindla

13,328 görüntüleme • 1 yıl önce

This Paper from Google DeepMind is a landmark one. 📚 "Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters" It may have contributed to the 01 Model from OpenAI or the principle may have been long known to OpenAI. The paper basically says - Searching at inference will give you great final result from the LLM. Now from Strawberry model is making use of inference time compute strategies using Search techniques over the response space to improve reasoning. ------ The Podcast is generated with Google's illuminate, the tool trained on AI & science-related Arxiv papers.
7:19

This Paper from Google DeepMind is a landmark one. 📚 "Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters" It may have contributed to the 01 Model from OpenAI or the principle may have been long known to OpenAI. The paper basically says - Searching at inference will give you great final result from the LLM. Now from Strawberry model is making use of inference time compute strategies using Search techniques over the response space to improve reasoning. ------ The Podcast is generated with Google's illuminate, the tool trained on AI & science-related Arxiv papers.

Rohan Paul

48,980 görüntüleme • 1 yıl önce

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.
2:00

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.

Microsoft Research

11,672 görüntüleme • 3 ay önce

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.
1:21

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe

12,096,815 görüntüleme • 7 ay önce

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper
1:30

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

Tsarathustra

250,828 görüntüleme • 1 yıl önce

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵
0:22

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵

LAGRANGE

249,292 görüntüleme • 10 ay önce

🚀BREAKING: Freedom AI is live!🚀 The uncensored LLM you've been waiting for – no limits, no censorship, just raw truth. Powered by our high performance compute infrastructure, it delivers unmatched AI freedom. 💡 Chat about anything 🔒 Privacy-first 🔥 Early access now Join the AI revolution: Retweet and tag 3 friends for a chance to win $NLOV tokens! 🎉
0:56

🚀BREAKING: Freedom AI is live!🚀 The uncensored LLM you've been waiting for – no limits, no censorship, just raw truth. Powered by our high performance compute infrastructure, it delivers unmatched AI freedom. 💡 Chat about anything 🔒 Privacy-first 🔥 Early access now Join the AI revolution: Retweet and tag 3 friends for a chance to win $NLOV tokens! 🎉

Neurolov

21,236 görüntüleme • 1 yıl önce

LLM inference speed with vs. without KV caching: (learn how and why it works below)
0:46

LLM inference speed with vs. without KV caching: (learn how and why it works below)

Avi Chawla

395,041 görüntüleme • 3 ay önce

LLM inference speed with vs. without KV caching: (learn how and why it works below)
0:46

LLM inference speed with vs. without KV caching: (learn how and why it works below)

Daily Dose of Data Science

59,218 görüntüleme • 2 ay önce

1/ Announcing the first Compute Market on Nockchain: AI inference.
0:34

1/ Announcing the first Compute Market on Nockchain: AI inference.

Nockchain

163,655 görüntüleme • 1 ay önce

Our proprietary AI model delivers animated characters on-device in real time, allowing any conversation with LLM-powered chatbots to be easily visualised.
0:37

Our proprietary AI model delivers animated characters on-device in real time, allowing any conversation with LLM-powered chatbots to be easily visualised.

Sergey Gonchar

126,369 görüntüleme • 1 yıl önce

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:
1:12

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:

Together AI

143,442 görüntüleme • 8 ay önce

Fuel AI Agent Demo ⛽ Powered by the Fuel Agent Kit. This is just a glimpse of what's possible with the Fuel Agent Kit and our integrations with projects like ai16zdao's Eliza and GOAT (Great Onchain Agent Toolkit).
0:24

Fuel AI Agent Demo ⛽ Powered by the Fuel Agent Kit. This is just a glimpse of what's possible with the Fuel Agent Kit and our integrations with projects like ai16zdao's Eliza and GOAT (Great Onchain Agent Toolkit).

Fuel

22,764 görüntüleme • 1 yıl önce

AI development is increasingly centralised. Gensyn is building an open protocol for machine intelligence - where verifiable AI training, inference, evaluation, and payments can be performed on any device, not just large clusters.
0:28

AI development is increasingly centralised. Gensyn is building an open protocol for machine intelligence - where verifiable AI training, inference, evaluation, and payments can be performed on any device, not just large clusters.

gensyn

87,885 görüntüleme • 6 ay önce

CHINA: China is illegally using American Ai technology made by $NVDA to build a powerful Ai model called DeepSeek R1. The LLM was released it for free using an open source license. This is a massive blow to US Ai companies like OpenAi and Antropic.
0:30

CHINA: China is illegally using American Ai technology made by $NVDA to build a powerful Ai model called DeepSeek R1. The LLM was released it for free using an open source license. This is a massive blow to US Ai companies like OpenAi and Antropic.

@amuse

1,333,440 görüntüleme • 1 yıl önce