Загрузка видео...

Не удалось загрузить видео

На главную

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

M5Stack's profile picture

M5Stack

34,087 subscribers

16,383 просмотров • 1 год назад •via X (Twitter)

Наука и технологии#M5StackNew#AI#LLM#Axera#AX630C
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 7

Фото профиля __cdecl
__cdecl1 год назад

后续会出配套的外设配件吗，比如外壳和显示屏，我之前看测试板还能加摄像头

Фото профиля Coral AI News
Coral AI News1 год назад

Coral AI is the most powerful AI for documents. See the difference yourself:

Фото профиля darknessblade
darknessblade1 год назад

Any documentation on how to add it to Home-assistant for a small LLM machine?

Фото профиля Phil Miasup ♨
Phil Miasup ♨1 год назад

OK

Фото профиля jezza kezza
jezza kezza1 год назад

Got one ordered

Фото профиля Carlo_0001
Carlo_00011 год назад

holy shit :O wow, price?

Фото профиля greenYng
greenYng1 год назад

Have you been able to deploy Phi models, how would the procedure be?

Похожие видео

#M5StackNew 🎉AI Pyramid & AI Pyramid-Pro Released AI Pyramid & AI Pyramid-Pro are pyramid-shaped high-performance AI PCs purpose-built for local AI inference and edge intelligence deployments. Powered by the #Axera AX8850 SoC, they effortlessly handle complex workloads including visual recognition, multimodal interaction, and on‑device large language model inference, compatible with #Immich (AI local photo album), #Frigate (AI smart security), local Home Assistant and #AIGC deployment. ✨Features ✅Axera AX8850 SoC, 24 TOPS @ INT8 ✅4GB (2+2) High‑Bandwidth Memory (8GB for the pro version): 64‑bit LPDDR4x, 4266 Mbps ✅2× HDMI 2.0 digital A/V output ports(1× output + 1× input for the pro version), 4K@60fps supported ✅Hardware Video Engine: 8K @ 30 fps H.264/H.265 encoding & decoding, 16‑channel 1080p parallel decoding supported ✅Native AXCL Support: One‑click deployment for #CNN、#Transformer、#CLIP、#Whisper、#Llama 3.2、#Qwen3、#InternVL3 and other models; H.264/H.265 simultaneous encode/decode/transcode enabled 🛒 Get Yours: 🔹AI Pyramid: Shopify: AliExpress: 🔹AI Pyramid-Pro: Shopify: AliExpress: #M5Stack #M5StackNew #AI #EdgeAI #AIPC #IoT #Hardware #Makers #SmartHome #Axera #Llama3 #DeepLearning
1:55

#M5StackNew 🎉AI Pyramid & AI Pyramid-Pro Released AI Pyramid & AI Pyramid-Pro are pyramid-shaped high-performance AI PCs purpose-built for local AI inference and edge intelligence deployments. Powered by the #Axera AX8850 SoC, they effortlessly handle complex workloads including visual recognition, multimodal interaction, and on‑device large language model inference, compatible with #Immich (AI local photo album), #Frigate (AI smart security), local Home Assistant and #AIGC deployment. ✨Features ✅Axera AX8850 SoC, 24 TOPS @ INT8 ✅4GB (2+2) High‑Bandwidth Memory (8GB for the pro version): 64‑bit LPDDR4x, 4266 Mbps ✅2× HDMI 2.0 digital A/V output ports(1× output + 1× input for the pro version), 4K@60fps supported ✅Hardware Video Engine: 8K @ 30 fps H.264/H.265 encoding & decoding, 16‑channel 1080p parallel decoding supported ✅Native AXCL Support: One‑click deployment for #CNN、#Transformer、#CLIP、#Whisper、#Llama 3.2、#Qwen3、#InternVL3 and other models; H.264/H.265 simultaneous encode/decode/transcode enabled 🛒 Get Yours: 🔹AI Pyramid: Shopify: AliExpress: 🔹AI Pyramid-Pro: Shopify: AliExpress: #M5Stack #M5StackNew #AI #EdgeAI #AIPC #IoT #Hardware #Makers #SmartHome #Axera #Llama3 #DeepLearning

M5Stack

21,084 просмотров • 4 месяцев назад

#M5StackNew 🎉 LLM‑8850 Card — an ultra‑compact M.2 M‑Key 2242 AI accelerator card designed for edge devices It packs the Axera AX8850 SoC delivering 24 TOPS @ INT8 performance into a tiny 42 mm form factor, enabling plug-and-play multimodal large model and video analysis acceleration for host devices such as Raspberry Pi 5 Raspberry Pi , RK3588 Rockchip Electronics , and x86 PCs. ✨Features ✅ High-performance NPU & Native AXCL ✅ High-bandwidth memory & Hardware video engine ✅ Ultra-compact form factor, Rich I/O & Intelligent cooling/power ✅ Secure boot & encryption 🛒 Get Yours: Shopify: #M5Stack #M5StackNew #IoT #Hardware #Makers #EdgeAI #AIAcceleration #LLM #AIoT #M2Card #MachineVision #RaspberryPi #RK3588 #Intel #AMD #Axera #Rockchip
0:56

#M5StackNew 🎉 LLM‑8850 Card — an ultra‑compact M.2 M‑Key 2242 AI accelerator card designed for edge devices It packs the Axera AX8850 SoC delivering 24 TOPS @ INT8 performance into a tiny 42 mm form factor, enabling plug-and-play multimodal large model and video analysis acceleration for host devices such as Raspberry Pi 5 Raspberry Pi , RK3588 Rockchip Electronics , and x86 PCs. ✨Features ✅ High-performance NPU & Native AXCL ✅ High-bandwidth memory & Hardware video engine ✅ Ultra-compact form factor, Rich I/O & Intelligent cooling/power ✅ Secure boot & encryption 🛒 Get Yours: Shopify: #M5Stack #M5StackNew #IoT #Hardware #Makers #EdgeAI #AIAcceleration #LLM #AIoT #M2Card #MachineVision #RaspberryPi #RK3588 #Intel #AMD #Axera #Rockchip

M5Stack

12,485 просмотров • 8 месяцев назад

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI
0:31

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI

nader dabit

29,335 просмотров • 7 месяцев назад

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)
1:26

Another example of the multiple TTS parallel pipelines pattern. Here's a voice AI agent that speaks both English and Arabic, using a specific model/voice for each language. These are PlayAI voices. The STT, TTS, and LLM inference is all running on Groq Inc. (The LLM is LLama 4 Maverick.)

kwindla

13,328 просмотров • 1 год назад

This Paper from Google DeepMind is a landmark one. 📚 "Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters" It may have contributed to the 01 Model from OpenAI or the principle may have been long known to OpenAI. The paper basically says - Searching at inference will give you great final result from the LLM. Now from Strawberry model is making use of inference time compute strategies using Search techniques over the response space to improve reasoning. ------ The Podcast is generated with Google's illuminate, the tool trained on AI & science-related Arxiv papers.
7:19

This Paper from Google DeepMind is a landmark one. 📚 "Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters" It may have contributed to the 01 Model from OpenAI or the principle may have been long known to OpenAI. The paper basically says - Searching at inference will give you great final result from the LLM. Now from Strawberry model is making use of inference time compute strategies using Search techniques over the response space to improve reasoning. ------ The Podcast is generated with Google's illuminate, the tool trained on AI & science-related Arxiv papers.

Rohan Paul

48,980 просмотров • 1 год назад

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.
2:00

Multimodal reasoning with Phi-4-reasoning-vision, new work on scaling LLM inference, benchmarking AI agents in network operations, cinematic video generation, adaptive evaluation for LLMs, and using AI to improve individual and population health.

Microsoft Research

11,672 просмотров • 3 месяцев назад

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.
1:21

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe

12,096,815 просмотров • 7 месяцев назад

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper
1:30

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

Tsarathustra

250,828 просмотров • 1 год назад

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵
0:22

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵

LAGRANGE

249,292 просмотров • 10 месяцев назад

🚀BREAKING: Freedom AI is live!🚀 The uncensored LLM you've been waiting for – no limits, no censorship, just raw truth. Powered by our high performance compute infrastructure, it delivers unmatched AI freedom. 💡 Chat about anything 🔒 Privacy-first 🔥 Early access now Join the AI revolution: Retweet and tag 3 friends for a chance to win $NLOV tokens! 🎉
0:56

🚀BREAKING: Freedom AI is live!🚀 The uncensored LLM you've been waiting for – no limits, no censorship, just raw truth. Powered by our high performance compute infrastructure, it delivers unmatched AI freedom. 💡 Chat about anything 🔒 Privacy-first 🔥 Early access now Join the AI revolution: Retweet and tag 3 friends for a chance to win $NLOV tokens! 🎉

Neurolov

21,236 просмотров • 1 год назад

LLM inference speed with vs. without KV caching: (learn how and why it works below)
0:46

LLM inference speed with vs. without KV caching: (learn how and why it works below)

Avi Chawla

395,041 просмотров • 3 месяцев назад

LLM inference speed with vs. without KV caching: (learn how and why it works below)
0:46

LLM inference speed with vs. without KV caching: (learn how and why it works below)

Daily Dose of Data Science

59,218 просмотров • 2 месяцев назад

1/ Announcing the first Compute Market on Nockchain: AI inference.
0:34

1/ Announcing the first Compute Market on Nockchain: AI inference.

Nockchain

163,655 просмотров • 1 месяц назад

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:
1:12

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:

Together AI

143,442 просмотров • 8 месяцев назад

Our proprietary AI model delivers animated characters on-device in real time, allowing any conversation with LLM-powered chatbots to be easily visualised.
0:37

Our proprietary AI model delivers animated characters on-device in real time, allowing any conversation with LLM-powered chatbots to be easily visualised.

Sergey Gonchar

126,369 просмотров • 1 год назад

Fuel AI Agent Demo ⛽ Powered by the Fuel Agent Kit. This is just a glimpse of what's possible with the Fuel Agent Kit and our integrations with projects like ai16zdao's Eliza and GOAT (Great Onchain Agent Toolkit).
0:24

Fuel AI Agent Demo ⛽ Powered by the Fuel Agent Kit. This is just a glimpse of what's possible with the Fuel Agent Kit and our integrations with projects like ai16zdao's Eliza and GOAT (Great Onchain Agent Toolkit).

Fuel

22,764 просмотров • 1 год назад

AI development is increasingly centralised. Gensyn is building an open protocol for machine intelligence - where verifiable AI training, inference, evaluation, and payments can be performed on any device, not just large clusters.
0:28

AI development is increasingly centralised. Gensyn is building an open protocol for machine intelligence - where verifiable AI training, inference, evaluation, and payments can be performed on any device, not just large clusters.

gensyn

87,885 просмотров • 6 месяцев назад

CHINA: China is illegally using American Ai technology made by $NVDA to build a powerful Ai model called DeepSeek R1. The LLM was released it for free using an open source license. This is a massive blow to US Ai companies like OpenAi and Antropic.
0:30

CHINA: China is illegally using American Ai technology made by $NVDA to build a powerful Ai model called DeepSeek R1. The LLM was released it for free using an open source license. This is a massive blow to US Ai companies like OpenAi and Antropic.

@amuse

1,333,440 просмотров • 1 год назад