Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Positron AI wants to run 16 trillion parameter models on a single server.

SemiAnalysis_'s profile picture

SemiAnalysis

112,510 subscribers

20,075 görüntüleme • 2 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

"One of the biggest misconceptions" Cerebras CFO Bob Komin pushes back on the small-models narrative. "We serve all models, and there is no limit to the size of the models that we can serve. Today, we're serving trillion parameter models. We're serving trillion parameter models that are internal for OpenAI today. We are currently running OpenAI 5.4 and 5.5 with them."
0:50

"One of the biggest misconceptions" Cerebras CFO Bob Komin pushes back on the small-models narrative. "We serve all models, and there is no limit to the size of the models that we can serve. Today, we're serving trillion parameter models. We're serving trillion parameter models that are internal for OpenAI today. We are currently running OpenAI 5.4 and 5.5 with them."

Deirdre Bosa

83,925 görüntüleme • 1 ay önce

What does it take to build chips that train trillion-parameter AI models? 🛠️💻 #AWS Trainium's chief architect breaks it down in this must-listen episode. #AI #TrainiumTuesdays 👉
0:40

What does it take to build chips that train trillion-parameter AI models? 🛠️💻 #AWS Trainium's chief architect breaks it down in this must-listen episode. #AI #TrainiumTuesdays 👉

Amazon Web Services

11,670 görüntüleme • 1 yıl önce

APPLE RESEARCH SCIENTIST JUST SHOWED HOW 4 MAC STUDIOS RUN A TRILLION PARAMETER MODEL LOCALLY ZERO COSTS 13:18 she shows the main thing - connect 4 Mac Studios and you get 1TB of shared memory - exactly enough to run a trillion parameter model right on your desk Apple's library - and four machines start working as one cluster tensor parallelism: every machine holds part of every layer - all process the same token simultaneously - speed increases 3x compared to a single device fine-tuning: one Mac Studio processes 180 tokens per second four together process 600 and not a single byte of data leaves the room one command in the terminal - and a trillion parameter model answers from your desk and runs 24/7 data centers took years to build to run models like this - Apple did it with four Thunderbolt cables
21:59

APPLE RESEARCH SCIENTIST JUST SHOWED HOW 4 MAC STUDIOS RUN A TRILLION PARAMETER MODEL LOCALLY ZERO COSTS 13:18 she shows the main thing - connect 4 Mac Studios and you get 1TB of shared memory - exactly enough to run a trillion parameter model right on your desk Apple's library - and four machines start working as one cluster tensor parallelism: every machine holds part of every layer - all process the same token simultaneously - speed increases 3x compared to a single device fine-tuning: one Mac Studio processes 180 tokens per second four together process 600 and not a single byte of data leaves the room one command in the terminal - and a trillion parameter model answers from your desk and runs 24/7 data centers took years to build to run models like this - Apple did it with four Thunderbolt cables

Noisy

47,399 görüntüleme • 7 gün önce

📢 ASUS ExpertCenter Pro ET900N G3 is now available to order worldwide. Built on NVIDIA GB300 Grace Blackwell Ultra Desktop Superchip: 🧠 748GB coherent memory 🤖 1 trillion parameter models ⚡ Data-center-class performance Learn more: #NVIDIA #AI
0:59

📢 ASUS ExpertCenter Pro ET900N G3 is now available to order worldwide. Built on NVIDIA GB300 Grace Blackwell Ultra Desktop Superchip: 🧠 748GB coherent memory 🤖 1 trillion parameter models ⚡ Data-center-class performance Learn more: #NVIDIA #AI

ASUS North America

97,473 görüntüleme • 14 gün önce

ELON MUSK: "Grok 5 will be the largest model, a 6 trillion parameter model, whereas Grok 3 and 4 are based on a 3 trillion parameter model. Moreover, the 6 trillion parameters will have a much higher intelligence density per gigabyte. Its really going to feel Sentient."
2:14

ELON MUSK: "Grok 5 will be the largest model, a 6 trillion parameter model, whereas Grok 3 and 4 are based on a 3 trillion parameter model. Moreover, the 6 trillion parameters will have a much higher intelligence density per gigabyte. Its really going to feel Sentient."

DogeDesigner

322,011 görüntüleme • 7 ay önce

Slash AI costs by 99%, run 1000+ models on a single GPU! OpenLoRA lets you run thousands of models on one GPU instead of one per model, drastically cutting costs and boosting flexibility. Excited to work with Aethir, Hyperbolic for infrastructure and for verifiability. Watch the demo:
3:18

Slash AI costs by 99%, run 1000+ models on a single GPU! OpenLoRA lets you run thousands of models on one GPU instead of one per model, drastically cutting costs and boosting flexibility. Excited to work with Aethir, Hyperbolic for infrastructure and for verifiability. Watch the demo:

OpenLedger

155,267 görüntüleme • 1 yıl önce

Introducing ✨Tiny Aya✨, a family of massively multilingual small language models built to run where people actually are. Tiny Aya delivers strong multilingual performance in 70+ global languages in a 3.35B parameter model, efficient enough to run locally, even on a phone.
0:30

Introducing ✨Tiny Aya✨, a family of massively multilingual small language models built to run where people actually are. Tiny Aya delivers strong multilingual performance in 70+ global languages in a 3.35B parameter model, efficient enough to run locally, even on a phone.

Cohere Labs

192,778 görüntüleme • 4 ay önce

Jane Street brought in Horace He to explain how to squeeze the most out of a single GPU. And then how to scale it to tens of thousands. Graduated from Cornell in 2020. Works on the PyTorch team. Training Llama 3 takes 40 trillion trillion floating point operations. He wrote the two things those models run on: torch.compile and FlexAttention.
1:02:33

Jane Street brought in Horace He to explain how to squeeze the most out of a single GPU. And then how to scale it to tens of thousands. Graduated from Cornell in 2020. Works on the PyTorch team. Training Llama 3 takes 40 trillion trillion floating point operations. He wrote the two things those models run on: torch.compile and FlexAttention.

zostaff

51,574 görüntüleme • 28 gün önce

The Gemma family continues to grow today! 🩺 Announcing new models for MedGemma, our collection of multimodal open models specifically designed for health AI development that can run on a single GPU. 1️⃣ MedGemma 27B Multimodal 2️⃣ MedSigLIP (Read the thread to learn more)
0:56

The Gemma family continues to grow today! 🩺 Announcing new models for MedGemma, our collection of multimodal open models specifically designed for health AI development that can run on a single GPU. 1️⃣ MedGemma 27B Multimodal 2️⃣ MedSigLIP (Read the thread to learn more)

Google AI Developers

61,037 görüntüleme • 11 ay önce

Inspired by Hugging Face's official MCP server, I built my own to expose my semantic search API for the HF ecosystem! Features AI-powered search, parameter analysis via safetensors, and tools to find similar models/datasets. Try: "Find non maths reasoning datasets from 2025"!
0:23

Inspired by Hugging Face's official MCP server, I built my own to expose my semantic search API for the HF ecosystem! Features AI-powered search, parameter analysis via safetensors, and tools to find similar models/datasets. Try: "Find non maths reasoning datasets from 2025"!

Daniel van Strien

15,147 görüntüleme • 1 yıl önce

GROK 5. the first 7 trillion parameter model
1:24

GROK 5. the first 7 trillion parameter model

🍓🍓🍓

39,839 görüntüleme • 5 ay önce

.RunAnywhere (YC W26) makes it easy for app developers to run AI models directly on phones and edge devices — fast, private, offline — with a single SDK and a dashboard to manage everything across user devices. Congrats on the launch Sanchit monga and Shubham Malhotra!
1:22

.RunAnywhere (YC W26) makes it easy for app developers to run AI models directly on phones and edge devices — fast, private, offline — with a single SDK and a dashboard to manage everything across user devices. Congrats on the launch Sanchit monga and Shubham Malhotra!

Y Combinator

69,411 görüntüleme • 5 ay önce

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below
16:10

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

Paul Couvert

41,185 görüntüleme • 3 ay önce

BOOM! 💥 Today I added WebGPU support for Andrej Karpathy's nanochat models, meaning they can run 100% locally in your browser (no server)! The d32 version runs at over 50 tps on my M4 Max 🚀 Pretty wild that you can now deploy AI applications using just a single index.html file 😅
0:20

BOOM! 💥 Today I added WebGPU support for Andrej Karpathy's nanochat models, meaning they can run 100% locally in your browser (no server)! The d32 version runs at over 50 tps on my M4 Max 🚀 Pretty wild that you can now deploy AI applications using just a single index.html file 😅

Xenova

95,454 görüntüleme • 8 ay önce

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests
2:08

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Wes Bos

153,435 görüntüleme • 11 ay önce

A 10B Chinese model beats models 20x its size. And it runs on your laptop. Step 3 VL10B uses parallel reasoning to think like 16 experts at once. → Beats 200B parameter models → Scores 92.2% on multimodal benchmarks → Runs 16 reasoning paths simultaneously → Open source on Hugging Face → Works offline on your hardware OCR. GUI understanding. STEM problems. All covered. Completely free to download. Want the technical breakdown? DM me.
8:24

A 10B Chinese model beats models 20x its size. And it runs on your laptop. Step 3 VL10B uses parallel reasoning to think like 16 experts at once. → Beats 200B parameter models → Scores 92.2% on multimodal benchmarks → Runs 16 reasoning paths simultaneously → Open source on Hugging Face → Works offline on your hardware OCR. GUI understanding. STEM problems. All covered. Completely free to download. Want the technical breakdown? DM me.

Julian Goldie SEO

37,165 görüntüleme • 5 ay önce

OK, this is insane.. Alibaba just dropped 4 new AI models at Apsara 2025, and they’re wild: → a 1 trillion parameter LLM → a vision model that codes from images → an omni-model for text/audio/video → and a new Wan 2.5 preview for video + audio gen more details below:👇
0:28

OK, this is insane.. Alibaba just dropped 4 new AI models at Apsara 2025, and they’re wild: → a 1 trillion parameter LLM → a vision model that codes from images → an omni-model for text/audio/video → and a new Wan 2.5 preview for video + audio gen more details below:👇

Hamza Khalid

26,707 görüntüleme • 9 ay önce

Lisa Su (CEO of AMD) unveils the world's smallest AI development PC, capable of running 200B parameter models locally.
0:32

Lisa Su (CEO of AMD) unveils the world's smallest AI development PC, capable of running 200B parameter models locally.

Big Brain AI

515,716 görüntüleme • 1 ay önce