Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

1-bit inference of 0.8m param gpt running inside 8192 bytes of sram

monty10x's profile picture

Monty Anderson

1,984 subscribers

66,775 Aufrufe • vor 3 Monaten •via X (Twitter)

GamingKunstWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

imagine dropping a bit in a pond of bytes #p5js
0:22

imagine dropping a bit in a pond of bytes #p5js

Prathamesh

11,036 Aufrufe • vor 7 Tagen

ITS 1AM. I GOT SERIAL PROGRAMMING WORKING ON THE 1 BIT COMPUTER!!!!!! THIS IS __AWESOME__!!!!! (ugh, so much fight) now I can *just* upload programs to it!!! Its running off an SRAM chip!!!
1:12

ITS 1AM. I GOT SERIAL PROGRAMMING WORKING ON THE 1 BIT COMPUTER!!!!!! THIS IS __AWESOME__!!!!! (ugh, so much fight) now I can *just* upload programs to it!!! Its running off an SRAM chip!!!

Rue Mohr🇨🇦

26,232 Aufrufe • vor 2 Jahren

The 2023 edition of my long-running anti-establishment art-science-fusion code-therapy smooth-baritone causal inference & Bayesian data analysis course is complete. 20 lectures, from the basics of causal inference & Bayesian updating to mixed models & Gaussian processes. 1/2
1:03

The 2023 edition of my long-running anti-establishment art-science-fusion code-therapy smooth-baritone causal inference & Bayesian data analysis course is complete. 20 lectures, from the basics of causal inference & Bayesian updating to mixed models & Gaussian processes. 1/2

Richard McElreath 🐈‍⬛

524,186 Aufrufe • vor 3 Jahren

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵
0:22

Breaking: We can now prove that AI is correct. DeepProve-1 is the first production-ready zkML system to cryptographically verify a full LLM inference. Lagrange has successfully proven the inference of OpenAI’s GPT-2, moving verifiable AI from theory to production: 🧵

LAGRANGE

249,292 Aufrufe • vor 11 Monaten

South Park inadvertently running of the best organic ads ever for Chat GPT
1:00

South Park inadvertently running of the best organic ads ever for Chat GPT

Chris Josephs

174,478 Aufrufe • vor 3 Jahren

Llama 2 (7B, 13B and 70B) is now available in Lit-GPT! 🚀 Try running inference on the chat model or finetune the foundation model ➡️ #Llama2 #MachineLearning #opensource
0:29

Llama 2 (7B, 13B and 70B) is now available in Lit-GPT! 🚀 Try running inference on the chat model or finetune the foundation model ➡️ #Llama2 #MachineLearning #opensource

Lightning AI ⚡️

17,845 Aufrufe • vor 3 Jahren

A look inside of a running engine
0:24

A look inside of a running engine

Massimo

39,236 Aufrufe • vor 1 Jahr

Kai-Fu Lee says GPU supply constraints are forcing Chinese AI companies to innovate, meaning they can train a frontier model for $3 million contrasted with GPT-5's $1 billion, and deliver inference costs of 10c/million tokens, 1/30th of what an American company charges
1:45

Kai-Fu Lee says GPU supply constraints are forcing Chinese AI companies to innovate, meaning they can train a frontier model for $3 million contrasted with GPT-5's $1 billion, and deliver inference costs of 10c/million tokens, 1/30th of what an American company charges

Tsarathustra

218,794 Aufrufe • vor 1 Jahr

[ Truth & Inference ] (1/2) Here are different videos of players from the Chinese server giving a showcase of the Prospector's Truth & Inference costume, accessory, and emote. ※ Video 1: ※ Video 2: ※ Video 3: ※ Video 4:
4:24

[ Truth & Inference ] (1/2) Here are different videos of players from the Chinese server giving a showcase of the Prospector's Truth & Inference costume, accessory, and emote. ※ Video 1: ※ Video 2: ※ Video 3: ※ Video 4:

Identity V | News

86,695 Aufrufe • vor 9 Monaten

🌸 Running Crew, looking for members 🌸 1. Date: April 1 - 15 2. Location: Pancake Tower's hottest running track 3. Needed: Just you! 4. Requirements: A tiny bit of courage! 5. Fee: 1 Like, 1 Sub, 1 Reply #CookieRun #TowerOfAdventures #Update #AprilFools #OvenBreak
1:22

🌸 Running Crew, looking for members 🌸 1. Date: April 1 - 15 2. Location: Pancake Tower's hottest running track 3. Needed: Just you! 4. Requirements: A tiny bit of courage! 5. Fee: 1 Like, 1 Sub, 1 Reply #CookieRun #TowerOfAdventures #Update #AprilFools #OvenBreak

CookieRun: Tower of Adventures

43,811 Aufrufe • vor 3 Monaten

Tempting feasts causing a bit of beef 👀 #sdmninside Inside
0:47

Tempting feasts causing a bit of beef 👀 #sdmninside Inside

Sidemen

142,488 Aufrufe • vor 1 Jahr

Why are you paying GPT 5.5 prices for requests that don't need GPT 5.5? I'm tired of waiting... One line of code. Every request goes to a live auction between providers. Cheapest reliable one wins. You get a normal response back, like nothing changed. Switchboard. AI inference as a market.
1:13

Why are you paying GPT 5.5 prices for requests that don't need GPT 5.5? I'm tired of waiting... One line of code. Every request goes to a live auction between providers. Cheapest reliable one wins. You get a normal response back, like nothing changed. Switchboard. AI inference as a market.

Matthew Korshunov

16,088 Aufrufe • vor 25 Tagen

Correction: There were 12 video bytes by ANI of people coming from Israel to India and around 85 video bytes by ANI of people coming from Iran. Deleting the incorrect/misleading tweet.
3:28

Correction: There were 12 video bytes by ANI of people coming from Israel to India and around 85 video bytes by ANI of people coming from Iran. Deleting the incorrect/misleading tweet.

Mohammed Zubair

20,994 Aufrufe • vor 1 Jahr

OpenAI CEO, Sam Altman: Someday, we'll make a powerful consumer device that is capable of running a GPT-5 or GPT-6-level model entirely locally, using very little power
0:32

OpenAI CEO, Sam Altman: Someday, we'll make a powerful consumer device that is capable of running a GPT-5 or GPT-6-level model entirely locally, using very little power

Haider.

186,781 Aufrufe • vor 8 Monaten

GPTs are generating sequences in a left-to-right order. Is there another way? With François Fleuret and @evanncourdier, in partnership with SkySoft-ATM, we developed σ-GPT, capable of generating sequences in any order chosen dynamically at inference time. 1/6
0:38

GPTs are generating sequences in a left-to-right order. Is there another way? With François Fleuret and @evanncourdier, in partnership with SkySoft-ATM, we developed σ-GPT, capable of generating sequences in any order chosen dynamically at inference time. 1/6

Arnaud Pannatier

379,958 Aufrufe • vor 2 Jahren

I can't believe this works, but I got DeepSeek-V4-Flash (284B params) running on a Raspberry Pi 5 (8GB edition) at >1tok/s @ ~8W during full-tilt inference! It uses an untouched copy of antirez's GGUF. Took 160+ experiments over 5 days between GPT-5.5 xhigh and Opus 4.8 max.
0:32

I can't believe this works, but I got DeepSeek-V4-Flash (284B params) running on a Raspberry Pi 5 (8GB edition) at >1tok/s @ ~8W during full-tilt inference! It uses an untouched copy of antirez's GGUF. Took 160+ experiments over 5 days between GPT-5.5 xhigh and Opus 4.8 max.

Dan Woods

184,322 Aufrufe • vor 1 Monat

Trevor Harries-Jones provides an incredible overview of training, through distributed inference (test-based learning) running in parallel. What is $RENDER cooking up back there?
2:14

Trevor Harries-Jones provides an incredible overview of training, through distributed inference (test-based learning) running in parallel. What is $RENDER cooking up back there?

BITKRAFT Ventures

16,675 Aufrufe • vor 1 Jahr

1-bit Bonsai 8B running locally on an M4 Pro (MLX) alongside a standard 16-bit 8B model. Same class of model, very different deployment profile: far lower memory use and substantially higher throughput.
0:32

1-bit Bonsai 8B running locally on an M4 Pro (MLX) alongside a standard 16-bit 8B model. Same class of model, very different deployment profile: far lower memory use and substantially higher throughput.

PrismML

93,021 Aufrufe • vor 3 Monaten

1. AI Chef University of Cambridge researchers released an AI-powered robot that watches cooking videos and replicates the results. It's a great demonstration of bringing AI technology out of the world of bytes and bits.
1:14

1. AI Chef University of Cambridge researchers released an AI-powered robot that watches cooking videos and replicates the results. It's a great demonstration of bringing AI technology out of the world of bytes and bits.

Aakash Gupta

80,636 Aufrufe • vor 3 Jahren