Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

483,223 görüntüleme • 1 yıl önce •via X (Twitter)

11 Yorum

EXO Labs profil fotoğrafı
EXO Labs1 yıl önce

This is Day 4 of The 12 Days of EXO. Blog post and DIY guide:

EXO Labs profil fotoğrafı
EXO Labs1 yıl önce

On Day 3, we announced a 100% Open-Source home assistant that runs locally and is aligned with you.

EXO Labs profil fotoğrafı
EXO Labs1 yıl önce

Be the first to hear what’s new by joining our email list:

EXO Labs profil fotoğrafı
EXO Labs1 yıl önce

Day 5:

Skytech Gaming profil fotoğrafı
Skytech Gaming2 yıl önce

Introducing our @amdgaming Powered King 95 Gaming PC. #amdadvantage

Alex Cheema - e/acc profil fotoğrafı
Alex Cheema - e/acc1 yıl önce

@karpathy If it runs on 26 year old hardware, it runs on anything. GameBoy next?

Aleksandr Blekh profil fotoğrafı
Aleksandr Blekh1 yıl önce

@karpathy Nice. Next try 80386 CPU (33/66 MHz), 16 GB RAM, and Xenix OS. Such a machine in the tower form factor was the server at my first job. It was a multi-user UNIX environment w/ VT100 (or VT200) green-screen dumb terminals & IMHO wonderful keyboards. Are you up for the challenge? 😉

Tommy profil fotoğrafı
Tommy1 yıl önce

@karpathy This is amazing. I remember that old windows 98 startup screen

Alexander Long profil fotoğrafı
Alexander Long1 yıl önce

@karpathy We really had it all🥲

fedri profil fotoğrafı
fedri1 yıl önce

@karpathy Imagine going back in time with this in a CD and showing up to Bill Gates' office

AD profil fotoğrafı
AD1 yıl önce

@karpathy The beige nostalgia with the satisfying clicks Oh yea and running LLM on a 26 year old hardware is pretty cool too

Benzer Videolar

After 8+ years on the Tesla Autopilot team and 3 years at Intel, I started Apex Compute to design a new architecture for efficient AI inference. For the past 9 months, we’ve been building our custom inference accelerator. Today we’re releasing Unified Engine v1. Last June we raised our seed round with Maxitech , DeepFin Research, Soma Capital and an incredible group of angel investors. In less than 9 months, we completed our RTL architecture and brought our first pre-silicon prototype to life on FPGA. Our architecture combines systolic array and vector processing in a single compute engine with multiple architectural optimizations, achieving very high FLOPs utilization. A single engine is super lean and it uses less than 90K LUTs and 1 MB Block RAM. It may also be one of the smallest logic-footprint compute engines developed so far. Our Unified Engine v1 supports: -matrix-matrix multiplication (~95% FLOPs utilization) -softmax (~90% FLOPs utilization) -broadcast and element-wise operations -RMSNorm / LayerNorm -block quantization/dequantization (fp4, int4) -multi-engine synchronization and many other operations. We even implemented memory-efficient attention similar to FlashAttention, reaching ~90% FLOP utilization. Full benchmarks and the software stack are available on our GitHub: We have basic compiler written in Python and it supports PyTorch tensors directly to easily test and transfer tensors between the accelerator and host using bf16, fp4 and int4 formats. Our FPGA prototype can already run LLM inference and outperform NVIDIA Jetson Orin Nano, even on a mid-tier FPGA setup (6.4x lower memory bandwidth, 18% slower clock speed at 4.5 Watts). Check the side-by-side comparison video below. Our GitHub includes low-level operator implementations, examples for tiled matrix multiplication, operation chaining, tensor parallelism, attention kernel and a full Gemma 3 1B model implementation. Many more models(Vision Transformers and VLA) are coming soon. Our accelerator IP is AXI-ready for deployment on any AMD(Xilinx) FPGA platform today. Even better, our two-engine prototype runs on an entry-level AMD(Xilinx) FPGA as a PCIe accelerator card. You can purchase it here for $50 to experiment our pre-silicon prototype on your desktop PC or Raspberry Pi 5. We will be releasing hardware bitstream updates as the architecture gets new features. More to come soon! We are expanding our team and looking for compiler engineers and floating-point hardware design engineers. If you're interested, please send me a DM.

Hasan

37,748 görüntüleme • 5 ay önce

It's officially that time of year again! Presenting the second annual "DreamDisc" indie gamejam for the Sega Dreamcast! If you weren't around for last year, check out the video! We had 24 incredibly polished, epic submissions including a wide-range of genres, such as 3D space shooters and resource managers, 2D platformers and racing games, VMU minigames, custom hardware, and even a custom implementation of the Java VM for SH4! Just like last year, the top 10 submissions, as voted by a panel of judges, will be pressed to a commercially released, actual physical Sega Dreamcast disc, which will be available for purchase from Orc Face Games - Chew Chew Mimic out on Dreamcast!! Oh, and there are cash prizes for the top 3, of course! This year we have an even wider range of engines, frameworks, and prebuilt library solutions for developers are all experience levels, including: 1) Antiruins - Lua-based, very newbie friendly game engine for the Sega Dreamcast. 2) raylib - famous cross-platform C-based games framework which needs no introduction 3) SDL2/3 - our very own ports of the famous cross-platform SDL libraries, which target the Dreamcast. 4) Simulant - the same engine that powered Driving Strikers--the very first online homebrew commercial DC game--as well as last year's wining submission, written in C++. 5) KallistiOS - you can raw-dog the indie SDK and pseudo OS that started it all and powers everything in the community, rolling your own tech stack. 6) SH4ZAM - my collection of SH4 assembly optimized math and matrix routines, which originally powered our Grand Theft Auto ports. Contestants are encouraged to join the OrcFace and Simulant Discord servers where they can interact with other DC developers, share their progress, and ask for help with anything they may need. Official DreamDisc '25 website:

Falco Girgis

16,980 görüntüleme • 9 ay önce