fleyta's banner
fleyta's profile picture

fleyta

@fleyta88 • 2,125 subscribers

ai researcher / dm open

Shorts

THIS GUY BOUGHT BOXES OF RETIRED NVIDIA TESLA CARDS TO BUILD A LOCAL AI SERVER FOR LESS THAN ONE MONTH OF SUBSCRIPTIONS these are old datacenter GPUs like the P100, M40 and P4, cards that once cost thousands but now sell used for a fraction of their original price the best target is a 24GB Tesla M40 for roughly $130, enough VRAM to run serious local models without paying Claude, ChatGPT and transcription fees every month add a $25 fan shroud and a $10 power adapter, drop it into an old desktop, then run Ollama for private summaries, transcription and overnight AI jobs the entire box lands near $165 while a $412 monthly AI stack burns $4,944 a year, turning retired server hardware into a machine that pays for itself in weeks

THIS GUY BOUGHT BOXES OF RETIRED NVIDIA TESLA CARDS TO BUILD A LOCAL AI SERVER FOR LESS THAN ONE MONTH OF SUBSCRIPTIONS these are old datacenter GPUs like the P100, M40 and P4, cards that once cost thousands but now sell used for a fraction of their original price the best target is a 24GB Tesla M40 for roughly $130, enough VRAM to run serious local models without paying Claude, ChatGPT and transcription fees every month add a $25 fan shroud and a $10 power adapter, drop it into an old desktop, then run Ollama for private summaries, transcription and overnight AI jobs the entire box lands near $165 while a $412 monthly AI stack burns $4,944 a year, turning retired server hardware into a machine that pays for itself in weeks

2,208,985 views

an Anthropic engineer just showed a cleaner way to run Sonnet 5.5 + Opus 5.5 without wasting turns the expensive mistake is letting the wrong model stay in the loop too long. so I turned the routing logic into a prompt: → clear, scoped work stays on Sonnet 5.5 → failed checks trigger escalation → Opus gets a clean handoff, not the full transcript → cache stays warm whenever possible the numbers get weird fast: → 20K context: Opus is 1.88x per turn → 150K: 1.49x → 400K: 1.26x a late 300K switch costs $1.50 just to rebuild cache. the same handoff at 20K costs $0.10. the point is not to use Opus more. it is to make Claude prove when Opus is actually needed ↓ ↳

an Anthropic engineer just showed a cleaner way to run Sonnet 5.5 + Opus 5.5 without wasting turns the expensive mistake is letting the wrong model stay in the loop too long. so I turned the routing logic into a prompt: → clear, scoped work stays on Sonnet 5.5 → failed checks trigger escalation → Opus gets a clean handoff, not the full transcript → cache stays warm whenever possible the numbers get weird fast: → 20K context: Opus is 1.88x per turn → 150K: 1.49x → 400K: 1.26x a late 300K switch costs $1.50 just to rebuild cache. the same handoff at 20K costs $0.10. the point is not to use Opus more. it is to make Claude prove when Opus is actually needed ↓ ↳

14,951 views

Videos

fleyta88's profile picture

this is certified f**king gold Andrej Karpathy just showed a cleaner way to build research agents, and it kills the dumbest loop in AI: search → answer → forget → search again he basically turns memory into a real system: raw sources stay raw the agent reads them once turns the useful parts into linked wiki pages then checks the wiki first every time a new question comes in so the loop changes: > question comes in > wiki gets searched first > gaps send the agent back to source material > the answer gets written back into the wiki > the system leaves the next run smarter than the last one that’s the trick the “memory” is not buried in some giant chat transcript anymore it lives in files the agent can actually work with: > pages it can read > links it can follow > notes it can update > gaps it can spot > stale claims it can fix after enough runs, you stop getting one-off answers you get an actual knowledge base that’s why this feels bigger than just “better RAG” a normal research agent can handle 100 questions and leave behind 100 dead chats Karpathy’s setup can handle the same 100 questions and leave behind a research system that compounds the architecture is stupidly simple: > raw/ = source of truth > wiki/ = maintained knowledge > schema = rules for how the whole thing gets updated search still matters it just stops being the whole product that’s the part I’d steal immediately: don’t make the agent remember harder make it write something worth remembering

fleyta

21,324 views • 5 days ago

No more content to load