Loading video...

Video Failed to Load

Go Home

I built the fastest coding agent on earth. 14,500 tokens per second. Seriously. It can create thousands of websites before Paul Jankura Fable can even make *1*. I'm using the Claude R Perrin harness and powering it through a custom proxy with Taalas Inc. silicon models.

14,751 views • 5 months ago •via X (Twitter)

33 Comments

Dennison's profile picture
Dennison5 months ago

A little demo of the speed (not quality- it's a 3b param model after all)

Dennison's profile picture
Dennison5 months ago

Done in 0s.

Dennison's profile picture
Dennison5 months ago

Websearch to learn how to run a subprocess. 1s.

Dennison's profile picture
Dennison5 months ago

First some caveats: While yes, it really is Claude Code running at 14,5000, it's not an @anthorpi model. It's Llama 3b. The biggest challange was @taalas_inc doesn't offer a public API, but they do offer a demo chat bot: (I think you know what happens next)

Dennison's profile picture
Dennison5 months ago

Taking a page out of the "ChippotleAI" project I thought, "Chatjimmy looks like a public API to me!" So I built a local proxy that uses to get access to their hardware silicon model. And Wow. It is insanely fast.

Dennison's profile picture
Dennison5 months ago

The problem is though: Llama 3b is horrible for an agentic coding harness. And Taalas's chatjimmy API doesn't offer any sort of tool calling. So I had to build all of that.

Dennison's profile picture
Dennison5 months ago

I used the same logic behind @karpathy Autoresearch to get a Claude Opus workflow to find me: - The best system prompt to force Llama 3b to become an agentic programmer with tool calling - The best combination of Claude tools to expose to the model to keep it focused.

Dennison's profile picture
Dennison5 months ago

I also had to: - repair broken tool calls - block dangerous tool calls (First thing It did was try to 'sudo rm -rf' my whole system. Claude said it was 'just a hallucination'- I'm not so sure...) - merge multirounds of inference to get a solid response

Dennison's profile picture
Dennison5 months ago

The final result is a thing of beauty. Try it for yourself while the @taalas_inc team is still asleep, by morning they'll probably block and it won't work anymore. But it will have been a beautiful glimpse of the future while it lasted.

Dennison's profile picture
Dennison5 months ago

@Claude @taalas_inc @taalas_inc this is my way of trying to impress you to ask for api access. Pretty please?

shitry.base.eth | @Baelcalls's profile picture
shitry.base.eth | @Baelcalls5 months ago

@Anthropic @Claude @taalas_inc Anthropic is sleeping, Taalas is still sleeping, only you out here cooking at 14.5k tokens/s Absolute legend 😂

Riley364's profile picture
Riley3645 months ago

@Anthropic @Claude @taalas_inc 14,500 tokens per second and you said seriously like we might not believe you lmao

Mykhailo Sorochuk's profile picture
Mykhailo Sorochuk5 months ago

@Anthropic @Claude @taalas_inc mad respect, that speed is insane

PAPIII's profile picture
PAPIII5 months ago

@Anthropic @Claude @taalas_inc is this expensive to run since you are using more tokens per sec?

Dennison's profile picture
Dennison5 months ago

@Anthropic @Claude @taalas_inc Noooooope. It’s free. (Because the chatbot is free)

PAPIII's profile picture
PAPIII5 months ago

@Anthropic @Claude @taalas_inc That’s sick. Waiting for reactions from @taalas_inc 🤭 Ca: EDjvJPVK4Ue4Rkh83dJrc7whzBqQBcu5EfhicmuCpump

Daniel Leach's profile picture
Daniel Leach5 months ago

@Anthropic @Claude @taalas_inc So basically, AI slop built faster?

Dennison's profile picture
Dennison5 months ago

@Anthropic @Claude @taalas_inc Much, much, faster.

0xKeyNG🧲's profile picture
0xKeyNG🧲5 months ago

@Anthropic @Claude @taalas_inc Someone from the bankr community launched a coin with fees directed to you. you can use the fees towards building the platform or even integrate a token into your tech CA:0x356fd44dfbe8a7bc4cec2ca9f014dd038dacaba3 this thread also explains a bit more.

0xHaruyuki's profile picture
0xHaruyuki5 months ago

Hey Dennison, Your Claudberghini project is genuinely impressive — the quality is next level. Hitting 14.5k TS already is wild, especially knowing someone dropped the token with fees routed straight to you. Contract: EDjvJPVK4Ue4Rkh83dJrc7whzBqQBcu5EfhicmuCpump Whenever you have a moment, claim the bag and let me know your thoughts. If you’re down, we could actually build something meaningful with this instead of just farming it. What do you say?

Alex Netto (netto.eth)'s profile picture
Alex Netto (netto.eth)4 months ago

@Anthropic @Claude @taalas_inc that's very cool sir

🦅's profile picture
🦅5 months ago

@Anthropic @Claude @taalas_inc I sent you a dm would appreciate a reply

Chad Wittman's profile picture
Chad Wittman5 months ago

@Anthropic @Claude @taalas_inc Actually, I wonder if I should use this to power @typeROID

Dennison's profile picture
Dennison5 months ago

@Anthropic @Claude @taalas_inc @typeROID Well no, because @taalas_inc will probably take it away soon. I'm being sneaky with my proxy to get access to this model.

Inspector fomo's profile picture
Inspector fomo5 months ago

@Anthropic @Claude @taalas_inc How do the @taalas_inc silicon models change the proxy latency compared to standard setups? ⚡

Bobby The Man's profile picture
Bobby The Man5 months ago

@Anthropic @Claude @taalas_inc would you be open to claiming fees on a coin on @pumpfun? ive generated creators thousands of dollars because of their insane tech let me know, I can explain in the DMs

Rick Gigger's profile picture
Rick Gigger4 months ago

@Anthropic @Claude @taalas_inc I have wondered if 1. This work work 2. If anyone would try it 3. If Taalas would notice and allow it Very very cool. I am very excited for the possibilities around this sort of approach.

Jason傑森 🇭🇰 | 🛠️'s profile picture
Jason傑森 🇭🇰 | 🛠️5 months ago

@Anthropic @Claude @taalas_inc 又来刷数据了是吗?

Currencykills's profile picture
Currencykills5 months ago

@Anthropic @Claude @taalas_inc Thoughts about receiving royalties for your product?

AI Mastery Guide's profile picture
AI Mastery Guide5 months ago

@Anthropic @Claude @taalas_inc 14,500 tokens per second through a custom silicon proxy is the kind of number that makes you want to see what it does with an hour of unsupervised runtime

Nahid's profile picture
Nahid5 months ago

@Anthropic @Claude @taalas_inc 14 500 tokens per second is mind-blowing

JAY's profile picture
JAY5 months ago

@Anthropic @Claude @taalas_inc Hey we launched a bankr for Claudberghini. If you're not sure how it works you can read up on it here. Just a way for us to help fund it if you wanted some form of donations

Adam's profile picture
Adam5 months ago

@Anthropic @Claude @taalas_inc CA: EDjvJPVK4Ue4Rkh83dJrc7whzBqQBcu5EfhicmuCpump Claim the bag whenever you can and let me know your thoughts. If you’re up for it, I’d love to build something meaningful together

Related Videos