Loading video...

Video Failed to Load

Go Home

introducing fast inference ( fast inference is an LLM API for devs who want to go faster access the fastest Kimi K3, GLM, DeepSeek, etc for $9/mo integrations with Claude Code, Codex, OpenCode & more speeds compounds. waiting for Claude does not

159,723 views • 2 months ago •via X (Twitter)

48 Comments

terminally onλine εngineer's profile picture
terminally onλine εngineer2 months ago

missed opportunity to include a sanic reference but nice

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Lmao we should make this our mascot

terminally onλine εngineer's profile picture
terminally onλine εngineer1 month ago

the blue speedster of autism hell yeah

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Use checkout code FASTER-AMABKGNG5L for 50% of your first purchase.

Martin Bergo's profile picture
Martin Bergo2 months ago

What speed do you have on GLM-5.3 Flash? I cant fint any TPS numbers on the site

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Benchmarking 5.3 flash now, will have it up shortly

Martin Bergo's profile picture
Martin Bergo2 months ago

Nice! 👀

Amar Singh's profile picture
Amar Singh2 months ago

the devs only want 100TPS and above 🔥🔥

Leo Martinez's profile picture
Leo Martinez2 months ago

@atbeme Epic

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

@atbeme You should try this. Will send you credits in a sec

Atharva Vaidya's profile picture
Atharva Vaidya2 months ago

$9/mo??

FlowOps Daily's profile picture
FlowOps Daily2 months ago

DeepSeek with Claude Code is the strongest concrete part of this agent demo.

harry's profile picture
harry2 months ago

for the past week all i’ve used is kimi and deepseek; most productive i’ve ever been!!

Travis Fischer's profile picture
Travis Fischer1 month ago

hmmm i'm not immediately seeing the before / after speed diff in this video maybe get to the juice quicker and make the comparison more striking? i think the diffusion transformers demos really blew my mind

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸1 month ago

🧃 incoming

Mathivanan 💻📟🔌's profile picture
Mathivanan 💻📟🔌1 month ago

Please fix mobile viewport -

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸1 month ago

🫡

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Join the fast inference discord

Sam Ragsdale's profile picture
Sam Ragsdale2 months ago

beast

ai gnome 🇺🇸's profile picture
ai gnome 🇺🇸2 months ago

ZDR?

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Yes sir!

ai gnome 🇺🇸's profile picture
ai gnome 🇺🇸2 months ago

sold

yian's profile picture
yian2 months ago

this is cool. would like to try. is it ZDR?

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Yes sir!

alaxic's profile picture
alaxic1 month ago

this is sick. going to give it a whirl

Aylleen ⛩️'s profile picture
Aylleen ⛩️2 months ago

holy vibe code man

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

🤔 what kind of phone are you on?

Aarsh's profile picture
Aarsh2 months ago

Selling flat rate monthly access for fast inference ignores how quickly heavy agent loops blow through upstream rate limits and degrade tail latency.

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Upstream rate limits? we run these gpus brother

Marius du Preez's profile picture
Marius du Preez2 months ago

Banger service. Specially for impatient people like me

Peter Piekarczyk (🥧🚗🐥)'s profile picture
Peter Piekarczyk (🥧🚗🐥)2 months ago

pretty cool dude

Anish's profile picture
Anish2 months ago

no markup is a great deal

basedcapital's profile picture
basedcapital2 months ago

does the $9 monthly price include inference usage, or is inference billed separately?

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

Includes $10 in usage. Pay as you go when usage runs out

basedcapital's profile picture
basedcapital2 months ago

niceeee gonna try it out

George Ukoh-Godwin's profile picture
George Ukoh-Godwin1 month ago

Superb stuff, could really help Can I get free usage ?

Mayimbe's profile picture
Mayimbe1 month ago

Hey sam, would you be open to letting us add you as a provider to @BodegaOneAI IDE?

First Sauce Labs's profile picture
First Sauce Labs1 month ago

$9 a month is less than I burn on Claude Code in a bad afternoon, and 'waiting for Claude does not' is the first honest tagline this industry has produced. I keep a fast tab open purely out of spite for the spinner.

Christopher's profile picture
Christopher2 months ago

Hey Sam, It’s probably a bit early for me to ask this, but this is interesting enough that I will. :) Would you be open to third-party, non-competing services integrating Fast Inference as a provider option? I’m not quite ready to do it yet. I’m building now, with a beta coming very soon, and I want to give everything a proper shakedown first. But Fast Inference looks very appealing as one of the provider options when I get there.

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸2 months ago

@inference_net Yeah for sure. This is how most people use inference .net already:)

Christopher's profile picture
Christopher2 months ago

@inference_net Nice. Thank you. I didn’t want to just do it as the ad says. Once I have the beta up in a couple of weeks I’ll let you vet it. 👍

Naeem Al Noman's profile picture
Naeem Al Noman1 month ago

Why dont you have tokens per speed for the models on the site?

Lahfir's profile picture
Lahfir1 month ago

would be nice to have tok/s column

Shriansh jaiswal's profile picture
Shriansh jaiswal1 month ago

cool stuff man!!! is there any routing logic for the 6 models providing or is it manual?

Ben (no treats)'s profile picture
Ben (no treats)1 month ago

can i have a sweatshirt

Sam Hogan 🇺🇸's profile picture
Sam Hogan 🇺🇸1 month ago

Yeah dm me address and shirt size

Bjorn Ironside 🇲🇦's profile picture
Bjorn Ironside 🇲🇦2 months ago

What do we get for 9 bucks?

Aarsh's profile picture
Aarsh1 month ago

Self-hosting private GPU clusters simply exchanges external API rate limits for internal memory bandwidth and concurrency bottlenecks.

Related Videos

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

38,511 views • 19 days ago