Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

introducing fast inference ( fast inference is an LLM API for devs who want to go faster access the fastest Kimi K3, GLM, DeepSeek, etc for $9/mo integrations with Claude Code, Codex, OpenCode & more speeds compounds. waiting for Claude does not

159,723 Aufrufe • vor 2 Monaten •via X (Twitter)

48 Kommentare

Profilbild von terminally onλine εngineer
terminally onλine εngineervor 2 Monaten

missed opportunity to include a sanic reference but nice

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Lmao we should make this our mascot

Profilbild von terminally onλine εngineer
terminally onλine εngineervor 1 Monat

the blue speedster of autism hell yeah

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Use checkout code FASTER-AMABKGNG5L for 50% of your first purchase.

Profilbild von Martin Bergo
Martin Bergovor 2 Monaten

What speed do you have on GLM-5.3 Flash? I cant fint any TPS numbers on the site

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Benchmarking 5.3 flash now, will have it up shortly

Profilbild von Martin Bergo
Martin Bergovor 2 Monaten

Nice! 👀

Profilbild von Amar Singh
Amar Singhvor 2 Monaten

the devs only want 100TPS and above 🔥🔥

Profilbild von Leo Martinez
Leo Martinezvor 2 Monaten

@atbeme Epic

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

@atbeme You should try this. Will send you credits in a sec

Profilbild von Atharva Vaidya
Atharva Vaidyavor 2 Monaten

$9/mo??

Profilbild von FlowOps Daily
FlowOps Dailyvor 2 Monaten

DeepSeek with Claude Code is the strongest concrete part of this agent demo.

Profilbild von harry
harryvor 2 Monaten

for the past week all i’ve used is kimi and deepseek; most productive i’ve ever been!!

Profilbild von Travis Fischer
Travis Fischervor 1 Monat

hmmm i'm not immediately seeing the before / after speed diff in this video maybe get to the juice quicker and make the comparison more striking? i think the diffusion transformers demos really blew my mind

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 1 Monat

🧃 incoming

Profilbild von Mathivanan 💻📟🔌
Mathivanan 💻📟🔌vor 1 Monat

Please fix mobile viewport -

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 1 Monat

🫡

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Join the fast inference discord

Profilbild von Sam Ragsdale
Sam Ragsdalevor 2 Monaten

beast

Profilbild von ai gnome 🇺🇸
ai gnome 🇺🇸vor 2 Monaten

ZDR?

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Yes sir!

Profilbild von ai gnome 🇺🇸
ai gnome 🇺🇸vor 2 Monaten

sold

Profilbild von yian
yianvor 2 Monaten

this is cool. would like to try. is it ZDR?

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Yes sir!

Profilbild von alaxic
alaxicvor 1 Monat

this is sick. going to give it a whirl

Profilbild von Aylleen ⛩️
Aylleen ⛩️vor 2 Monaten

holy vibe code man

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

🤔 what kind of phone are you on?

Profilbild von Aarsh
Aarshvor 2 Monaten

Selling flat rate monthly access for fast inference ignores how quickly heavy agent loops blow through upstream rate limits and degrade tail latency.

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Upstream rate limits? we run these gpus brother

Profilbild von Marius du Preez
Marius du Preezvor 2 Monaten

Banger service. Specially for impatient people like me

Profilbild von Peter Piekarczyk (🥧🚗🐥)
Peter Piekarczyk (🥧🚗🐥)vor 2 Monaten

pretty cool dude

Profilbild von Anish
Anishvor 2 Monaten

no markup is a great deal

Profilbild von basedcapital
basedcapitalvor 2 Monaten

does the $9 monthly price include inference usage, or is inference billed separately?

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

Includes $10 in usage. Pay as you go when usage runs out

Profilbild von basedcapital
basedcapitalvor 2 Monaten

niceeee gonna try it out

Profilbild von George Ukoh-Godwin
George Ukoh-Godwinvor 1 Monat

Superb stuff, could really help Can I get free usage ?

Profilbild von Mayimbe
Mayimbevor 1 Monat

Hey sam, would you be open to letting us add you as a provider to @BodegaOneAI IDE?

Profilbild von First Sauce Labs
First Sauce Labsvor 1 Monat

$9 a month is less than I burn on Claude Code in a bad afternoon, and 'waiting for Claude does not' is the first honest tagline this industry has produced. I keep a fast tab open purely out of spite for the spinner.

Profilbild von Christopher
Christophervor 2 Monaten

Hey Sam, It’s probably a bit early for me to ask this, but this is interesting enough that I will. :) Would you be open to third-party, non-competing services integrating Fast Inference as a provider option? I’m not quite ready to do it yet. I’m building now, with a beta coming very soon, and I want to give everything a proper shakedown first. But Fast Inference looks very appealing as one of the provider options when I get there.

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 2 Monaten

@inference_net Yeah for sure. This is how most people use inference .net already:)

Profilbild von Christopher
Christophervor 2 Monaten

@inference_net Nice. Thank you. I didn’t want to just do it as the ad says. Once I have the beta up in a couple of weeks I’ll let you vet it. 👍

Profilbild von Naeem Al Noman
Naeem Al Nomanvor 1 Monat

Why dont you have tokens per speed for the models on the site?

Profilbild von Lahfir
Lahfirvor 1 Monat

would be nice to have tok/s column

Profilbild von Shriansh jaiswal
Shriansh jaiswalvor 1 Monat

cool stuff man!!! is there any routing logic for the 6 models providing or is it manual?

Profilbild von Ben (no treats)
Ben (no treats)vor 1 Monat

can i have a sweatshirt

Profilbild von Sam Hogan 🇺🇸
Sam Hogan 🇺🇸vor 1 Monat

Yeah dm me address and shirt size

Profilbild von Bjorn Ironside 🇲🇦
Bjorn Ironside 🇲🇦vor 2 Monaten

What do we get for 9 bucks?

Profilbild von Aarsh
Aarshvor 1 Monat

Self-hosting private GPU clusters simply exchanges external API rate limits for internal memory bandwidth and concurrency bottlenecks.

Ähnliche Videos

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

38,511 Aufrufe • vor 19 Tagen