Загрузка видео...

Не удалось загрузить видео

На главную

introducing fast inference ( fast inference is an LLM API for devs who want to go faster access the fastest Kimi K3, GLM, DeepSeek, etc for $9/mo integrations with Claude Code, Codex, OpenCode & more speeds compounds. waiting for Claude does not

159,723 просмотров • 2 месяцев назад •via X (Twitter)

Комментарии: 48

Фото профиля terminally onλine εngineer
terminally onλine εngineer2 месяцев назад

missed opportunity to include a sanic reference but nice

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Lmao we should make this our mascot

Фото профиля terminally onλine εngineer
terminally onλine εngineer1 месяц назад

the blue speedster of autism hell yeah

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Use checkout code FASTER-AMABKGNG5L for 50% of your first purchase.

Фото профиля Martin Bergo
Martin Bergo2 месяцев назад

What speed do you have on GLM-5.3 Flash? I cant fint any TPS numbers on the site

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Benchmarking 5.3 flash now, will have it up shortly

Фото профиля Martin Bergo
Martin Bergo2 месяцев назад

Nice! 👀

Фото профиля Amar Singh
Amar Singh2 месяцев назад

the devs only want 100TPS and above 🔥🔥

Фото профиля Leo Martinez
Leo Martinez2 месяцев назад

@atbeme Epic

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

@atbeme You should try this. Will send you credits in a sec

Фото профиля Atharva Vaidya
Atharva Vaidya2 месяцев назад

$9/mo??

Фото профиля FlowOps Daily
FlowOps Daily2 месяцев назад

DeepSeek with Claude Code is the strongest concrete part of this agent demo.

Фото профиля harry
harry2 месяцев назад

for the past week all i’ve used is kimi and deepseek; most productive i’ve ever been!!

Фото профиля Travis Fischer
Travis Fischer1 месяц назад

hmmm i'm not immediately seeing the before / after speed diff in this video maybe get to the juice quicker and make the comparison more striking? i think the diffusion transformers demos really blew my mind

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸1 месяц назад

🧃 incoming

Фото профиля Mathivanan 💻📟🔌
Mathivanan 💻📟🔌1 месяц назад

Please fix mobile viewport -

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸1 месяц назад

🫡

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Join the fast inference discord

Фото профиля Sam Ragsdale
Sam Ragsdale2 месяцев назад

beast

Фото профиля ai gnome 🇺🇸
ai gnome 🇺🇸2 месяцев назад

ZDR?

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Yes sir!

Фото профиля ai gnome 🇺🇸
ai gnome 🇺🇸2 месяцев назад

sold

Фото профиля yian
yian2 месяцев назад

this is cool. would like to try. is it ZDR?

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Yes sir!

Фото профиля alaxic
alaxic1 месяц назад

this is sick. going to give it a whirl

Фото профиля Aylleen ⛩️
Aylleen ⛩️2 месяцев назад

holy vibe code man

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

🤔 what kind of phone are you on?

Фото профиля Aarsh
Aarsh2 месяцев назад

Selling flat rate monthly access for fast inference ignores how quickly heavy agent loops blow through upstream rate limits and degrade tail latency.

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Upstream rate limits? we run these gpus brother

Фото профиля Marius du Preez
Marius du Preez2 месяцев назад

Banger service. Specially for impatient people like me

Фото профиля Peter Piekarczyk (🥧🚗🐥)
Peter Piekarczyk (🥧🚗🐥)2 месяцев назад

pretty cool dude

Фото профиля Anish
Anish2 месяцев назад

no markup is a great deal

Фото профиля basedcapital
basedcapital2 месяцев назад

does the $9 monthly price include inference usage, or is inference billed separately?

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

Includes $10 in usage. Pay as you go when usage runs out

Фото профиля basedcapital
basedcapital2 месяцев назад

niceeee gonna try it out

Фото профиля George Ukoh-Godwin
George Ukoh-Godwin1 месяц назад

Superb stuff, could really help Can I get free usage ?

Фото профиля Mayimbe
Mayimbe1 месяц назад

Hey sam, would you be open to letting us add you as a provider to @BodegaOneAI IDE?

Фото профиля First Sauce Labs
First Sauce Labs1 месяц назад

$9 a month is less than I burn on Claude Code in a bad afternoon, and 'waiting for Claude does not' is the first honest tagline this industry has produced. I keep a fast tab open purely out of spite for the spinner.

Фото профиля Christopher
Christopher2 месяцев назад

Hey Sam, It’s probably a bit early for me to ask this, but this is interesting enough that I will. :) Would you be open to third-party, non-competing services integrating Fast Inference as a provider option? I’m not quite ready to do it yet. I’m building now, with a beta coming very soon, and I want to give everything a proper shakedown first. But Fast Inference looks very appealing as one of the provider options when I get there.

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸2 месяцев назад

@inference_net Yeah for sure. This is how most people use inference .net already:)

Фото профиля Christopher
Christopher2 месяцев назад

@inference_net Nice. Thank you. I didn’t want to just do it as the ad says. Once I have the beta up in a couple of weeks I’ll let you vet it. 👍

Фото профиля Naeem Al Noman
Naeem Al Noman1 месяц назад

Why dont you have tokens per speed for the models on the site?

Фото профиля Lahfir
Lahfir1 месяц назад

would be nice to have tok/s column

Фото профиля Shriansh jaiswal
Shriansh jaiswal1 месяц назад

cool stuff man!!! is there any routing logic for the 6 models providing or is it manual?

Фото профиля Ben (no treats)
Ben (no treats)1 месяц назад

can i have a sweatshirt

Фото профиля Sam Hogan 🇺🇸
Sam Hogan 🇺🇸1 месяц назад

Yeah dm me address and shirt size

Фото профиля Bjorn Ironside 🇲🇦
Bjorn Ironside 🇲🇦2 месяцев назад

What do we get for 9 bucks?

Фото профиля Aarsh
Aarsh1 месяц назад

Self-hosting private GPU clusters simply exchanges external API rate limits for internal memory bandwidth and concurrency bottlenecks.

Похожие видео

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

38,511 просмотров • 19 дней назад