Philip Kiely's banner

Philip Kiely

@philipkiely • 16,437 subscribers

Author of Inference Engineering | Building @baseten | Not an LLM (yet)

Shorts

Kimi K2 Thinking was already smarter than ChatGPT. Now, it is faster than ChatGPT.

Kimi K2 Thinking was already smarter than ChatGPT. Now, it is faster than ChatGPT.

100,331 次观看

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Scaling past a trillion parameters requires inference engineers to solve 3 issues: - Width: Routing between hundreds of sparse experts - Depth: Mixing global and local linear attention - Length: Processing 1M-token sequences I asked Ali and Bryce to draw it up. They delivered.

Scaling past a trillion parameters requires inference engineers to solve 3 issues: - Width: Routing between hundreds of sparse experts - Depth: Mixing global and local linear attention - Length: Processing 1M-token sequences I asked Ali and Bryce to draw it up. They delivered.

158,771 次观看 • 13 天前

On sample workloads: Opus 4.8 -> Kimi 2.7 Code | 82% savings GPT 5.5 -> GLM 5.2 | 77% savings Gemini 3.5 Flash -> Nemotron 3 Ultra | 67% savings Run the numbers for your yourself:

On sample workloads: Opus 4.8 -> Kimi 2.7 Code | 82% savings GPT 5.5 -> GLM 5.2 | 77% savings Gemini 3.5 Flash -> Nemotron 3 Ultra | 67% savings Run the numbers for your yourself:

1,823,552 次观看 • 4 个月前

Inference Engineering launches today.

Inference Engineering launches today.

1,473,423 次观看 • 8 个月前

The first 100 seconds of the Inference Engineering audiobook, narrated by a voice clone built by Rime. P.S. the video was also made using an AI-built script. Input is a PNG and a text file, script handles narration, bounding boxes, captions, and final video export.

The first 100 seconds of the Inference Engineering audiobook, narrated by a voice clone built by Rime. P.S. the video was also made using an AI-built script. Input is a PNG and a text file, script handles narration, bounding boxes, captions, and final video export.

72,778 次观看 • 5 个月前

没有更多内容可加载