First steps for a specialized DeepSeek v4 Flash inference...

antirez's profile picture

antirez

14,176 Aufrufe • vor 2 Monaten

DeepSeek DeepSeek is now live on Heurist. Open source...

Heurist's profile picture

Heurist

25,664 Aufrufe • vor 1 Jahr

Running DeepSeek R1 on my desk Uses EXO Labs...

Alex Cheema's profile picture

Alex Cheema

992,353 Aufrufe • vor 1 Jahr

AGI at home Running DeepSeek R1 across my 7...

Alex Cheema's profile picture

Alex Cheema

1,934,971 Aufrufe • vor 1 Jahr

Batching for vision models is now available in Beta...

LM Studio's profile picture

LM Studio

47,794 Aufrufe • vor 2 Monaten

Watching llama.cpp do 40 tok/s inference of the 7B...

Nat Friedman's profile picture

Nat Friedman

1,764,082 Aufrufe • vor 3 Jahren

DeepSeek v4 Flash has 43 blocks... so, even 4096...

antirez's profile picture

antirez

18,422 Aufrufe • vor 2 Monaten

How much faster is the new MacBook Pro for...

Alex Cheema's profile picture

Alex Cheema

529,690 Aufrufe • vor 1 Jahr

Another demo of the iPhone 17 Pro’s on-device LLM...

Adrien Grondin's profile picture

Adrien Grondin

46,205 Aufrufe • vor 10 Monaten

Got continuous batching working with SSMs in mlx-lm. Here's...

Awni Hannun's profile picture

Awni Hannun

35,078 Aufrufe • vor 6 Monaten

The world’s fastest inference for Llama 4 Scout is...

Poe's profile picture

Poe

17,286 Aufrufe • vor 1 Jahr

Today, we're excited to announce a partnership with Manta...

Nesa's profile picture

Nesa

35,219 Aufrufe • vor 2 Jahren

My AI broke the world record on Tempest yesterday!...

Dave W Plummer's profile picture

Dave W Plummer

37,406 Aufrufe • vor 4 Monaten

⭐The Year of Inference is here. Featherless is now...

Featherless AI's profile picture

Featherless AI

24,012 Aufrufe • vor 1 Jahr

NVIDIA Nemotron 3 Nano Omni, a new multimodal reasoning...

NVIDIA Robotics's profile picture

NVIDIA Robotics

16,031 Aufrufe • vor 2 Monaten

Day 11/90 of Inference Engineering How does vLLM work...

max fu's profile picture

max fu

69,270 Aufrufe • vor 8 Tagen

There’s some subtle details here that make v4 standout...

Franky Shaw's profile picture

Franky Shaw

21,865 Aufrufe • vor 5 Monaten

We’re proud to share that Tamarind Bio has been...

Deniz Kavi's profile picture

Deniz Kavi

43,309 Aufrufe • vor 1 Monat

In flow matching, a coupling determines how noise and...

Alec Helbling's profile picture

Alec Helbling

65,253 Aufrufe • vor 2 Monaten

got cloud inference working! here i have smolvla running...

Jack Vial's profile picture

Jack Vial

12,992 Aufrufe • vor 6 Monaten

Grok 2 mini is now 2x faster than it...

Igor Babuschkin's profile picture

Igor Babuschkin

1,803,113 Aufrufe • vor 1 Jahr