PrismML's banner

PrismML

@PrismML • 16,255 subscribers

Centering AI research on efficiency. https://t.co/88MQHGCeFD

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

153,244 Aufrufe • vor 28 Tagen

The phone threshold is even harder than the storage number suggests. A phone exposes only part of its memory to an application, and the model must share that budget with its KV cache, activations, runtime, and the rest of the product. At 3.9 GB, 1-bit Bonsai 27B clears that threshold with room to work, making 27B-class local AI possible on a phone for the first time. (Demo Mode: cached & prefilled image context)

The phone threshold is even harder than the storage number suggests. A phone exposes only part of its memory to an application, and the model must share that budget with its KV cache, activations, runtime, and the rest of the product. At 3.9 GB, 1-bit Bonsai 27B clears that threshold with room to work, making 27B-class local AI possible on a phone for the first time. (Demo Mode: cached & prefilled image context)

32,858 Aufrufe • vor 28 Tagen

1-bit Bonsai 8B running locally on an M4 Pro (MLX) alongside a standard 16-bit 8B model. Same class of model, very different deployment profile: far lower memory use and substantially higher throughput.

93,021 Aufrufe • vor 4 Monaten

Try Ternary Bonsai 27B directly on Hugging Face , powered by Together AI

Try Ternary Bonsai 27B directly on Hugging Face , powered by Together AI

11,669 Aufrufe • vor 21 Tagen

We’re also launching Bonsai Studio, an iOS app for trying Bonsai Image 4B directly on your iPhone. Run image generation on-device, with no subscription and no API requests.

We’re also launching Bonsai Studio, an iOS app for trying Bonsai Image 4B directly on your iPhone. Run image generation on-device, with no subscription and no API requests.

14,499 Aufrufe • vor 2 Monaten

Keine weiteren Inhalte verfügbar