Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

This is a 9B model running a full agentic loop with Wi-Fi off. Ornith 1.5. It read three sheets, cross-referenced the monthly rollups, and wrote a revenue analysis on its own. Nothing left the Mac.

104,455 Aufrufe • vor 2 Monaten •via X (Twitter)

31 Kommentare

Profilbild von Osaurus
Osaurusvor 2 Monaten

Ornith 1.5 9B, MXFP8 quant on MLX. Recorded with Wi-Fi off, start to finish. Ornith reports the 9B matches or beats Gemma 4 31B and Qwen 3.6 35B. Watching it plan, read files, and self-correct, that tracks.

Profilbild von Osaurus
Osaurusvor 2 Monaten

Free and open source. MIT licensed. Native macOS, not Electron.

Profilbild von Ornith
Ornithvor 2 Monaten

🧡thanks for your great work!

Profilbild von Osaurus
Osaurusvor 2 Monaten

Thank you for the great model!

Profilbild von Aleksandar Janca
Aleksandar Jancavor 2 Monaten

how fast is it?

Profilbild von Osaurus
Osaurusvor 2 Monaten

It’s decently fast, depends on your Mac

Profilbild von 师梦豪
师梦豪vor 2 Monaten

@Jungian_coach 🫶

Profilbild von Osaurus
Osaurusvor 2 Monaten

@Jungian_coach ❤️

Profilbild von Berlioz
Berliozvor 2 Monaten

I never seem to get the same results you guys do when I try osaurus on my own

Profilbild von Osaurus
Osaurusvor 2 Monaten

Which model did you try?

Profilbild von Berlioz
Berliozvor 2 Monaten

Tried many models including the previous Ornith ones. Even GPT 5.6 Sol frequently fails basic tool calls

Profilbild von Osaurus
Osaurusvor 2 Monaten

With the latest version?

Profilbild von Berlioz
Berliozvor 2 Monaten

There’s been some updates since the last attempts, will give it another shot

Profilbild von Martin Ronfort
Martin Ronfortvor 2 Monaten

That local execution is what makes the 9B so compelling for real work. We actually broke down what this model can do here:

Profilbild von George Mastorakos, MD
George Mastorakos, MDvor 2 Monaten

wow! what hardware?

Profilbild von Osaurus
Osaurusvor 2 Monaten

Mine is MacBook Pro M4 48GB Ram

Profilbild von RiftStack AI
RiftStack AIvor 2 Monaten

a 9B holding an agent loop together is a big deal. did you have to cut the tool set down to keep it reliable, or constrain it some other way?

Profilbild von Osaurus
Osaurusvor 2 Monaten

It’s a delicate balance but keeping contexts minimal is the key to success

Profilbild von deX
deXvor 2 Monaten

wifi off is the detail that changes everything

Profilbild von Fanfulla
Fanfullavor 2 Monaten

9b doing arithmetic across three sheets, i'd check the totals

Profilbild von Rick | DMKTZ | FITzOn
Rick | DMKTZ | FITzOnvor 2 Monaten

offline 9b model running full agent loops without leaving the mac. privacy is nice but i doubt it can beat a cloud api at actual reasoning

Profilbild von Cuth
Cuthvor 2 Monaten

On a macbook pro m5 24 gb?

Profilbild von scoraclescotty
scoraclescottyvor 2 Monaten

Really good work, guys. This kind of experience is the next frontier.

Profilbild von Osaurus
Osaurusvor 2 Monaten

Thank you! We still have a long way to go.

Profilbild von ZK
ZKvor 2 Monaten

@HENKOWISH

Profilbild von 刘朝 Zhao Liu
刘朝 Zhao Liuvor 2 Monaten

A 9B model completing a spreadsheet analysis with Wi-Fi disabled is a strong privacy demo. The next proof point is reproducibility: task recipe, failure cases, and the boundary between local tools and model state.

Profilbild von AI Mastery Guide
AI Mastery Guidevor 2 Monaten

Wifi off and it still worked, wild

Profilbild von QuietLayer Studio
QuietLayer Studiovor 2 Monaten

why are you posting time lapsed video? Why not show the real speed?

Profilbild von Martino Wong
Martino Wongvor 2 Monaten

What model(s) would you suggest for osaurus with around 24/32GB memory?

Profilbild von Osaurus
Osaurusvor 2 Monaten

Try this model, Ornith 9B

Profilbild von Sebastian Buzdugan
Sebastian Buzduganvor 2 Monaten

offline is useful, but spreadsheet agents need cell-level citations before production use

Ähnliche Videos

watch this anon. i gave NVIDIA's biggest model ever a single task. 100 minutes and 440,000 tokens later, it had rendered nothing. not one important thing on the screen. this is Nemotron 3 Ultra. 550 billion parameters, a hybrid Mamba Transformer MoE, the largest model NVIDIA has ever shipped, and they built it specifically for long-running agentic coding. so i handed it exactly that: build a 3D scene from a spec, multiple files, iterate until the tests pass. the same task a frontier model one shotted in minutes. i genuinely wanted to be impressed. it ran for an hour and forty. burned through 440,000 tokens. wrote every file, passed its own tests, and proudly printed "task complete."the browser was blank. the 3D scene never rendered. not once. and the long horizon agentic behavior was genuinely good. it stayed on task the whole hour and forty, wrote real multi-file code, drove its own tools without derailing. it just couldn't turn any of that into something that actually runs. here's the part that gets me. it's a text model, it cannot see its own output. so it sat there looping on a broken vision tool, trying to "look" at the page, hitting error after error, never once reasoning its way out. it declared victory on an empty screen because it had no way to know the screen was empty. to be fair, i genuinely don't know what quant the NIM was serving, so maybe some of that's on the serving, not the model. but the biggest model NVIDIA has ever made, on the exact task it was designed for, couldn't tell it had built nothing in 100 minutes. same task on a local model, below thread👇.

Sudo su

32,589 Aufrufe • vor 4 Monaten