Skip navigation
Here's what we're building.
0:00 / 1:20

Here's what we're building.

0xSero

75K followers

Visit on X
491 likesDownloadOriginal post

26,876 views

Here's what we're building. Audit the code, test it, enjoy. Local AI 1. detects your hardware 2. tries to find an exl3 optimised recipe 3. downloads, runs the model 4. pick one of 8 agents, pi/omp/codex/claude/opencode/etc.. 5. runs the agent

21 Comments

Comments from the original post on X (Twitter)

  • Torkild Johansen's profile picture

    @TorkildJohansen

    Any chance of Intel iGPU support? Chips like the Core Ultra 5 series have 4 Xe-cores, shared RAM and can already run 3B–8B Q4 models via llama.cpp Vulkan/SYCL. They are not fast, but these laptops will run ause able local LLM depending on ram size. This would cover a lot of machines.

    2 likes

  • 0xSero's profile picture

    @0xSero

    I already added intel arc b70 support, you add support by putting recipes in here give it to any clanker and it'll figure it out

    7 likes

  • DARIO ALTMAN's profile picture

    @thedarioaltman

    The real unlock isn’t just running AI locally it’s removing the friction between hardware and useful work. Detect → optimize → download → run → build. If you nail that UX, local AI stops feeling like infrastructure and starts feeling like a product.

    2 likes

  • Robert DeVore's profile picture

    @deviorobert

    Love to see it 🤘 I submitted a PR to get @kujolang installed by default to help make it easier for developing with AI. I think it'd be a great addition alongside all of the local first work you're doing 🫡

    2 likes

  • Jayakrishnan R's profile picture

    @BlastBurn27

    How it's different from ODS? Osmantic AI?

    2 likes

  • 0xSero's profile picture

    @0xSero

    It doesn’t

  • Jonathan Leaders's profile picture

    @JonathanLeaders

    I can help you beat that 5090 tps for 32GB

    1 like

  • ~sarlev (e/acc)'s profile picture

    @sarlev_

    can i make a few formal requests, now that your are officially in the project (congrats, btw. nice job), to include a few things here for local ai support: - a unified gateway covering both my local models, cloud APIs, and subscriptions (@opencode go and @openai codex) [i've got a private version of this, lmk if you want access to the current codebase] - @dee_hw and @autonomous_labs have some awesome stuff w/ (omagrid); i would like to please be able to discover/add other gpus on my network - local classifier models that are integrated for blocking sensitive data from going out to 3rd party providers (openrouter, openai, etc), probably will need tooling for helping users configure what they care about, possibly even enabling fine tuning?

    1 like

  • Max Wolter's profile picture

    @maxintechnology

    I saw what you are doing with Omarchy now. Amazing news. I was thinking about reaching out to present my agent framework when it's released. It could be an amazing fit. Hopefully we can talk then. Congrats!

    1 like

  • Mr. Bungle ❖ A⃝'s profile picture

    @Doghablaespanol

    Congrats on the @OmarchyLinux sponsorship boy. Got a long way to go. Chill and be the best dad 💯🔥

    1 like

  • Andrey Kolesnikov's profile picture

    @minviable_org

    Cooking something along those lines too.

    1 like

  • McLovin's profile picture

    @_McLovin_617

    Est-ce que tu continues le projet d'adaptation d'Omarchy sur les puces M3 et M4

  • Tomato's profile picture

    @Mayoandham

    Create an IPFS LIBRARY OF "CERTIFIED" LLMs so we can download and install

  • Austin Bakanec's profile picture

    @AustinBakanec

    Yo @grok what how does exl3 help? Isnt there severe quality loss at such compression?

  • Omar BAROOD's profile picture

    @OmarBAROOD4

    Any chance for me to contribute with a 3050 😅? Seriously asking, not EXL3s though, custom models with custom llama.cpp patches for them. Yes or No?

  • Andrius Mostauskas's profile picture

    @aniuks27

    Can Hermes be added to the list of agents ?

  • Marc's profile picture

    @marc_quikshot

    amd too? 7900 or r9700?

  • ShowTimeZ's profile picture

    @_Show_TimeZ_

    Sei un buon investimento, grazie

  • Piotrek Witek's profile picture

    @piotrekwitek

    Is it working for the dual GPU set up with tensor parallel?

  • Android 🔳's profile picture

    @Androthon

    @grok add this to my reminder list and ping me in 3 months 😊 about the details what it is now and what it will become then 🥳