Here's what we're building.
75K followers
26,876 views
21 Comments
Comments from the original post on X (Twitter)

@TorkildJohansen
Any chance of Intel iGPU support? Chips like the Core Ultra 5 series have 4 Xe-cores, shared RAM and can already run 3B–8B Q4 models via llama.cpp Vulkan/SYCL. They are not fast, but these laptops will run ause able local LLM depending on ram size. This would cover a lot of machines.
2 likes

@0xSero
I already added intel arc b70 support, you add support by putting recipes in here give it to any clanker and it'll figure it out
7 likes

@thedarioaltman
The real unlock isn’t just running AI locally it’s removing the friction between hardware and useful work. Detect → optimize → download → run → build. If you nail that UX, local AI stops feeling like infrastructure and starts feeling like a product.
2 likes

@deviorobert
Love to see it 🤘 I submitted a PR to get @kujolang installed by default to help make it easier for developing with AI. I think it'd be a great addition alongside all of the local first work you're doing 🫡
2 likes

@BlastBurn27
How it's different from ODS? Osmantic AI?
2 likes

@0xSero
It doesn’t

@JonathanLeaders
I can help you beat that 5090 tps for 32GB
1 like

@sarlev_
can i make a few formal requests, now that your are officially in the project (congrats, btw. nice job), to include a few things here for local ai support: - a unified gateway covering both my local models, cloud APIs, and subscriptions (@opencode go and @openai codex) [i've got a private version of this, lmk if you want access to the current codebase] - @dee_hw and @autonomous_labs have some awesome stuff w/ (omagrid); i would like to please be able to discover/add other gpus on my network - local classifier models that are integrated for blocking sensitive data from going out to 3rd party providers (openrouter, openai, etc), probably will need tooling for helping users configure what they care about, possibly even enabling fine tuning?
1 like

@maxintechnology
I saw what you are doing with Omarchy now. Amazing news. I was thinking about reaching out to present my agent framework when it's released. It could be an amazing fit. Hopefully we can talk then. Congrats!
1 like

@Doghablaespanol
Congrats on the @OmarchyLinux sponsorship boy. Got a long way to go. Chill and be the best dad 💯🔥
1 like

@minviable_org
Cooking something along those lines too.
1 like

@_McLovin_617
Est-ce que tu continues le projet d'adaptation d'Omarchy sur les puces M3 et M4

@Mayoandham
Create an IPFS LIBRARY OF "CERTIFIED" LLMs so we can download and install

@AustinBakanec
Yo @grok what how does exl3 help? Isnt there severe quality loss at such compression?

@OmarBAROOD4
Any chance for me to contribute with a 3050 😅? Seriously asking, not EXL3s though, custom models with custom llama.cpp patches for them. Yes or No?

@aniuks27
Can Hermes be added to the list of agents ?

@marc_quikshot
amd too? 7900 or r9700?

@_Show_TimeZ_
Sei un buon investimento, grazie

@piotrekwitek
Is it working for the dual GPU set up with tensor parallel?

@Androthon
@grok add this to my reminder list and ping me in 3 months 😊 about the details what it is now and what it will become then 🥳

