omkaar's banner

omkaar

@omkizzy • 4,342 subscribers

gpu middle-class | nyc, once upon a time @uwaterloo

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

I built software to cut docker image sizes by more than 80%. It uses dynamic analysis and and has a LOT more room for improvement. The demo here shows an ETL workflow docker image, cut down from 1.28GB to 193MB (-85%)! If large docker image sizes are becoming a production problem, I'd be happy to explore how we can help.

I built software to cut docker image sizes by more than 80%. It uses dynamic analysis and and has a LOT more room for improvement. The demo here shows an ETL workflow docker image, cut down from 1.28GB to 193MB (-85%)! If large docker image sizes are becoming a production problem, I'd be happy to explore how we can help.

353,266 просмотров • 1 год назад

Introducing BeyondPDF, a smart, free, fully-local (wifi-less) PDF search app for MacOS. "Free" has always connoted to "It's free but we will steal your data"... not anymore. Whats wrong with MacOS's Preview? It's great... but I NEED smart/semantic search. Searching for words is tedious but searching for ideas is wayy easier. I converted a light embedding model from Hugging Face to CoreML and used zero libraries (vectordb + tokenizer is all raw code)... the installer itself is 42mb lol incl. the ML model, so its light and has a reasonable footprint. It's 99% perfect. My goal is to improve perf/UX with every release as more feedback rolls in. I urgently needed this myself and now, you can enjoy it too. Available only on the app store (recommended, linked below) or as a .dmg from my website (also linked).

Introducing BeyondPDF, a smart, free, fully-local (wifi-less) PDF search app for MacOS. "Free" has always connoted to "It's free but we will steal your data"... not anymore. Whats wrong with MacOS's Preview? It's great... but I NEED smart/semantic search. Searching for words is tedious but searching for ideas is wayy easier. I converted a light embedding model from Hugging Face to CoreML and used zero libraries (vectordb + tokenizer is all raw code)... the installer itself is 42mb lol incl. the ML model, so its light and has a reasonable footprint. It's 99% perfect. My goal is to improve perf/UX with every release as more feedback rolls in. I urgently needed this myself and now, you can enjoy it too. Available only on the app store (recommended, linked below) or as a .dmg from my website (also linked).

193,680 просмотров • 2 лет назад

I hand-wrote a 500-LoC RL stack to make hacking on RL research much easier. Most RL stacks are either massive and unhackable, or duct-taped research scripts. I am open-sourcing Mithrl, a modular RLVR stack. Next items on my checklist: adding more complex environment examples, supporting multi-gpu + async RL, and QoL fixes. I might scrap external runtime dependencies (Huggingface PEFT + vLLM) and write purpose-built, simpler versions from scratch if I feel the need. If you want to experiment with RL and are looking to own sovereign tools, I’d love to get on call, understand your requirements and help integrate for free.

I hand-wrote a 500-LoC RL stack to make hacking on RL research much easier. Most RL stacks are either massive and unhackable, or duct-taped research scripts. I am open-sourcing Mithrl, a modular RLVR stack. Next items on my checklist: adding more complex environment examples, supporting multi-gpu + async RL, and QoL fixes. I might scrap external runtime dependencies (Huggingface PEFT + vLLM) and write purpose-built, simpler versions from scratch if I feel the need. If you want to experiment with RL and are looking to own sovereign tools, I’d love to get on call, understand your requirements and help integrate for free.

17,676 просмотров • 6 месяцев назад

Больше нет контента для загрузки