Simone Margaritelli
@evilsocket • 47,871 subscribers
Music, cybersecurity, open source and AI • Author of bettercap, pwnagotchi, opensnitch, bleah, legba and a few other things. Co-founder & CTO @ 🥷
Videos
llama3 8B (not quantized) running on an heterogeneous home cluster made of: - iPhone 15 Pro Max - iPad Pro (not sure which version XD) - MacBook Pro ( M1 Max ) - NVIDIA GeForce 3080 (not visible in video) - 2x NVIDIA Titan X Pascal Very soon also supporting Android (I *have* to also add my NVIDIA Shield GPU!!!!!). Single code base, single model format (reduced and optimally distributed to every node to save space). Everything (including iOS code) is open here ... it would be really nice, with the help of the community, taking this project to the next level in terms of optimization and support. My vision is about a distributed inference server that can run any model on any backend in any cluster topology - let's fight programmed obsolescence and democratize inference!
Simone Margaritelli304,161 views • 2 years ago
What if you glue together (free) AI, torrents, a torrent search engine, telegram and your movies history? Freeflix! An AI that knows your tastes, recommends and searches movies, TV shows and more, then downloads them, from your terminal or (remotely) via Telegram.
Simone Margaritelli20,848 views • 8 months ago
No more content to load