Day 1: Benchmarks We ran 1000+ LLM benchmarks on... real consumer devices. Data includes single-device and multi-device clusters with Tokens-Per-Second (TPS) and Time-To-First-Token (TTFT). Setups tested: 3x M4 Mac Mini cluster, iPhone 15 + S24, RTX4090 & more.show more

M4 Mac Mini AI Cluster Uses EXO Labs with... Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).show more

M4 Mac Mini AI cluster running Llama 3.3 70B... Preliminary results show Gigabit ethernet switch (4 tok/sec) is slower than Thunderbolt-5 with EXO Labs Benchmarks including Thunderbolt-5 coming soonTM.show more

Distributed training on M4 Mac Mini cluster We implemented... Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.show more

m4 mac mini cluster with 5 nodes running exo

What if your cloud agents could use iOS and... Android devices just like that? Introducing Agent Device Cloud: hosted on your dusted Mac Mini, used through 𝚊𝚐𝚎𝚗𝚝-𝚍𝚎𝚟𝚒𝚌𝚎show more

Introducing Find the best local models based on real... data 1. People run and submit benchmarks 2. Stats aggregated over models / devices 3. Find the best model for you `npx whatcanirun`, fully open-sourceshow more

This is not possible with chatgpt… Only possible with... an on-device LLM: - Real-time note monitoring - Adjusts difficulty in real-time - Announces progressshow more

Another demo of the iPhone 17 Pro’s on-device LLM... performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quantsshow more

Introducing Nomic Embed - the first fully open long... context text embedder to beat OpenAI - Open source, open weights, open data - Beats OpenAI text-embeding-3-small and Ada on short and long context benchmarks - Day 1 integrations with @langchain, Llama-index, MongoDBshow more

Multi-chain data, streamed in real-time. Get live prices, onchain... trades & OHLCV data for 20M+ tokens with the CoinGecko WebSocket API.show more

No matter where you go, and no matter which... device, we believe your internet should go with you 🌏 Starting today, your Arc tabs, folders, & spaces SYNC in real-time across iPhone (Arc Search), Mac, & Windows. Android in the works. Here’s a demo from the new Arc Search app:show more

Just dropped on HF — NeuTTS Air Next-gen on-device... TTS that matches cloud-level quality while staying fully open source. > Real-time speech synthesis on CPU/GPU > 3-second voice cloning, no cloud or data upload > Compact: under 200 MB, runs on mobile and edge devices > Multilingual and expressive > Developed by Neuphonic , optimized for speed and fidelityshow more

The Expansion of LayerAI Network with laiOS 🧬 Each... laiOS device requires at least 1 token per device to operate. There are over 1 trillion devices in the world already. This number grows by tens of billions every year. If just 0.3% of devices opt into the network, that’s a demand for 3 billion $LAI. LayerAI aims to present the first working version of this product by Q1-Q2 of this year.show more

Wow, Apple finally catches up with Android here. Device... Hub lets you control a connected iPhone directly from your Mac without constantly reaching for the deviceshow more

Running multiple accounts on one device was never supposed... to work at scale. Yet professionals do it every day without bans, flags, or leaks. Octo Browser is the reason. A next-gen anti-detect infrastructure built to replicate real devices, secure data, and manage hundreds of accounts seamlessly. Multi-accounting isn’t the risk anymore; weak tools are. 👇show more

CRYPTIC ALPHA V1 IS NOW LIVE After months of... focused development and rigorous testing, Cryptic Alpha V1 is officially live on Android. This marks the first time quantum-safe messaging and private token swaps are delivered together in a single, consumer-grade mobile app protected by device-level encryption and built for real-world use. For the first time, privacy at this scale is accessible to everyday users. New integrations, features, and expansions are already underway as we continue building the future of private digital life.show more

Track new token launches in real-time on mobile ⚡... → Discover newly launched, migrating, and migrated tokens → Monitor live data on holder count, market cap, and volumeshow more

Demo of 1-bit Bonsai 8B from PrismML running on-device... on iPhone 17 Pro More than 40tk/s for a dense 8B model on iPhone, that’s a first Powered by Apple MLX and available now in Locally AIshow more