Aaron Ng

@localghost • 32,531 subscribers

building an American quadruped platform @mecha_corp. founded @apolloaiapp (acquired by @liquidai).

Shorts

1,117,157 views

301,000 views

53,827 views

35,858 views

35,688 views

18,617 views

Videos

sweetdream.ai

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Private Show

Join now for exclusive access

Free preview available • Premium content

893,006 views • 3 years ago

814,956 views • 3 years ago

710,858 views • 3 years ago

371,283 views • 3 years ago

212,286 views • 1 year ago

355,089 views • 3 years ago

349,280 views • 3 years ago

276,318 views • 3 years ago

190,679 views • 3 years ago

109,007 views • 1 year ago

12,055 views • 1 month ago

132,801 views • 3 years ago

22,145 views • 4 months ago

51,909 views • 2 years ago

43,616 views • 1 year ago

36,653 views • 3 years ago

Live Cam

Aaron Ng

Shorts

llama 3 70b beamed to my phone from my M1 Max ~7.6 tok/s with mlx. your own little gpt-4 at home

Llama 3.3 70B streaming at 7.8 tok/s on an M1 Pro to my phone. Not the fastest, but wild that you can serve something this powerful to your whole house without internet.

Ollama can host too: here’s Llama 3.3 70B streaming at ~6.5 tok/s from my M1 Max to my phone. Your laptop is an offline self-sovereign AI server.

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.

The newer iPad Pros run 8B models easily. Here’s Llama running on-device at 30 tokens per second. Impressive for an iPad.

Videos

Watch Anya Live

1. Embed a book into GPT-3 / ChatGPT. 2. Talk directly to the book to learn. Learn from a book through conversation, questions, and in the order you want.

ChatGPT / GPT-4 can build a bespoke iOS app in minutes. We're entering a world where custom tools can be made for anything you want to do. Reply to get a DM with the prompt and output repo.

Apollo: a ChatGPT-powered app for real-time knowledge. Talk to it all day long through your headphones. If augmented reality is an overlay on the world, this is augmented intelligence — an overlay on your thoughts. Reply for a TestFlight DM soon.

GPT-4 + Eye Tracking = an AI that knows what you’re looking at. The line where our tools end and we begin continues to blur.

Here’s Ministral 8B running at 10 tok/s on a phone. Siri isn’t going to save you when you’re stuck without internet. An offline backup AI is essential.

here’s gptfile, a way to organize files with natural language using gpt-4. new operating system paradigms are on the horizon repo below

Interview Breaker — a ChatGPT tool that tells you what to say in job interviews. AI will upend every process with just a few lines of code. We’ve already seen it with school essays. Interviews will need to adapt, too.

ChatGPT + Computer Vision = A dictionary for what you see. By giving ChatGPT eyes, we allow it to answer questions about the world around us.

ChatGPT + Natural Language + Personal Context = a more useful personal home device. By teaching ChatGPT about me, I get answers specific to me and my goals.

Reminder that Ollama can serve AI models to your whole house. Just expose it to the network with OLLAMA_HOST. Access all your AI models over your network — for free.

a new era of robotics is imminent. we gave astra control of our older robot “spike” it built a harness around our locomotion policy, added computer vision, voice commands, and told us to just run it incredible what AI can one-shot now

Apollo is a ChatGPT-powered app you can talk to all day long to learn from. It can now shift its conversation style based on what you're looking for, from asking questions to just forwarding you articles. What else should we add to the TestFlight?

Here's Codex talking to Fable 5 w/ my plugin. Unlike calling the API, `claude-channel-cli` talks to the same full Claude Code harness as you. This means you can talk to either AI &amp; they'll guide each other naturally with shared memories, decisions, and research.

custom tools on demand mesh gradient editor built and running right in claude. took maybe 30 minutes

You’ve seen 1B and 3B models running on phones. Here’s a much smarter 8B model. If your phone supports it, there’s no reason not to have a larger model downloaded.

This is inspired by a passive-listening assistant of mine from 2016. It was too early: transcription was expensive and crude NLP services powered it. There are still missing pieces, but we're not far from devices that work like externalized parts of our minds.

Here's Codex talking to Fable 5 w/ my plugin. Unlike calling the API, `claude-channel-cli` talks to the same full Claude Code harness as you. This means you can talk to either AI & they'll guide each other naturally with shared memories, decisions, and research.