Ian Johnson 🔬🤖

I'm excited to release Latent Scope 1.0! Thanks to Fable clearing 2 years of backlog, you can now point your workhorse model at a directory of images, a text corpus or even existing RAG db and get back an interactive map for looking at your data through the eyes of a transformer. Latent Scope started as a set of scripts with a frontend to try and make it less tedious to run the process of projecting & clustering embeddings. Now we let agents do the tedium and the library is essentially a skill that reliably outputs data maps that you can explore. In this release we enabled a ton of stuff, starting with performance increases by switching the backend to LanceDB and enabling cuML GPU acceleration. We added support for images, and late interaction (ColBERT models) as well as 3D UMAP support. We also added Leland McInnes new EVoC clustering method. All that is topped off with a skill definition and an Impeccable powered UI revamp. See the thread for more videos and demos!