Ian Johnson 🔬🤖
@enjalot • 8,729 subscribers
Member of Technical Staff @orbital_ind 💾 @observablehq, @google, @lever https://t.co/fuEQttdsY0
Shorts
Videos
i want new ways to look at lots of trajectories, currently exploring: - treemap laid out by groupings (metadata or computed) - colored by classification of success (or grouping) - sized by length - zoom in smoothly to see turns as beads on a string - extremely fast transcript viewer (instant for many thousands of msgs) - switch to 3d to see the forrest for the trees - transition to semantic (UMAP) layout - color by semantic clustering
Ian Johnson 🔬🤖29,769 görüntüleme • 10 gün önce
what if visualizing your data was actually a video game? flying through 30 million jina-v5-nano embeddings of 12 billion tokens of multilingual FineWeb + starcoder + pile + RedPajama looking at your data is supposed to be like eating your veggies, what if we made tasty veggies?
Ian Johnson 🔬🤖23,261 görüntüleme • 1 ay önce
I'm excited to release Latent Scope 1.0! Thanks to Fable clearing 2 years of backlog, you can now point your workhorse model at a directory of images, a text corpus or even existing RAG db and get back an interactive map for looking at your data through the eyes of a transformer. Latent Scope started as a set of scripts with a frontend to try and make it less tedious to run the process of projecting & clustering embeddings. Now we let agents do the tedium and the library is essentially a skill that reliably outputs data maps that you can explore. In this release we enabled a ton of stuff, starting with performance increases by switching the backend to LanceDB and enabling cuML GPU acceleration. We added support for images, and late interaction (ColBERT models) as well as 3D UMAP support. We also added Leland McInnes new EVoC clustering method. All that is topped off with a skill definition and an Impeccable powered UI revamp. See the thread for more videos and demos!
Ian Johnson 🔬🤖17,857 görüntüleme • 3 ay önce
Daha fazla içerik yok.