Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

what if visualizing your data was actually a video game? flying through 30 million jina-v5-nano embeddings of 12 billion tokens of multilingual FineWeb + starcoder + pile + RedPajama looking at your data is supposed to be like eating your veggies, what if we made tasty veggies?

23,261 Aufrufe • vor 23 Tagen •via X (Twitter)

14 Kommentare

Profilbild von Ian Johnson 🔬🤖
Ian Johnson 🔬🤖vor 23 Tagen

each voxel is a bin that holds umap data points, so we can preview whats in it with a heatmap (to show density), summary statistics (data set composition) or experimenting with an identicon (icon generated from content hash). i have more ideas but the weekend is over

Profilbild von Smoke-away
Smoke-awayvor 23 Tagen

Heatmap view is awesome.

Profilbild von Daniel van Strien
Daniel van Strienvor 22 Tagen

You should make this into a @huggingface Space (even cooler if you can use Jobs so someone can set this up for any hub dataset!)

Profilbild von Vorname MitD
Vorname MitDvor 22 Tagen

Veggies attract fruit flies - I see a pattern here :)

Profilbild von William Wolf
William Wolfvor 23 Tagen

so cool

Profilbild von lakshya
lakshyavor 23 Tagen

so cool

Profilbild von Kushal
Kushalvor 22 Tagen

Severance would like a call

Profilbild von Caleb Palmquist
Caleb Palmquistvor 22 Tagen

This is very cool, I’ve thought of doing something like this before. Are there some practical applications you are using this with?

Profilbild von Benny Schudel
Benny Schudelvor 22 Tagen

This is amazing ❤️

Profilbild von Dr. Xi Zeng
Dr. Xi Zengvor 22 Tagen

I'd go looking for the single-point voxels you filtered out. Those samples might be more fun to explore than the dense neighborhoods.

Profilbild von Matt Caldwell
Matt Caldwellvor 22 Tagen

mindcraft

Profilbild von Alex
Alexvor 23 Tagen

30 million embeddings is the scale where 'explore vs. report' stops being a UX question and starts being an epistemology one

Profilbild von Thomas Czerniawski
Thomas Czerniawskivor 23 Tagen

How many voxels?

Profilbild von Ian Johnson 🔬🤖
Ian Johnson 🔬🤖vor 23 Tagen

3 million. but i filtered the view to only voxels with >5 points and its 500k (1.5m have just 1 point in them)

Ähnliche Videos