Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

what if visualizing your data was actually a video game? flying through 30 million jina-v5-nano embeddings of 12 billion tokens of multilingual FineWeb + starcoder + pile + RedPajama looking at your data is supposed to be like eating your veggies, what if we made tasty veggies?

23,261 görüntüleme • 23 gün önce •via X (Twitter)

14 Yorum

Ian Johnson 🔬🤖 profil fotoğrafı
Ian Johnson 🔬🤖23 gün önce

each voxel is a bin that holds umap data points, so we can preview whats in it with a heatmap (to show density), summary statistics (data set composition) or experimenting with an identicon (icon generated from content hash). i have more ideas but the weekend is over

Smoke-away profil fotoğrafı
Smoke-away23 gün önce

Heatmap view is awesome.

Daniel van Strien profil fotoğrafı
Daniel van Strien22 gün önce

You should make this into a @huggingface Space (even cooler if you can use Jobs so someone can set this up for any hub dataset!)

Vorname MitD profil fotoğrafı
Vorname MitD22 gün önce

Veggies attract fruit flies - I see a pattern here :)

William Wolf profil fotoğrafı
William Wolf23 gün önce

so cool

lakshya profil fotoğrafı
lakshya22 gün önce

so cool

Kushal profil fotoğrafı
Kushal22 gün önce

Severance would like a call

Caleb Palmquist profil fotoğrafı
Caleb Palmquist22 gün önce

This is very cool, I’ve thought of doing something like this before. Are there some practical applications you are using this with?

Benny Schudel profil fotoğrafı
Benny Schudel22 gün önce

This is amazing ❤️

Dr. Xi Zeng profil fotoğrafı
Dr. Xi Zeng22 gün önce

I'd go looking for the single-point voxels you filtered out. Those samples might be more fun to explore than the dense neighborhoods.

Matt Caldwell profil fotoğrafı
Matt Caldwell22 gün önce

mindcraft

Alex profil fotoğrafı
Alex23 gün önce

30 million embeddings is the scale where 'explore vs. report' stops being a UX question and starts being an epistemology one

Thomas Czerniawski profil fotoğrafı
Thomas Czerniawski23 gün önce

How many voxels?

Ian Johnson 🔬🤖 profil fotoğrafı
Ian Johnson 🔬🤖22 gün önce

3 million. but i filtered the view to only voxels with >5 points and its 500k (1.5m have just 1 point in them)

Benzer Videolar