Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

what if visualizing your data was actually a video game? flying through 30 million jina-v5-nano embeddings of 12 billion tokens of multilingual FineWeb + starcoder + pile + RedPajama looking at your data is supposed to be like eating your veggies, what if we made tasty veggies?

Ian Johnson 🔬🤖

8,514 subscribers

23,261 views • 23 days ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

14 Comments

Ian Johnson 🔬🤖23 days ago

each voxel is a bin that holds umap data points, so we can preview whats in it with a heatmap (to show density), summary statistics (data set composition) or experimenting with an identicon (icon generated from content hash). i have more ideas but the weekend is over

Smoke-away23 days ago

Heatmap view is awesome.

Daniel van Strien22 days ago

You should make this into a @huggingface Space (even cooler if you can use Jobs so someone can set this up for any hub dataset!)

Vorname MitD22 days ago

Veggies attract fruit flies - I see a pattern here :)

William Wolf23 days ago

so cool

lakshya22 days ago

so cool

Kushal22 days ago

Severance would like a call

Caleb Palmquist22 days ago

This is very cool, I’ve thought of doing something like this before. Are there some practical applications you are using this with?

Benny Schudel22 days ago

This is amazing ❤️

Dr. Xi Zeng22 days ago

I'd go looking for the single-point voxels you filtered out. Those samples might be more fun to explore than the dense neighborhoods.

Matt Caldwell22 days ago

mindcraft

Alex22 days ago

30 million embeddings is the scale where 'explore vs. report' stops being a UX question and starts being an epistemology one

Thomas Czerniawski22 days ago

How many voxels?

Ian Johnson 🔬🤖22 days ago

3 million. but i filtered the view to only voxels with >5 points and its 500k (1.5m have just 1 point in them)

Related Videos

jina-embeddings-v5-omni is here! Our first universal embedding model for text, images, audio, and video. Available in two sizes: small (1.57B, 1024-dim, 32K context) and nano (0.95B, 768-dim, 8K context). Both support Matryoshka truncation down to 32 dimensions. v5-omni is back-compatible: if you already use jina-embeddings-v5-text-small/nano, the existing text indexes work with v5-omni out of the box. Without reindexing the text, just index your multimodal content with v5-omni and start searching images, audio, and video.

jina-embeddings-v5-omni is here! Our first universal embedding model for text, images, audio, and video. Available in two sizes: small (1.57B, 1024-dim, 32K context) and nano (0.95B, 768-dim, 8K context). Both support Matryoshka truncation down to 32 dimensions. v5-omni is back-compatible: if you already use jina-embeddings-v5-text-small/nano, the existing text indexes work with v5-omni out of the box. Without reindexing the text, just index your multimodal content with v5-omni and start searching images, audio, and video.

Jina AI

136,239 views • 4 months ago

What if catfishing was a thing of the past? What if you could access healthcare without compromising your medical data? We explored these and many other zk use cases during zkIRL in DevCon!

What if catfishing was a thing of the past? What if you could access healthcare without compromising your medical data? We explored these and many other zk use cases during zkIRL in DevCon!

Aleo

16,388 views • 1 year ago

Uh oh! Explosive diarrhea! A Cyclospora outbreak is making news- and if you are infected you get explosive diarrhea. Currently 32 states are affected and it appears to be in contaminated fruits and veggies. If you are in an outbreak area - think about cooking all of your fruits and veggies.

Uh oh! Explosive diarrhea! A Cyclospora outbreak is making news- and if you are infected you get explosive diarrhea. Currently 32 states are affected and it appears to be in contaminated fruits and veggies. If you are in an outbreak area - think about cooking all of your fruits and veggies.

Bunsen, Beaker, Bernoulli & Brix

14,308 views • 2 months ago

This can't be real. She actually thinks that kids can't apply and receive student loans for college if we get rid of the Department of Education. "What am I supposed to tell my son?" What is your message to her liberal tears?

This can't be real. She actually thinks that kids can't apply and receive student loans for college if we get rid of the Department of Education. "What am I supposed to tell my son?" What is your message to her liberal tears?

AmericanPapaBear™

2,184,617 views • 1 year ago

Be aware of what your electricity bill is now. Watch what happens if any AI data centers get built in your region. Your rates are going to increase dramatically because consumers are going to be forced to pay for the expansion of the power supply. If AI companies are not forced to fully fund their electricity requirements, the rest of us will pay for it. We are starting to see communities rise up and protest the building permits for AI data centers in their areas.

Be aware of what your electricity bill is now. Watch what happens if any AI data centers get built in your region. Your rates are going to increase dramatically because consumers are going to be forced to pay for the expansion of the power supply. If AI companies are not forced to fully fund their electricity requirements, the rest of us will pay for it. We are starting to see communities rise up and protest the building permits for AI data centers in their areas.

Wall Street Mav

47,407 views • 10 months ago

there’s no need to use wifi & cellular data at the same time. your phone is the #1 source of EMF exposure. if you’re going to be exposed to wifi, turn off cellular data to optimize your environment. better yet, hardwire your internet.

there’s no need to use wifi & cellular data at the same time. your phone is the #1 source of EMF exposure. if you’re going to be exposed to wifi, turn off cellular data to optimize your environment. better yet, hardwire your internet.

Tristan Scott

14,617 views • 6 months ago

What if this moment of weakness in your life is actually a weapon in God’s hand? Full Video:

What if this moment of weakness in your life is actually a weapon in God’s hand? Full Video:

stevenfurtick

28,244 views • 1 month ago

A hacking group spent a decade stealing data through hotel WiFi. That was espionage. Today, your credentials leak in breaches, land on the dark web, and get matched to your public identity — automatically. Serus monitors all of it. If your data surfaces anywhere, you'll know.

A hacking group spent a decade stealing data through hotel WiFi. That was espionage. Today, your credentials leak in breaches, land on the dark web, and get matched to your public identity — automatically. Serus monitors all of it. If your data surfaces anywhere, you'll know.

Serus

27,490,604 views • 5 months ago

What if your data worked for you instead of against you? In one of the most gripping talks at ZK Hub ETHDenver, Juan Angel (Juan), Ecosystem Growth at , made the case for “open but private” data - arguing that blind computation can break data out of corporate silos and let users lease it securely without ever revealing the raw inputs. Through real examples like encrypted genomic data (via Monatic DNA) and incentivized health prediction markets (Stadium Science), Juan painted a future where users hold the encryption keys, opt in to share data selectively, and get paid every time it's used. The biggest takeaway? Not your keys, not your data. This talk is also available to view on the House of ZK YouTube:

What if your data worked for you instead of against you? In one of the most gripping talks at ZK Hub ETHDenver, Juan Angel (Juan), Ecosystem Growth at , made the case for “open but private” data - arguing that blind computation can break data out of corporate silos and let users lease it securely without ever revealing the raw inputs. Through real examples like encrypted genomic data (via Monatic DNA) and incentivized health prediction markets (Stadium Science), Juan painted a future where users hold the encryption keys, opt in to share data selectively, and get paid every time it's used. The biggest takeaway? Not your keys, not your data. This talk is also available to view on the House of ZK YouTube:

House of ZK

65,143 views • 1 year ago

Is the future of AI $NEAR … ? OpenAI is racing toward a $1T IPO, quickly becoming a centralized beast of epic proportions. But what happens to your data in that world?? As chronear explains, “We can't let centralized actors determine how they store or how they use user data. It should be the users who actually control the custody or use of their data." NEAR AI is building a truly open AI, open source, where users control their data and store their data locally. What AI do you use daily? And would you switch if a better decentralized option existed?

Is the future of AI $NEAR … ? OpenAI is racing toward a $1T IPO, quickly becoming a centralized beast of epic proportions. But what happens to your data in that world?? As chronear explains, “We can't let centralized actors determine how they store or how they use user data. It should be the users who actually control the custody or use of their data." NEAR AI is building a truly open AI, open source, where users control their data and store their data locally. What AI do you use daily? And would you switch if a better decentralized option existed?

Bri Teresi

25,101 views • 6 months ago

Only 7.5 million into each of the 4 core coins puts $HEX at over $1. 30 million total. What people fail to realize is, if $HEX went back to a 80 billion dollar market cap like in 2021, it would be at 80 billion over $1. This is because 92.2 percent of the total supply is burned. Full video here:

Only 7.5 million into each of the 4 core coins puts $HEX at over $1. 30 million total. What people fail to realize is, if $HEX went back to a 80 billion dollar market cap like in 2021, it would be at 80 billion over $1. This is because 92.2 percent of the total supply is burned. Full video here:

Jake

28,175 views • 8 months ago

Casey Handmer on why Starlink and Starmind are so valuable: "If you run the math: What is the revenue per watt of transmitted microwave power for Starlink? It's a billion times higher than space-based solar power. SpaceX is making money hand over fist with Starlink. So you take that model and say, we make lots of money transmitting data from your content delivery service like Netflix, but instead let's transmit tokens of some hyper intelligent model. Once you've got the hardware flying, what is the comparative value between your average Starlink bit versus your average Starmind bit? It's probably at least 1,000 times more valuable. It's not even in the same category. It will be interesting to see if economic demand for intelligence in the form of AI tokens can saturate. I suspect not."

Casey Handmer on why Starlink and Starmind are so valuable: "If you run the math: What is the revenue per watt of transmitted microwave power for Starlink? It's a billion times higher than space-based solar power. SpaceX is making money hand over fist with Starlink. So you take that model and say, we make lots of money transmitting data from your content delivery service like Netflix, but instead let's transmit tokens of some hyper intelligent model. Once you've got the hardware flying, what is the comparative value between your average Starlink bit versus your average Starmind bit? It's probably at least 1,000 times more valuable. It's not even in the same category. It will be interesting to see if economic demand for intelligence in the form of AI tokens can saturate. I suspect not."

Ti Morse

61,222 views • 5 days ago

Are you the one? #InnBucks is looking for a creative, fun, energetic, confident, and multilingual Spokesperson to present our video content. If you feel you have what it takes, drop us your 30 second demo here and if you impress, we will call you for the final round. 1/2

Are you the one? #InnBucks is looking for a creative, fun, energetic, confident, and multilingual Spokesperson to present our video content. If you feel you have what it takes, drop us your 30 second demo here and if you impress, we will call you for the final round. 1/2

InnBucks®

21,027 views • 3 years ago

Palantir CEO Alex Karp on what customers actually want, the real business of frontier labs, and the importance of open source models: “What the technical customers want is control over their compute, their models, their data stack, and their alpha. They want to know they own the means of production, and it's not being transferred to someone else.” "Who owns the data? Are the prompts secure? Is this being transferred to you?" "If it was so valuable, and I can make you a billion dollars, wouldn't I say I'll make you a billion dollars and I want 30%? Why are they charging for tokens if it's so valuable?"

Palantir CEO Alex Karp on what customers actually want, the real business of frontier labs, and the importance of open source models: “What the technical customers want is control over their compute, their models, their data stack, and their alpha. They want to know they own the means of production, and it's not being transferred to someone else.” "Who owns the data? Are the prompts secure? Is this being transferred to you?" "If it was so valuable, and I can make you a billion dollars, wouldn't I say I'll make you a billion dollars and I want 30%? Why are they charging for tokens if it's so valuable?"

Palantir

4,527,213 views • 3 months ago

Looking at the data, it almost seems like the church is intentionally ignoring unreached people. Why is that? When we take the time together to consider why that is, we can actually change the reality of the unreached. If we want to.

Looking at the data, it almost seems like the church is intentionally ignoring unreached people. Why is that? When we take the time together to consider why that is, we can actually change the reality of the unreached. If we want to.

David Platt

28,637 views • 2 years ago

Atomic veterans describe what nukes feel like “When the flash hit you, you could see the X-rays of your hand through your closed eyes.” “If I was looking at you now I would see all your bones, the blood vessels and everything.”

Atomic veterans describe what nukes feel like “When the flash hit you, you could see the X-rays of your hand through your closed eyes.” “If I was looking at you now I would see all your bones, the blood vessels and everything.”

James Lucas

3,414,534 views • 6 months ago

Did you know that Facebook made $134.9 billion in 2023 from selling your data? Our society has come to the point where we accepted an unfair model in which privacy is being exploited and data gifted to big tech that is selling it for billions. We intend to break the norm of how data is shared on the internet because it is outdated and unfair. You should be empowered with more control and monetization models for your data!

Did you know that Facebook made $134.9 billion in 2023 from selling your data? Our society has come to the point where we accepted an unfair model in which privacy is being exploited and data gifted to big tech that is selling it for billions. We intend to break the norm of how data is shared on the internet because it is outdated and unfair. You should be empowered with more control and monetization models for your data!

Solana ID 🪷

30,464 views • 2 years ago

Some of the most important moments in your health never make it into your data. How a workout actually felt. Whether an injury is improving. What recovery tools you have at home. Those details matter. Now WHOOP can understand them. Here's what that looks like in practice:

Some of the most important moments in your health never make it into your data. How a workout actually felt. Whether an injury is improving. What recovery tools you have at home. Those details matter. Now WHOOP can understand them. Here's what that looks like in practice:

WHOOP

10,277 views • 10 months ago