Loading video...

Video Failed to Load

Go Home

One cool thing about ColBERT-based search compared to the cosine-based vector retrieval is that you get interpretability for free as a byproduct of the MaxSim computation. It's kind of like the Lucene highlighter, letting you grab the most relevant snippets from a long document to show users where their...

JinaAI_'s profile picture

Jina AI

17,213 subscribers

22,268 views • 2 years ago •via X (Twitter)

Science & TechnologyArts
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

GraphRAG-UI GraphRAG-UI is a user-friendly interface for GraphRAG, a powerful tool that uses the Retrieval-Augmented Generation (RAG) approach to index and query large text data. This project supports the latest version graphrag-0.3.3 and aims to provide a convenient management and interaction method for GraphRAG, supporting the configuration of local large language models like Ollama, making it easier for users to leverage.
0:11

GraphRAG-UI GraphRAG-UI is a user-friendly interface for GraphRAG, a powerful tool that uses the Retrieval-Augmented Generation (RAG) approach to index and query large text data. This project supports the latest version graphrag-0.3.3 and aims to provide a convenient management and interaction method for GraphRAG, supporting the configuration of local large language models like Ollama, making it easier for users to leverage.

AK

27,249 views • 1 year ago

Vector Database by Hand ✍️ Vector databases are revolutionizing how we search and analyze complex data. They have become the backbone of Retrieval Augmented Generation (#RAG). How do vector databases work? [1] Given ↳ A dataset of three sentences, each has 3 words (or tokens) ↳ In practice, a dataset may contain millions or billions of sentences. The max number of tokens may be tens of thousands (e.g., 32,768 mistral-7b). Process "how are you" [2] 🟨 Word Embeddings ↳ For each word, look up corresponding word embedding vector from a table of 22 vectors, where 22 is the vocabulary size. ↳ In practice, the vocabulary size can be tens of thousands. The word embedding dimensions are in the thousands (e.g., 1024, 4096) [3] 🟩 Encoding ↳ Feed the sequence of word embeddings to an encoder to obtain a sequence of feature vectors, one per word. ↳ Here, the encoder is a simple one layer perceptron (linear layer + ReLU) ↳ In practice, the encoder is a transformer or one of its many variants. [4] 🟩 Mean Pooling ↳ Merge the sequence of feature vectors into a single vector using "mean pooling" which is to average across the columns. ↳ The result is a single vector. We often call it "text embeddings" or "sentence embeddings." ↳ Other pooling techniques are possible, such as CLS. But mean pooling is the most common. [5] 🟦 Indexing ↳ Reduce the dimensions of the text embedding vector by a projection matrix. The reduction rate is 50% (4->2). ↳ In practice, the values in this projection matrix is much more random. ↳ The purpose is similar to that of hashing, which is to obtain a short representation to allow faster comparison and retrieval. ↳ The resulting dimension-reduced index vector is saved in the vector storage. [6] Process "who are you" ↳ Repeat [2]-[5] [7] Process "who am I" ↳ Repeat [2]-[5] Now we have indexed our dataset in the vector database. [8] 🟥 Query: "am I you" ↳ Repeat [2]-[5] ↳ The result is a 2-d query vector. [9] 🟥 Dot Products ↳ Take dot product between the query vector and database vectors. They are all 2-d. ↳ The purpose is to use dot product to estimate similarity. ↳ By transposing the query vector, this step becomes a matrix multiplication. [10] 🟥 Nearest Neighbor ↳ Find the largest dot product by linear scan. ↳ The sentence with the highest dot product is "who am I" ↳ In practice, because scanning billions of vectors is slow, we use an Approximate Nearest Neighbor (ANN) algorithm like the Hierarchical Navigable Small Worlds (HNSW).
0:17

Vector Database by Hand ✍️ Vector databases are revolutionizing how we search and analyze complex data. They have become the backbone of Retrieval Augmented Generation (#RAG). How do vector databases work? [1] Given ↳ A dataset of three sentences, each has 3 words (or tokens) ↳ In practice, a dataset may contain millions or billions of sentences. The max number of tokens may be tens of thousands (e.g., 32,768 mistral-7b). Process "how are you" [2] 🟨 Word Embeddings ↳ For each word, look up corresponding word embedding vector from a table of 22 vectors, where 22 is the vocabulary size. ↳ In practice, the vocabulary size can be tens of thousands. The word embedding dimensions are in the thousands (e.g., 1024, 4096) [3] 🟩 Encoding ↳ Feed the sequence of word embeddings to an encoder to obtain a sequence of feature vectors, one per word. ↳ Here, the encoder is a simple one layer perceptron (linear layer + ReLU) ↳ In practice, the encoder is a transformer or one of its many variants. [4] 🟩 Mean Pooling ↳ Merge the sequence of feature vectors into a single vector using "mean pooling" which is to average across the columns. ↳ The result is a single vector. We often call it "text embeddings" or "sentence embeddings." ↳ Other pooling techniques are possible, such as CLS. But mean pooling is the most common. [5] 🟦 Indexing ↳ Reduce the dimensions of the text embedding vector by a projection matrix. The reduction rate is 50% (4->2). ↳ In practice, the values in this projection matrix is much more random. ↳ The purpose is similar to that of hashing, which is to obtain a short representation to allow faster comparison and retrieval. ↳ The resulting dimension-reduced index vector is saved in the vector storage. [6] Process "who are you" ↳ Repeat [2]-[5] [7] Process "who am I" ↳ Repeat [2]-[5] Now we have indexed our dataset in the vector database. [8] 🟥 Query: "am I you" ↳ Repeat [2]-[5] ↳ The result is a 2-d query vector. [9] 🟥 Dot Products ↳ Take dot product between the query vector and database vectors. They are all 2-d. ↳ The purpose is to use dot product to estimate similarity. ↳ By transposing the query vector, this step becomes a matrix multiplication. [10] 🟥 Nearest Neighbor ↳ Find the largest dot product by linear scan. ↳ The sentence with the highest dot product is "who am I" ↳ In practice, because scanning billions of vectors is slow, we use an Approximate Nearest Neighbor (ANN) algorithm like the Hierarchical Navigable Small Worlds (HNSW).

Tom Yeh

191,928 views • 2 years ago

Reminder: The Democrats are not an opposition party. Their function is to sell the illusion of democracy and cover up the truth, which is that the US is a dictatorship of capital where every aspect of society from the government to the economy is controlled by and for the rich.
0:15

Reminder: The Democrats are not an opposition party. Their function is to sell the illusion of democracy and cover up the truth, which is that the US is a dictatorship of capital where every aspect of society from the government to the economy is controlled by and for the rich.

Power to the People ☭🕊

59,394 views • 3 months ago

We had a productive day and had a solid interaction with Volunteers of the Ward the MK is going to decisively win the up-coming By-Elections. #GwazaMkhontoGwaza
0:15

We had a productive day and had a solid interaction with Volunteers of the Ward the MK is going to decisively win the up-coming By-Elections. #GwazaMkhontoGwaza

Floyd Shivambu

14,829 views • 1 year ago

HOLY SHIT...you can "inference" LLMs in Sora 🤯 the prompt was: "Open chatgpt and send a message!" How insane is it that the generated audio is not only a relevant response to the query that Sora made up out of nowhere, but the haiku is syllable-accurate?! 🥲
0:10

HOLY SHIT...you can "inference" LLMs in Sora 🤯 the prompt was: "Open chatgpt and send a message!" How insane is it that the generated audio is not only a relevant response to the query that Sora made up out of nowhere, but the haiku is syllable-accurate?! 🥲

Pliny the Liberator 🐉󠅫󠄼󠄿󠅆󠄵󠄐󠅀󠄼󠄹󠄾󠅉󠅭

284,447 views • 8 months ago

“The light of Fajr is the beginning of hope and the start of a new day.” “The morning prayer is essential to start your day on a positive note.” “Fajr is the best time to seek Allah's mercy and blessings.” The Fajr prayer is like a fortress, guarding us from the evils of the day.
0:10

“The light of Fajr is the beginning of hope and the start of a new day.” “The morning prayer is essential to start your day on a positive note.” “Fajr is the best time to seek Allah's mercy and blessings.” The Fajr prayer is like a fortress, guarding us from the evils of the day.

Fariha Rajput

21,623 views • 2 years ago

Added context to my tiny diffusion model to enable sequential generation of longer outputs! Currently the context is a quarter of the sequence length (seq_len=256, context_len=64). I have a theory that the less semantic-value-per-token, the worse the “curse of parallel decoding” is. With parallel decoding, we independently predict multiple tokens in one step. With the sentence “My poker hand was a ___ ___”, two valid predictions are “two pair” and “straight flush”. Because each token prediction is independent though, we can end up with a nonsensical output like “two flush”. This seems to be exacerbated with low semantic-value-per-token, as now you need more tokens to express the same concept. Instead of needing to independently predict two tokens, we might need to predict 10 instead (which is of course much harder). The model currently has noticeably worse output compared to nanogpt (similar size) and I believe this is a main reason. I’ll try adding confidence-aware parallel decoding (from NVIDIA’s Fast-dLLM paper) and other tricks and see how much they improve generation quality.
0:12

Added context to my tiny diffusion model to enable sequential generation of longer outputs! Currently the context is a quarter of the sequence length (seq_len=256, context_len=64). I have a theory that the less semantic-value-per-token, the worse the “curse of parallel decoding” is. With parallel decoding, we independently predict multiple tokens in one step. With the sentence “My poker hand was a ___ ___”, two valid predictions are “two pair” and “straight flush”. Because each token prediction is independent though, we can end up with a nonsensical output like “two flush”. This seems to be exacerbated with low semantic-value-per-token, as now you need more tokens to express the same concept. Instead of needing to independently predict two tokens, we might need to predict 10 instead (which is of course much harder). The model currently has noticeably worse output compared to nanogpt (similar size) and I believe this is a main reason. I’ll try adding confidence-aware parallel decoding (from NVIDIA’s Fast-dLLM paper) and other tricks and see how much they improve generation quality.

Nathan Barry

89,040 views • 8 months ago

In 2000, Jennifer Lopez attended the Grammy Awards wearing the now-infamous green Versace "Jungle Dress". The striking, plunging gown immediately became a global sensation, generating an unprecedented demand from users searching for photos of the dress. At the time, Google's search results were primarily text-based, and the company realized they couldn't directly satisfy the massive, visually-driven query. This overwhelming and specific search demand, which became the most popular query Google had ever seen, served as the direct catalyst and motivation for the company to develop and launch Google Images in 2001. . . . #jenniferlopez #grammys #google #tech #usa
0:12

In 2000, Jennifer Lopez attended the Grammy Awards wearing the now-infamous green Versace "Jungle Dress". The striking, plunging gown immediately became a global sensation, generating an unprecedented demand from users searching for photos of the dress. At the time, Google's search results were primarily text-based, and the company realized they couldn't directly satisfy the massive, visually-driven query. This overwhelming and specific search demand, which became the most popular query Google had ever seen, served as the direct catalyst and motivation for the company to develop and launch Google Images in 2001. . . . #jenniferlopez #grammys #google #tech #usa

𝐌𝐮𝐬𝐢𝐜 - 𝐌𝐨𝐯𝐢𝐞 - 𝐀𝐧𝐝 𝐌𝐨𝐫𝐞⭐️❤️

1,324,194 views • 5 months ago

Unlocking Zero Point Energy. The Casimir effect is a spontaneous force which has potential applications as free source of energy. The effect can be manifesting as a repulsive tendency between two conductive plates in a vacuum environment or can be a phenomenon of attraction between the same plates. A number of characteristics determine the attraction or repellence. The current understanding of the Casimir effect is based on the interaction between the fluctuations in energy density of the vacuum and van der Waals forces at play. The vacuum is thought to be the primary driver in the dynamical effect while the van der Waals contributes to the attraction. Because the Casimir torque arise from the #quantum fluctuations of energy or, more precisely from the zero point energy of materials and their dependence on the boundary conditions of the electromagnetic fields, these kinetic forces can be tailored, this raises the intriguing possibility of exploiting it for free energy. 🔗
0:13

Unlocking Zero Point Energy. The Casimir effect is a spontaneous force which has potential applications as free source of energy. The effect can be manifesting as a repulsive tendency between two conductive plates in a vacuum environment or can be a phenomenon of attraction between the same plates. A number of characteristics determine the attraction or repellence. The current understanding of the Casimir effect is based on the interaction between the fluctuations in energy density of the vacuum and van der Waals forces at play. The vacuum is thought to be the primary driver in the dynamical effect while the van der Waals contributes to the attraction. Because the Casimir torque arise from the #quantum fluctuations of energy or, more precisely from the zero point energy of materials and their dependence on the boundary conditions of the electromagnetic fields, these kinetic forces can be tailored, this raises the intriguing possibility of exploiting it for free energy. 🔗

Maurizio Iβλἄ

23,552 views • 1 year ago

Here is a 3D visualization of the coming solar storm using model parameters from NASA's run, NOAA's run (shown below), and the coronagraph views from STEREO-A/COR2 and SOHO/LASCO. The storm is expected to hit Earth early December 9. The 3D visualization clearly shows the low inclination orientation of the solar slinky core inside the larger storm envelope. Of course, the earlier eruption that erupted to the northeast, might deflect this structure a little bit, but likely that will only make the structure move more towards the ecliptic plane, which will give us a larger chance of crossing through the solar slinky core. One nice thing about low inclination flux rope cores is that they almost ALWAYS have southward field in them at some point. So this is good news for aurora photographers-- as long as this solar storm stays true to its launch trajectory and inclination, we could see some organized southward pointed magnetic field. Considering this solar storm is fast-- that usually indicates the storm will not deviate much from its original launch trajectory! Here is the link to a static frame of the 3D frame visualization so you can fly around it yourself:
0:36

Here is a 3D visualization of the coming solar storm using model parameters from NASA's run, NOAA's run (shown below), and the coronagraph views from STEREO-A/COR2 and SOHO/LASCO. The storm is expected to hit Earth early December 9. The 3D visualization clearly shows the low inclination orientation of the solar slinky core inside the larger storm envelope. Of course, the earlier eruption that erupted to the northeast, might deflect this structure a little bit, but likely that will only make the structure move more towards the ecliptic plane, which will give us a larger chance of crossing through the solar slinky core. One nice thing about low inclination flux rope cores is that they almost ALWAYS have southward field in them at some point. So this is good news for aurora photographers-- as long as this solar storm stays true to its launch trajectory and inclination, we could see some organized southward pointed magnetic field. Considering this solar storm is fast-- that usually indicates the storm will not deviate much from its original launch trajectory! Here is the link to a static frame of the 3D frame visualization so you can fly around it yourself:

Dr. Tamitha Skov

18,429 views • 6 months ago

Due to a bizarre interaction between Pokeys and Turn Blocks in Super Mario Maker 2, it is possible to create a "Jumpscare Pokey" that rises up extremely quickly and unexpectedly from the bottom of the screen.
0:16

Due to a bizarre interaction between Pokeys and Turn Blocks in Super Mario Maker 2, it is possible to create a "Jumpscare Pokey" that rises up extremely quickly and unexpectedly from the bottom of the screen.

Supper Mario Broth

152,479 views • 10 months ago

DOM3 is made from HTML, CSS and Javascript, closer to a document than a canvas. It's a strange contemporary material that shapes much of our digital lives. The rhythm of endless creation and deletion in DOM3 is a self-driving version of what happens when you browse the web. "The Document Object Model (DOM) connects web pages to scripts or programming languages by representing the structure of a document—such as the HTML representing a web page—in memory." A html element, and a rectangle on a canvas, are not the same thing. It's a different material. Even if it all ends up controlling the same pixels, the process is different. The html element kind of actually exists, in this abstract context of a document object model. And in memory, in the moment. If it was possible to measure its weight, it would be heavier than a pixel on a canvas.
0:18

DOM3 is made from HTML, CSS and Javascript, closer to a document than a canvas. It's a strange contemporary material that shapes much of our digital lives. The rhythm of endless creation and deletion in DOM3 is a self-driving version of what happens when you browse the web. "The Document Object Model (DOM) connects web pages to scripts or programming languages by representing the structure of a document—such as the HTML representing a web page—in memory." A html element, and a rectangle on a canvas, are not the same thing. It's a different material. Even if it all ends up controlling the same pixels, the process is different. The html element kind of actually exists, in this abstract context of a document object model. And in memory, in the moment. If it was possible to measure its weight, it would be heavier than a pixel on a canvas.

Leander Herzog

11,466 views • 9 months ago

Playphrase. me is a website where you can look up a phrase and it'll show you the same phrase found in movies or tv shows. It shows you over 1000s of matches and it's completely free. This is great if you want to find funny clips for videos saying the same phrase.
0:19

Playphrase. me is a website where you can look up a phrase and it'll show you the same phrase found in movies or tv shows. It shows you over 1000s of matches and it's completely free. This is great if you want to find funny clips for videos saying the same phrase.

Malummii | → Offkai 🦐🫧

37,760 views • 3 months ago

In Prisma Next, you can stream query results straight from the database, row by row and fully typed. That means exports, reports, and ETL jobs of any size run smoothly, with the same safety you get on a normal query.
0:12

In Prisma Next, you can stream query results straight from the database, row by row and fully typed. That means exports, reports, and ETL jobs of any size run smoothly, with the same safety you get on a normal query.

Prisma

24,373 views • 17 days ago

how based are you? it’s nice to see how more and more new apps are appearing inside the base app every day. it’s a great opportunity for users to get in early and earn rewards it’s also a big boost for the base ecosystem as a whole: active users get rewarded, the ecosystem grows, developers earn, users earn. a real win-win that’s what “base is for everyone” is all about “base me” is a fun app from the creator Fokki. you can spin the wheel and find out just how based you are. i got lucky and ended up being as based as jesse.base.eth you can join and try it yourself using the link below
0:18

how based are you? it’s nice to see how more and more new apps are appearing inside the base app every day. it’s a great opportunity for users to get in early and earn rewards it’s also a big boost for the base ecosystem as a whole: active users get rewarded, the ecosystem grows, developers earn, users earn. a real win-win that’s what “base is for everyone” is all about “base me” is a fun app from the creator Fokki. you can spin the wheel and find out just how based you are. i got lucky and ended up being as based as jesse.base.eth you can join and try it yourself using the link below

mai

26,203 views • 5 months ago

Levin responds to an article about Gavin Newsom by attacking someone quoted in the article as “one of the fake MAGA bigmouths” The quote is from Steve Bannon
0:11

Levin responds to an article about Gavin Newsom by attacking someone quoted in the article as “one of the fake MAGA bigmouths” The quote is from Steve Bannon

Acyn

75,044 views • 10 months ago

Realizing people might not have realized that by "flower game" I mean this end screen is a DIRECT reference to the book of unveiling in Destiny 2, which itself refers to a modified version of John Horton Conway's Game of Life; the book refers to this as The Flower Game, a zero-player game where the only move is the initial set up of the pieces and their behaviors. I think if this Durandal is the one from the end of Marathon Infinity, then perhaps he's found a way to influence the Flower Game, and is using that influence to re-write the universe to create a reality that allows his escape from reality itself.
0:12

Realizing people might not have realized that by "flower game" I mean this end screen is a DIRECT reference to the book of unveiling in Destiny 2, which itself refers to a modified version of John Horton Conway's Game of Life; the book refers to this as The Flower Game, a zero-player game where the only move is the initial set up of the pieces and their behaviors. I think if this Durandal is the one from the end of Marathon Infinity, then perhaps he's found a way to influence the Flower Game, and is using that influence to re-write the universe to create a reality that allows his escape from reality itself.

John Titor, Timewalker.

48,955 views • 3 months ago

Welcome to this little moment of morning routine, if we can call it that 😊 this comforting little moment with the sweet scent of coffee and the softness of the sun's rays ☀️ I chose my earrings for the day based on my mood. The jewelry we wear is also indicative of our personality, which is why it's important for me that it matches my outfit and the mood of the day.
0:17

Welcome to this little moment of morning routine, if we can call it that 😊 this comforting little moment with the sweet scent of coffee and the softness of the sun's rays ☀️ I chose my earrings for the day based on my mood. The jewelry we wear is also indicative of our personality, which is why it's important for me that it matches my outfit and the mood of the day.

Wildy Caro

15,787 views • 1 year ago

The giant oceanic manta ray is the largest type of ray in the world. It can grow to a disc size of up to 7 m (23 ft) across with a weight of about 3,000 kg (6,600 lb). Scuba diver for scale. [📹 deepbluecoast]
0:16

The giant oceanic manta ray is the largest type of ray in the world. It can grow to a disc size of up to 7 m (23 ft) across with a weight of about 3,000 kg (6,600 lb). Scuba diver for scale. [📹 deepbluecoast]

Massimo

27,828 views • 1 year ago