One cool thing about ColBERT-based search compared to the... cosine-based vector retrieval is that you get interpretability for free as a byproduct of the MaxSim computation. It's kind of like the Lucene highlighter, letting you grab the most relevant snippets from a long document to show users where their query matches. With Jina-ColBERT-v1, which supports up to 8K token length, released by us earlier this Feb., the visualization of the late interaction between a query and a document is almost... artistic. The video shows the late interaction between the query "Elephants eat 150 kg of food per day." and the Wikipedia article about "Indian Elephant". Darker colors indicate stronger semantic matches. The darkest area corresponds to "The species is classified as a megaherbivore and consume up to 150 kg (330 lb) of plant matter per day." from the original article.show more

GraphRAG-UI GraphRAG-UI is a user-friendly interface for GraphRAG, a... powerful tool that uses the Retrieval-Augmented Generation (RAG) approach to index and query large text data. This project supports the latest version graphrag-0.3.3 and aims to provide a convenient management and interaction method for GraphRAG, supporting the configuration of local large language models like Ollama, making it easier for users to leverage.show more

Vector Database by Hand ✍️ Vector databases are revolutionizing... how we search and analyze complex data. They have become the backbone of Retrieval Augmented Generation (#RAG). How do vector databases work? [1] Given ↳ A dataset of three sentences, each has 3 words (or tokens) ↳ In practice, a dataset may contain millions or billions of sentences. The max number of tokens may be tens of thousands (e.g., 32,768 mistral-7b). Process "how are you" [2] 🟨 Word Embeddings ↳ For each word, look up corresponding word embedding vector from a table of 22 vectors, where 22 is the vocabulary size. ↳ In practice, the vocabulary size can be tens of thousands. The word embedding dimensions are in the thousands (e.g., 1024, 4096) [3] 🟩 Encoding ↳ Feed the sequence of word embeddings to an encoder to obtain a sequence of feature vectors, one per word. ↳ Here, the encoder is a simple one layer perceptron (linear layer + ReLU) ↳ In practice, the encoder is a transformer or one of its many variants. [4] 🟩 Mean Pooling ↳ Merge the sequence of feature vectors into a single vector using "mean pooling" which is to average across the columns. ↳ The result is a single vector. We often call it "text embeddings" or "sentence embeddings." ↳ Other pooling techniques are possible, such as CLS. But mean pooling is the most common. [5] 🟦 Indexing ↳ Reduce the dimensions of the text embedding vector by a projection matrix. The reduction rate is 50% (4->2). ↳ In practice, the values in this projection matrix is much more random. ↳ The purpose is similar to that of hashing, which is to obtain a short representation to allow faster comparison and retrieval. ↳ The resulting dimension-reduced index vector is saved in the vector storage. [6] Process "who are you" ↳ Repeat [2]-[5] [7] Process "who am I" ↳ Repeat [2]-[5] Now we have indexed our dataset in the vector database. [8] 🟥 Query: "am I you" ↳ Repeat [2]-[5] ↳ The result is a 2-d query vector. [9] 🟥 Dot Products ↳ Take dot product between the query vector and database vectors. They are all 2-d. ↳ The purpose is to use dot product to estimate similarity. ↳ By transposing the query vector, this step becomes a matrix multiplication. [10] 🟥 Nearest Neighbor ↳ Find the largest dot product by linear scan. ↳ The sentence with the highest dot product is "who am I" ↳ In practice, because scanning billions of vectors is slow, we use an Approximate Nearest Neighbor (ANN) algorithm like the Hierarchical Navigable Small Worlds (HNSW).show more

Reminder: The Democrats are not an opposition party. Their... function is to sell the illusion of democracy and cover up the truth, which is that the US is a dictatorship of capital where every aspect of society from the government to the economy is controlled by and for the rich.show more

We had a productive day and had a solid... interaction with Volunteers of the Ward the MK is going to decisively win the up-coming By-Elections. #GwazaMkhontoGwazashow more

HOLY SHIT...you can "inference" LLMs in Sora 🤯 the... prompt was: "Open chatgpt and send a message!" How insane is it that the generated audio is not only a relevant response to the query that Sora made up out of nowhere, but the haiku is syllable-accurate?! 🥲show more

“The light of Fajr is the beginning of hope... and the start of a new day.” “The morning prayer is essential to start your day on a positive note.” “Fajr is the best time to seek Allah's mercy and blessings.” The Fajr prayer is like a fortress, guarding us from the evils of the day.show more

Unlocking Zero Point Energy. The Casimir effect is a... spontaneous force which has potential applications as free source of energy. The effect can be manifesting as a repulsive tendency between two conductive plates in a vacuum environment or can be a phenomenon of attraction between the same plates. A number of characteristics determine the attraction or repellence. The current understanding of the Casimir effect is based on the interaction between the fluctuations in energy density of the vacuum and van der Waals forces at play. The vacuum is thought to be the primary driver in the dynamical effect while the van der Waals contributes to the attraction. Because the Casimir torque arise from the #quantum fluctuations of energy or, more precisely from the zero point energy of materials and their dependence on the boundary conditions of the electromagnetic fields, these kinetic forces can be tailored, this raises the intriguing possibility of exploiting it for free energy. 🔗show more

Added context to my tiny diffusion model to enable... sequential generation of longer outputs! Currently the context is a quarter of the sequence length (seq_len=256, context_len=64). I have a theory that the less semantic-value-per-token, the worse the “curse of parallel decoding” is. With parallel decoding, we independently predict multiple tokens in one step. With the sentence “My poker hand was a ___ ___”, two valid predictions are “two pair” and “straight flush”. Because each token prediction is independent though, we can end up with a nonsensical output like “two flush”. This seems to be exacerbated with low semantic-value-per-token, as now you need more tokens to express the same concept. Instead of needing to independently predict two tokens, we might need to predict 10 instead (which is of course much harder). The model currently has noticeably worse output compared to nanogpt (similar size) and I believe this is a main reason. I’ll try adding confidence-aware parallel decoding (from NVIDIA’s Fast-dLLM paper) and other tricks and see how much they improve generation quality.show more

In 2000, Jennifer Lopez attended the Grammy Awards wearing... the now-infamous green Versace "Jungle Dress". The striking, plunging gown immediately became a global sensation, generating an unprecedented demand from users searching for photos of the dress. At the time, Google's search results were primarily text-based, and the company realized they couldn't directly satisfy the massive, visually-driven query. This overwhelming and specific search demand, which became the most popular query Google had ever seen, served as the direct catalyst and motivation for the company to develop and launch Google Images in 2001. . . . #jenniferlopez #grammys #google #tech #usashow more

Due to a bizarre interaction between Pokeys and Turn... Blocks in Super Mario Maker 2, it is possible to create a "Jumpscare Pokey" that rises up extremely quickly and unexpectedly from the bottom of the screen.show more

Here is a 3D visualization of the coming solar... storm using model parameters from NASA's run, NOAA's run (shown below), and the coronagraph views from STEREO-A/COR2 and SOHO/LASCO. The storm is expected to hit Earth early December 9. The 3D visualization clearly shows the low inclination orientation of the solar slinky core inside the larger storm envelope. Of course, the earlier eruption that erupted to the northeast, might deflect this structure a little bit, but likely that will only make the structure move more towards the ecliptic plane, which will give us a larger chance of crossing through the solar slinky core. One nice thing about low inclination flux rope cores is that they almost ALWAYS have southward field in them at some point. So this is good news for aurora photographers-- as long as this solar storm stays true to its launch trajectory and inclination, we could see some organized southward pointed magnetic field. Considering this solar storm is fast-- that usually indicates the storm will not deviate much from its original launch trajectory! Here is the link to a static frame of the 3D frame visualization so you can fly around it yourself:show more

DOM3 is made from HTML, CSS and Javascript, closer... to a document than a canvas. It's a strange contemporary material that shapes much of our digital lives. The rhythm of endless creation and deletion in DOM3 is a self-driving version of what happens when you browse the web. "The Document Object Model (DOM) connects web pages to scripts or programming languages by representing the structure of a document—such as the HTML representing a web page—in memory." A html element, and a rectangle on a canvas, are not the same thing. It's a different material. Even if it all ends up controlling the same pixels, the process is different. The html element kind of actually exists, in this abstract context of a document object model. And in memory, in the moment. If it was possible to measure its weight, it would be heavier than a pixel on a canvas.show more

Playphrase. me is a website where you can look... up a phrase and it'll show you the same phrase found in movies or tv shows. It shows you over 1000s of matches and it's completely free. This is great if you want to find funny clips for videos saying the same phrase.show more

how based are you? it’s nice to see how... more and more new apps are appearing inside the base app every day. it’s a great opportunity for users to get in early and earn rewards it’s also a big boost for the base ecosystem as a whole: active users get rewarded, the ecosystem grows, developers earn, users earn. a real win-win that’s what “base is for everyone” is all about “base me” is a fun app from the creator Fokki. you can spin the wheel and find out just how based you are. i got lucky and ended up being as based as jesse.base.eth you can join and try it yourself using the link belowshow more

Levin responds to an article about Gavin Newsom by... attacking someone quoted in the article as “one of the fake MAGA bigmouths” The quote is from Steve Bannonshow more

Realizing people might not have realized that by "flower... game" I mean this end screen is a DIRECT reference to the book of unveiling in Destiny 2, which itself refers to a modified version of John Horton Conway's Game of Life; the book refers to this as The Flower Game, a zero-player game where the only move is the initial set up of the pieces and their behaviors. I think if this Durandal is the one from the end of Marathon Infinity, then perhaps he's found a way to influence the Flower Game, and is using that influence to re-write the universe to create a reality that allows his escape from reality itself.show more

Welcome to this little moment of morning routine, if... we can call it that 😊 this comforting little moment with the sweet scent of coffee and the softness of the sun's rays ☀️ I chose my earrings for the day based on my mood. The jewelry we wear is also indicative of our personality, which is why it's important for me that it matches my outfit and the mood of the day.show more

The giant oceanic manta ray is the largest type... of ray in the world. It can grow to a disc size of up to 7 m (23 ft) across with a weight of about 3,000 kg (6,600 lb). Scuba diver for scale. [📹 deepbluecoast]show more