Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

One cool thing about ColBERT-based search compared to the cosine-based vector retrieval is that you get interpretability for free as a byproduct of the MaxSim computation. It's kind of like the Lucene highlighter, letting you grab the most relevant snippets from a long document to show users where their...

22,268 görüntüleme • 2 yıl önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Vector Database by Hand ✍️ Vector databases are revolutionizing how we search and analyze complex data. They have become the backbone of Retrieval Augmented Generation (#RAG). How do vector databases work? [1] Given ↳ A dataset of three sentences, each has 3 words (or tokens) ↳ In practice, a dataset may contain millions or billions of sentences. The max number of tokens may be tens of thousands (e.g., 32,768 mistral-7b). Process "how are you" [2] 🟨 Word Embeddings ↳ For each word, look up corresponding word embedding vector from a table of 22 vectors, where 22 is the vocabulary size. ↳ In practice, the vocabulary size can be tens of thousands. The word embedding dimensions are in the thousands (e.g., 1024, 4096) [3] 🟩 Encoding ↳ Feed the sequence of word embeddings to an encoder to obtain a sequence of feature vectors, one per word. ↳ Here, the encoder is a simple one layer perceptron (linear layer + ReLU) ↳ In practice, the encoder is a transformer or one of its many variants. [4] 🟩 Mean Pooling ↳ Merge the sequence of feature vectors into a single vector using "mean pooling" which is to average across the columns. ↳ The result is a single vector. We often call it "text embeddings" or "sentence embeddings." ↳ Other pooling techniques are possible, such as CLS. But mean pooling is the most common. [5] 🟦 Indexing ↳ Reduce the dimensions of the text embedding vector by a projection matrix. The reduction rate is 50% (4->2). ↳ In practice, the values in this projection matrix is much more random. ↳ The purpose is similar to that of hashing, which is to obtain a short representation to allow faster comparison and retrieval. ↳ The resulting dimension-reduced index vector is saved in the vector storage. [6] Process "who are you" ↳ Repeat [2]-[5] [7] Process "who am I" ↳ Repeat [2]-[5] Now we have indexed our dataset in the vector database. [8] 🟥 Query: "am I you" ↳ Repeat [2]-[5] ↳ The result is a 2-d query vector. [9] 🟥 Dot Products ↳ Take dot product between the query vector and database vectors. They are all 2-d. ↳ The purpose is to use dot product to estimate similarity. ↳ By transposing the query vector, this step becomes a matrix multiplication. [10] 🟥 Nearest Neighbor ↳ Find the largest dot product by linear scan. ↳ The sentence with the highest dot product is "who am I" ↳ In practice, because scanning billions of vectors is slow, we use an Approximate Nearest Neighbor (ANN) algorithm like the Hierarchical Navigable Small Worlds (HNSW).

Tom Yeh

192,022 görüntüleme • 2 yıl önce

Apparently, I saw this video online and I decided to share. What this worker is applying is called bitumen, or what many of us know as bituminous coating. Most people think a wall is a solid, impenetrable block, but in reality, it is more like a sponge. Concrete and blocks have microscopic pores that pull water from the earth through a process we call capillary action. This thick black substance is the shield that stops that water from climbing up into the house. It is not about making the wall look good because this part will be buried under the dirt forever. It is about creating a skin that water cannot breathe through. When do you need to do this? The need for this arises because the soil is a very aggressive environment. Water is not your only enemy.. The ground also contains salts and sulfates that want to eat away at the cement. If this moisture finds its way to the steel bars inside the columns, those bars will start to rust. And when steel rusts, it expands, and that expansion is what cracks the concrete from the inside out. This coating is the only thing standing between your foundation and that kind of slow destruction. Thats is why if you see wet patches at the bottom of your walls inside your house, it usually means someone skipped this step or did it poorly during construction. You can apply this anytime you are building parts of a structure that will stay in contact with the ground. It is common in areas where the water table is high or where the soil stays damp for most of the year. This is a one-shot opportunity. Once you backfill the soil, you can never go back to fix it without a lot of expense and a lot of digging. It is about having the foresight to protect the heart of the building while it is still exposed. Please don’t ignore this if you need to. If you ignore it now to save a bit of money, you will be funding the future decay of your own home. I hope this helps.

A.Y.O

75,399 görüntüleme • 4 ay önce

The importance of pointing the AirFanta Wear personal air purifier accurately. You need to point the center of the Wear's airflow at your breathing zone. Otherwise you won't get any benefit from the device. This is just a visualization using the mist from an ultrasonic nebulizer to stand in for unfiltered ambient air. In the demonstration the air is not completely still due to the output of the nebulizer. But the air flow may be similar to cross currents that might be found in indoor settings. AirFanta has shown a number of different ways to position the Wear, but hasn't given exact numbers for distance as far as I know. I'm using a distance of 2 inches or less as a rule of thumb, with the center of the device pointed at my breathing zone. The 3/4 position feels like it's one that people may be the most interested in because it can let you eat while at the same time maintaining a close proximity to the output. The Wear is not meant as a one-to-one replacement for a respirator grade mask. It's best for situations where you were not going to be wearing a mask at all, but would still like to breathe cleaner air. Avoid risk compensation, which is where you take on more risk because you think you are more protected than you actually are. For instance, visiting a nephew sick with measles without an N95 mask because you think the Wear will give you equal protection. Maintaining the correct distance and orientation between the Wear and your breathing zone requires conscious effort. The Wear can reduce your overall exposure to airborne contaminants, but it needs to be used very close to breathing zone and needs to be very accurately centered.

Gerard Hughes ( @ghhughes.bsky.social )

57,309 görüntüleme • 8 ay önce