Загрузка видео...

Не удалось загрузить видео

На главную

Knowledge graphs are really cool 🧠 What’s even cooler is LLMs + knowledge graphs backed by a graph db (NebulaGraph) 🔥 This presents an entirely new stack for retrieval-augmented generation (separate from vector db + top-k)! Now possible with LlamaIndex 🦙 👇

113,738 просмотров • 3 лет назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

V8 DKG Launches Now: A New Dawn for AI in 2025🌟 As 2024 draws to a close, we're excited to announce the immediate launch of V8 Decentralized Knowledge Graph (DKG)! This monumental release is set to redefine AI's capabilities as we step into 2025. What Does V8 Bring to the Table? 🧠Decentralized AI: AI agents can now leverage a 'collective memory' at internet scale, drawing from a shared, yet sovereign, knowledge base. This means AI can provide more contextual, coherent, and accurate interactions without compromising data integrity or privacy. 🚀Unmatched Scalability: With the capability to handle billions of Knowledge Assets, V8 DKG sets the stage for AI to grow and learn in ways we've only imagined, supporting everything from decentralized science to industry 4.0. 🔐Trust and Integrity: With integrated decentralized Retrieval Augmented Generation (dRAG), V8 DKG promotes AI that's more accurate, less biased, and inherently trustworthy. How to V8👇 To update your node from V6 to V8, delegate your TRAC utility tokens, and learn more about creating, connecting and owning your Knowledge Assets, make sure to thoroughly read the following documentation: 👉 With V8 DKG launch, you may now access the new: V8 Explorer👉 AND Staking Dashboard 👉 You may now also participate in V8 Staking Security Bounty by delegating new TRAC stake and report your findings. Read more: 👉 The V8 Staking Security Bounty will importantly contribute to the so-called tuning phase of V8 DKG launch (V8.0 to V8.1). Let's break records, as we usher in a new era of Internet Scale OriginTrail!

OriginTrail

561,243 просмотров • 1 год назад

Vector Database by Hand ✍️ Vector databases are revolutionizing how we search and analyze complex data. They have become the backbone of Retrieval Augmented Generation (#RAG). How do vector databases work? [1] Given ↳ A dataset of three sentences, each has 3 words (or tokens) ↳ In practice, a dataset may contain millions or billions of sentences. The max number of tokens may be tens of thousands (e.g., 32,768 mistral-7b). Process "how are you" [2] 🟨 Word Embeddings ↳ For each word, look up corresponding word embedding vector from a table of 22 vectors, where 22 is the vocabulary size. ↳ In practice, the vocabulary size can be tens of thousands. The word embedding dimensions are in the thousands (e.g., 1024, 4096) [3] 🟩 Encoding ↳ Feed the sequence of word embeddings to an encoder to obtain a sequence of feature vectors, one per word. ↳ Here, the encoder is a simple one layer perceptron (linear layer + ReLU) ↳ In practice, the encoder is a transformer or one of its many variants. [4] 🟩 Mean Pooling ↳ Merge the sequence of feature vectors into a single vector using "mean pooling" which is to average across the columns. ↳ The result is a single vector. We often call it "text embeddings" or "sentence embeddings." ↳ Other pooling techniques are possible, such as CLS. But mean pooling is the most common. [5] 🟦 Indexing ↳ Reduce the dimensions of the text embedding vector by a projection matrix. The reduction rate is 50% (4->2). ↳ In practice, the values in this projection matrix is much more random. ↳ The purpose is similar to that of hashing, which is to obtain a short representation to allow faster comparison and retrieval. ↳ The resulting dimension-reduced index vector is saved in the vector storage. [6] Process "who are you" ↳ Repeat [2]-[5] [7] Process "who am I" ↳ Repeat [2]-[5] Now we have indexed our dataset in the vector database. [8] 🟥 Query: "am I you" ↳ Repeat [2]-[5] ↳ The result is a 2-d query vector. [9] 🟥 Dot Products ↳ Take dot product between the query vector and database vectors. They are all 2-d. ↳ The purpose is to use dot product to estimate similarity. ↳ By transposing the query vector, this step becomes a matrix multiplication. [10] 🟥 Nearest Neighbor ↳ Find the largest dot product by linear scan. ↳ The sentence with the highest dot product is "who am I" ↳ In practice, because scanning billions of vectors is slow, we use an Approximate Nearest Neighbor (ANN) algorithm like the Hierarchical Navigable Small Worlds (HNSW).

Tom Yeh

192,022 просмотров • 2 лет назад

Young children are like scientists - constantly testing their theories about the world. Swiss psychologist Jean Piaget is revered in education circles as the father of “constructivism” - which is a theory that young children create knowledge by connecting new experiences with past learning, through a process not unlike the scientific method. And here’s an amazing example. Faced with something unfamiliar (an anti-theft security tag affixed to a shoe), this little guy draws upon his existing knowledge (or “schema” in Piagetian terms) to make sense of what he’s seeing. In a sign of the times that would have fascinated Piaget (who died in 1980), our hero assumes that the shoe comes with its own charger, which - according to its label (a size 10 sticker) will permit the owner to walk for 10 minutes after charging. (Or perhaps this is the time required to achieve a full charge?) It’s really a pretty amazing hypothesis that draws on multiple different data points. Not shown in the video is what happens next. Had his theory been affirmed as correct (which in this case it isn’t), the example of a battery powered shoe with a USB port would have been “assimilated,” strengthening his existing knowledge of electronic devices. Presuming mom provides some explanation about store security tags, however, our little scientist will be disproven - forcing him to “accommodate” within his existing schema to take the existence of a new object into account. Either way, knowledge is being constructed. What an impressive little guy! 🧠 Have you noticed your children test their theories about the world? If so how? 🎥 hannahs_journeys IG

Dan Wuori

271,161 просмотров • 3 лет назад

Young children are like scientists - constantly testing their theories about the world. Swiss psychologist Jean Piaget is revered in education circles as the father of “constructivism” - which is a theory that young children create knowledge by connecting new experiences with past learning, through a process not unlike the scientific method. And here’s an amazing example. Faced with something unfamiliar (an anti-theft security tag affixed to a shoe), this little guy draws upon his existing knowledge (or “schema” in Piagetian terms) to make sense of what he’s seeing. In a sign of the times that would have fascinated Piaget (who died in 1980), our hero assumes that the shoe comes with its own charger, which - according to its label (a size 10 sticker) will permit the owner to walk for 10 minutes after charging. (Or perhaps this is the time required to achieve a full charge?) It’s really a pretty amazing hypothesis that draws on multiple different data points. Not shown in the video is what happens next. Had his theory been affirmed as correct (which in this case it isn’t), the example of a battery powered shoe with a USB port would have been “assimilated,” strengthening his existing knowledge of electronic devices. Presuming mom provides some explanation about store security tags, however, our little scientist will be disproven - forcing him to “accommodate” within his existing schema to take the existence of a new object into account. Either way, knowledge is being constructed. What an impressive little guy! 🧠 Have you noticed your children test their theories about the world? If so how? 🎥 hannahs_journeys IG

Dan Wuori

133,150 просмотров • 2 лет назад

[Graph Convolutional Network] by hand ✍️ Graph Convolutional Networks (GCNs), introduced by Thomas Kipf and Max Welling in 2017, have emerged as a powerful tool in the analysis and interpretation of data structured as graphs. This exercise demonstrates how GCN works in a simple application: binary classification. -- Goal -- Predict if a node in a graph is X. -- Architecture -- 🟪 Graph Convolutional Network (GCN) 1. GCN1(4,3) 2. GCN2(3,3) 🟦 Fully Connected Network (FCN) 1. Linear1(3,5) 2. ReLU 3. Linear2(5,1) 4. Sigmoid Simplications: • Adjacent matrices are not normalized. • ReLU is applied to messages directly. -- Walkthrough -- [1] Given ↳ A graph with five nodes A, B, C, D, E [2] 🟩 Adjacency Matrix: Neighbors ↳ Add 1 for each edge to neighbors ↳ Repeat in both directions (e.g., A->C, C->A) ↳ Repeat for both GCN layers [3] 🟩 Adjacency Matrix: Self ↳ Add 1's for each self loop ↳ Equivalent to adding the identity matrix ↳ Repeat for both GCN layers [4] 🟪 GCN1: Messages ↳ Multiply the node embeddings 🟨 with weights and biases ↳ Apply ReLU (negatives → 0) ↳ The result is one message per node [5] 🟪 GCN1: Pooling ↳ Multiply the messages with the adjacent matrix ↳ The purpose is the pool messages from each node's neighbors as well as from the node itself. ↳ The result is a new feature per node [6] 🟪 GCN1: Visualize ↳ For node 1, visualize how messages are pooled to obtain a new feature for better understanding ↳ [3,0,1] + [1,0,0] = [4,0,1] [7] 🟪 GCN2: Messages ↳ Multiply the node features with weights and biases ↳ Apply ReLU (negatives → 0) ↳ The result is one message per node [8] 🟪 GCN2: Pooling ↳ Multiply the messages with the adjacent matrix ↳ The result is a new feature per node [9] 🟪 GCN2: Visualize ↳ For node 3, visualize how messages are pooled to obtain a new feature for better understanding ↳ [1,2,4] + [1,3,5] + [0,0,1] = [2,5,10] [10] 🟦 FCN: Linear 1 + ReLU ↳ Multiply node features with weights and biases ↳ Apply ReLU (negatives → 0) ↳ The result is a new feature per node ↳ Unlike in GCN layers, no messages from other nodes are included. [11] 🟦 FCN: Linear 2 ↳ Multiply node features with weights and biases [12] 🟦 FCN: Sigmoid ↳ Apply the Sigmoid activation function ↳ The purpose is to obtain a probability value for each node ↳ One way to calculate Sigmoid by hand ✍️ is to use the approximation below: • >= 3 → 1 • 0 → 0.5 • <= -3 → 0 -- Outputs -- A: 0 (Very unlikely) B: 1 (Very likely) C: 1 (Very likely) D: 1 (Very likely) E: 0.5 (Neutral)

Tom Yeh

46,779 просмотров • 1 год назад

LLM Artifacts Connected to Andrej Karpathy's LLM Knowledge base idea, I've been building out a fun way to generate dynamic artifacts from these knowledge bases with the goal of discovering and revealing meaningful and deeper insights. LLM KBs are hard to consume for humans, as I think they are more built for agents. So the question is, what form would be useful for humans to take actions and make important decisions? That's what I am trying to figure out with these artifacts. The artifact example shows a pulse on HN discussions around AI-related stories. The insights can go deeper, of course, but this is already super fun and thought-provoking, like some of my favorite podcasts. The format and depth matter a lot. The aggregation skills of agents are outstanding if you tune the prompts and skill carefully. I built this artifact generator in a few minutes through an agent skill, but I feel like there are so many ways that LLM-generated information can be used and consumed. Like generating deeper insights and analysis, and things that are just not feasible for humans today. The generated artifact (including its data and design) serves as reusable templates or can be updated in real-time via auomations, which is something I am also working on. It is truly an insane way to monitor and track information. Better than a newsletter. Better than newspapers. There is something about this that gets me really excited about the future of AI agents for knowledge generation and discovery. Lots of hidden gems everywhere just waiting to be discovered and acted on if the information is presented correctly. This is not perfect. The format, style/prose can be improved, but this is easy to customize via skill. You can personalize it to your liking. I feel like these dynamic artifacts are going to emerge as a strong new medium to stay on the cutting edge of things, both for agents and humans. My target is research, of course. This was just a basic example. Besides animation, I am also targeting other components like voice, videos, images, slides, etc. This space is full of opportunities to explore. Skill for this coming soon.

elvis

31,242 просмотров • 3 месяцев назад

introducing a new, very fun, LLM benchmark- the Game-of-Life Bench! the rules are simple: given an 8x8 grid following Conway's game of life rules, the goal is to create an initial pattern with at most 32 cells that can last the longest number of turns before dying/repeating. some results to highlight (with caveats detailed below): - gpt 5.1 lasts the longest with a 106 step run - claude models are really bad at this! they refuse to reason about this task and score < 25 points - deepseek r1 is the best open model with 102 steps. why? because i wanted to create a benchmark that has (i think) no practicality, but is still fun to look at, cheap, and still measures something interesting. i also am a big fan of the game of life. its absurdly simple rules leading to intractability is extremely cool to me. also, i saw a lot of work with LLMs trying to "predict" the next state in Conway's game of life, I think game-of-life bench is more fun because it's pretty open ended and only asks the LLM for the initial state. I also think this could be an RL env? but idk why you would ever train on this task haha i don't think this is a "serious" benchmark because it doesnt measure anything practical, but i still think it's a hard benchmark exactly because you can't predict what happens with your initial state many turns into the future; this is why i was initially expecting all LLMs to be bad at it, but turns out, some are clearly better than the others (the ordering may surprise you!) reminder: this is still a work-in-progress; (1) i am gpu-poor so could only do 10 runs for each model, even though total running cost is relatively low. maybe with some more credits i can run more seeds for each model. (2) i handpicked models which i think are at the frontier right now, plus some others that were on my mind. so, if you'd like to see a model on here, let me know. (3) i currently only do an 8x8 grid because i thought that by itself would be pretty hard for current LLMs, but of course we can increase grid sizes! (4) the coolest thing is, i dont think we can calculate the max possible number of states (yay undecidability!) you can go without repeating, so this is essentially a no-ceiling task, which is pretty cool! again, i did this mostly out of a desire to make LLMs do something fun. if this keeps me entertained for a few more days, i'd likely release a blog post on it. if it keeps me entertained for a week (and someone sponsors me), i'll put more work into it :P lastly, this is fully open sourced, so feel free to run this on your own!

Akshit

13,722 просмотров • 5 месяцев назад

Most chiral molecules arise from carbons being bonded to 4 different atoms, which are called sterocenters. The makes the molecule have a different mirror image that cannot arise from simple rotation. But, you can have chiral molecules not from stereocenters. You can have chirality that doesn't come from a single point in the molecule. It comes from some global property. The classic example is helicene, which doesn't have any stereocenters, but has chirality because of hits helical structure. This means you cannot capture this molecule with a graph, and thus SMILES or a string representation cannot capture this. Of course natural language comes to the rescue (just say in words if it's left-handed or right-handed helix), but it's an interesting failure mode for viewing molecules as just a graph. Another example of a molecule with helical chirality is DNA. DNA is actually chiral in two ways, which is kind of confusing. It has both helical structure and stereocenters. You won't find the stereocenters ever flipped, but left-handed helical DNA can exist (called Z-DNA). Interestingly, making the flipped stereocenter of DNA could be part of an entire mirror organism (mirror RNA, DNA, AAs, sugars) that would then be potentially invisible to our immune systems. This has been recently proposed as a "mechanism" for how a runaway AI system could cause harm to Earth. I find it to be a pretty tedious and difficult way to cause harm, but it is intellectually cool. Anyway - this came up in a PhD defense and I have a lot of arcane knowledge about this I wanted to dump.

Andrew White 🐦‍⬛

15,039 просмотров • 3 месяцев назад

⚡️ We are excited to introduce Rush Games - a new platform that combines onchain gaming, mobile, social media and AI in innovative ways. 🎮 One of the key features we are most excited about is Rush Genie 🧞‍♂️, an AI agent trained on game development and the Beyond Network SDK, which will allow users to create their own mini-games without any coding knowledge. We believe this will open up new possibilities for creative game design. 🧩 With Rush, not only can you play a variety of engaging games, but you'll also have the opportunity to be rewarded for your creativity. But that's not all - we are integrating social features to take gameplay to the next level: 🆚 Connect with friends and challenge them head-to-head 🌐 Leverage decentralized social graphs for personalized, interconnected gaming experiences 💰 NFT holders will enjoy special perks like earning multipliers The $Bull token will be deeply integrated into the Rush Games ecosystem: 🪙 Spend $Bull to access Rush Genie and supercharge your game creation 🛍️ Use $Bull for in-game assets, lucky spins, draws, and raffles directly from Telegram and Farcaster on Base 🔒 Stake $Bull tokens to earn multipliers on your rewards 🔥 100% of revenues generated will be used to buy back and burn $Bull, driving sustainable value We are preparing to launch a selection of new titles that showcase the potential of on-chain gaming. Rush games beta along with our first game NetGains goes live on 25.01.25 ⚡️ Stay tuned for more details. The future of on-chain gaming is bright with #RushGames by #Bullieverse $Bull

Bullieverse (25.10.25)

18,633 просмотров • 1 год назад