正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

I recorded this introduction to embeddings (perhaps the most essential concept behind how LLMs.) But this is different from everything else you've seen: We will generate embeddings from scratch using a Siamese Network and a contrastive loss. This video is for 5 year olds.

Santiago

451,613 subscribers

68,976 次观看 • 2 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

11 条评论

Santiago 的头像

Santiago2 年前

Some people say that YouTube's video interface is better. If that's you, here is the link of this video over there:

Santiago 的头像

Santiago2 年前

This is a great exercise. You can read all you want, watch videos all you want, and listen to others all you want. But nothing, *nothing* will teach you more than building things yourself. Especially when you start from first principles, and add complexity step by step.

Hesam 的头像

Hesam2 年前

I love when ML concepts are explained intuitively Bookmarked 👌🏻

Roshini Fernando 的头像

Roshini Fernando2 年前

About embeddings. Awesome 😊🔥

nocodedev ⚡ 的头像

nocodedev ⚡2 年前

How to transcribe an YouTube video and ask questions about it using local llm?

Geoff Kim 的头像

Geoff Kim2 年前

This is immensely helpful. Thank you for your service. 🫡

teamtom 的头像

teamtom2 年前

thank you for the video! i tried to run your notebook in Google Colab to dig deeper but unfortunaly something was not OK. first i did not touch your code just run cell by cell but it failed with some Keras code /1

Santiago 的头像

Santiago2 年前

Not sure what's happening. I just rerun it on my computer (Keras 3.3.3). Here is the training process:

teck 🖖🏿 的头像

teck 🖖🏿2 年前

Hi, 👋 What course do you recommend for junior ?

Justin Borgers 的头像

Justin Borgers2 年前

I just have to say "Thank You" for this tutorial. You really have a talent for explaining complex concepts in a way that is easy to understand!

Santiago 的头像

Santiago2 年前

🙏🏻

相关视频

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!

Santiago

110,133 次观看 • 1 年前

Maglev robots from a Chinese manufacturer. Perhaps this is how the future air highways will be... When flying cars take over. This concept will be implemented and everything will be automated.🤔

Maglev robots from a Chinese manufacturer. Perhaps this is how the future air highways will be... When flying cars take over. This concept will be implemented and everything will be automated.🤔

ShanghaiPanda （ Account deactivation）

65,189 次观看 • 1 年前

How to build an AI agent from scratch. This is the question I get the most, so I recorded this video to show you from the very beginning how you can get started. You can do this in Python, TypeScript, JavaScript, or Ruby.

How to build an AI agent from scratch. This is the question I get the most, so I recorded this video to show you from the very beginning how you can get started. You can do this in Python, TypeScript, JavaScript, or Ruby.

Santiago

71,768 次观看 • 1 年前

Anthropic pays $750,000+ a year for engineers who can build LLMs from scratch. Not how to prompt them. Not how to fine-tune them. Not how to build RAG pipelines. But how to build them from scratch. This 2-hour Stanford lecture teaches you everything. Scaling laws. Data collection. Architecture design. Post-training alignment. Free. From Stanford. Watch first. Then read this. The lecture is the theory. And this article shows you how to actually build it (with code) ↓

Anthropic pays $750,000+ a year for engineers who can build LLMs from scratch. Not how to prompt them. Not how to fine-tune them. Not how to build RAG pipelines. But how to build them from scratch. This 2-hour Stanford lecture teaches you everything. Scaling laws. Data collection. Architecture design. Post-training alignment. Free. From Stanford. Watch first. Then read this. The lecture is the theory. And this article shows you how to actually build it (with code) ↓

Rahul

422,494 次观看 • 2 个月前

Testing Flux.1 schnell embedding interpolation. I told claude some details about my life and had it generate 40 prompts from being born -> being dead using the data I gave it. Then interpolated between the embeddings for this video. Uses Araminta softpasty LoRA

Testing Flux.1 schnell embedding interpolation. I told claude some details about my life and had it generate 40 prompts from being born -> being dead using the data I gave it. Then interpolated between the embeddings for this video. Uses Araminta softpasty LoRA

Ostris

45,767 次观看 • 2 年前

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Roan

80,735 次观看 • 28 天前

I feel a mess. My hard work. The tools tailored to me, bought along the way. I’ve done EVERYTHING from scratch. Who does this to people? Who steals their livelihoods? I’m devastated. From the loss and the damage. This is how I make my living. #GardeningTwitter

I feel a mess. My hard work. The tools tailored to me, bought along the way. I’ve done EVERYTHING from scratch. Who does this to people? Who steals their livelihoods? I’m devastated. From the loss and the damage. This is how I make my living. #GardeningTwitter

Dirty Garden Hoe 🌱

1,187,130 次观看 • 3 年前

Perhaps this is old news and everyone else knows it, but just in case, this is a handy tip for anyone using a spline path to create geo.

Perhaps this is old news and everyone else knows it, but just in case, this is a handy tip for anyone using a spline path to create geo.

Josh Powers

14,908 次观看 • 11 个月前

THIS MOD IS CODED USING SCRATCH!!!! Solomons Seared Symphony is a mod I have huge appreciation for with it's dedication of using Scratch, and with this new update, the cool art style and amazing OST NEEDS to be seen by you all!

THIS MOD IS CODED USING SCRATCH!!!! Solomons Seared Symphony is a mod I have huge appreciation for with it's dedication of using Scratch, and with this new update, the cool art style and amazing OST NEEDS to be seen by you all!

T I M E L I M E (Synecdoche Funkin ???%)

13,194 次观看 • 1 年前

THIS GUY ONLY HAS 280 SUBS??? He designed the rifle FROM THE GROUND UP. this video will BLOW his channel up. This guy is a GENIUS. This is probably the most impressive thing I have ever seen from any video game fan.

THIS GUY ONLY HAS 280 SUBS??? He designed the rifle FROM THE GROUND UP. this video will BLOW his channel up. This guy is a GENIUS. This is probably the most impressive thing I have ever seen from any video game fan.

ringoid

1,018,608 次观看 • 2 年前

Look how easy it is to build apps on $ICP 🤯 Genuinely one of the most impressive things I have came across in crypto. This short video from caffeine shows how EASY it is to make and edit apps from scratch for pretty much anything using chat 😂 The future is here DFINITY Foundation

Look how easy it is to build apps on $ICP 🤯 Genuinely one of the most impressive things I have came across in crypto. This short video from caffeine shows how EASY it is to make and edit apps from scratch for pretty much anything using chat 😂 The future is here DFINITY Foundation

ALLINCRYPTO

12,805 次观看 • 4 个月前

Build a RAG Application from Scratch 🐕 This video covers the architecture behind Verba 0.3.0! The design behind Verba is to have an explicit manager for each core component of RAG pipelines (Read, Chunk, Embed, Retrieve, Generate) 1. ReaderManager: Load in your data (GitHubReader, PDFReader, SimpleReader, etc.) 2. ChunkManager: Chunk up your data into smaller bits (avoids hitting the token limit and results in better retrieval) 3. EmbeddingManager: Convert your data into embeddings (use OpenAI, Cohere, SentenceTransformer, etc.) 4. RetrieverManager: Retrieve the relevant context from your query 5. GenerationManager: Generate an answer from the retrieved chunks Test out Verba on the Weaviate AI Database docs/blogs here: Verba repo:

Build a RAG Application from Scratch 🐕 This video covers the architecture behind Verba 0.3.0! The design behind Verba is to have an explicit manager for each core component of RAG pipelines (Read, Chunk, Embed, Retrieve, Generate) 1. ReaderManager: Load in your data (GitHubReader, PDFReader, SimpleReader, etc.) 2. ChunkManager: Chunk up your data into smaller bits (avoids hitting the token limit and results in better retrieval) 3. EmbeddingManager: Convert your data into embeddings (use OpenAI, Cohere, SentenceTransformer, etc.) 4. RetrieverManager: Retrieve the relevant context from your query 5. GenerationManager: Generate an answer from the retrieved chunks Test out Verba on the Weaviate AI Database docs/blogs here: Verba repo:

Erika Shorten

155,273 次观看 • 2 年前

Question: - Would you be okay watching an ESPN Top 10 like this? This is how we were shown the video from behind Charlie. Stand and demand TPUSA to release the original video from behind Charlie! Candace is no different than any of us! Rise up and demand accountability!

Question: - Would you be okay watching an ESPN Top 10 like this? This is how we were shown the video from behind Charlie. Stand and demand TPUSA to release the original video from behind Charlie! Candace is no different than any of us! Rise up and demand accountability!

Blake

11,688 次观看 • 5 个月前

Here is a killer way to use embeddings: I built a notebook to show you how to do anomaly detection on images. Anomaly detection is one of the most common problems in the real world. Learn how to implement anomaly detection, and you'll be able to solve a ton of use cases that happen every day: • Predicting equipment failures • Identifying defective products • Identifying tumors in medical images • Spotting counterfeit products • Detecting fraud • Flagging fake reviews • Detecting bot traffic My notebook focuses on images. It uses: • Langchain • OpenClip embeddings • Oracle vector store This is the way my example works: • You start with a collection of similar images • You can then check whether a new image "belongs" to that collection I generate embeddings and use Oracle 26ai to store them and retrieve similar images on demand.

Here is a killer way to use embeddings: I built a notebook to show you how to do anomaly detection on images. Anomaly detection is one of the most common problems in the real world. Learn how to implement anomaly detection, and you'll be able to solve a ton of use cases that happen every day: • Predicting equipment failures • Identifying defective products • Identifying tumors in medical images • Spotting counterfeit products • Detecting fraud • Flagging fake reviews • Detecting bot traffic My notebook focuses on images. It uses: • Langchain • OpenClip embeddings • Oracle vector store This is the way my example works: • You start with a collection of similar images • You can then check whether a new image "belongs" to that collection I generate embeddings and use Oracle 26ai to store them and retrieve similar images on demand.

Santiago

24,527 次观看 • 5 个月前

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 次观看 • 1 年前

How do you go from this to that to this? This is the most powerful & touching prodigal son video I’ve ever seen

How do you go from this to that to this? This is the most powerful & touching prodigal son video I’ve ever seen

DON “Tobechukwu” Ade 👑

116,587 次观看 • 1 个月前

Today I’m proud to launch Context, a CLI and open-source corpus for the python ecosystem - 4M quality embeddings of the top 1218 Python Libraries. $ pip install fleet-context or download to get the entire python universe. Here’s why this is game-changing for both Devs and LLMs

Today I’m proud to launch Context, a CLI and open-source corpus for the python ecosystem - 4M quality embeddings of the top 1218 Python Libraries. $ pip install fleet-context or download to get the entire python universe. Here’s why this is game-changing for both Devs and LLMs

Nicolai Ouporov

310,860 次观看 • 2 年前

The network marketing concept is not bad, but in India, many companies misuse this concept and commit fraud and this concept is going on very well outside India and people are doing a lot of business and making money from it!

The network marketing concept is not bad, but in India, many companies misuse this concept and commit fraud and this concept is going on very well outside India and people are doing a lot of business and making money from it!

Shivam_007

69,840 次观看 • 4 个月前