Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🪄👩🏾‍💻🏗️ Simplify the process of pretraining and fine-tuning transformer models from scratch. This step-by-step guide breaks down how KerasNLP helps to make building state-of-the-art text processing models easier. ➡️

TensorFlow's profile picture

TensorFlow

376,571 subscribers

16,999 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

1 Kommentare

Profilbild von Kongfutze
Kongfutzevor 2 Jahren

this is actually super helpful

Ähnliche Videos

📺 New Tutorial: Submitting #AI Models to Learn how to easily upload your models to #Inferium and make them accessible to a wider audience. Our new video guide provides a step-by-step walkthrough of the submission process, covering everything from crafting informative descriptions to uploading your files. Watch now and contribute to the growing AI community! 👇
2:11

📺 New Tutorial: Submitting #AI Models to Learn how to easily upload your models to #Inferium and make them accessible to a wider audience. Our new video guide provides a step-by-step walkthrough of the submission process, covering everything from crafting informative descriptions to uploading your files. Watch now and contribute to the growing AI community! 👇

Inferium

22,124 Aufrufe • vor 1 Jahr

Did Fenix Flexin really use AI to make “Rubberz”? 🤯 This video breaks down the evidence step by step and shows how they figured out the process behind one of the internet’s biggest viral tracks. BUSTED MY BOY! 🚫🚨
2:56

Did Fenix Flexin really use AI to make “Rubberz”? 🤯 This video breaks down the evidence step by step and shows how they figured out the process behind one of the internet’s biggest viral tracks. BUSTED MY BOY! 🚫🚨

ExtendoClipzzz

911,903 Aufrufe • vor 23 Tagen

Fine tuning your game just got even easier. The @bushnellgolf Launch Pro is back with improved technology to help you dial in your data this off season. @rdsbarath breaks down the new models and how it can help your game.
1:03

Fine tuning your game just got even easier. The @bushnellgolf Launch Pro is back with improved technology to help you dial in your data this off season. @rdsbarath breaks down the new models and how it can help your game.

Skratch

157,045 Aufrufe • vor 9 Monaten

Need help getting started with the #XRP Alliance - Flare campaign? 👀 This detailed video shows how to participate step by step 🔥 XRP Bags💰👨🏽‍🚀 BagMan breaks down the full process. Helpful guide for first-time participants 🙌
12:34

Need help getting started with the #XRP Alliance - Flare campaign? 👀 This detailed video shows how to participate step by step 🔥 XRP Bags💰👨🏽‍🚀 BagMan breaks down the full process. Helpful guide for first-time participants 🙌

D'CENT Wallet

15,634 Aufrufe • vor 3 Monaten

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.
2:52

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 Aufrufe • vor 2 Jahren

BNB Greenfield is a state-of-the-art decentralized storage solution by BNB Chain. Learn how to use it with this step-by-step tutorial
2:43

BNB Greenfield is a state-of-the-art decentralized storage solution by BNB Chain. Learn how to use it with this step-by-step tutorial

Yerasyl Amanbek

631,643 Aufrufe • vor 1 Jahr

Embeddings (and how to create them) are, perhaps, the most interesting idea behind Large Language Models. I built a simple model to help you understand embeddings from scratch. Here is a step-by-step video explanation:
51:43

Embeddings (and how to create them) are, perhaps, the most interesting idea behind Large Language Models. I built a simple model to help you understand embeddings from scratch. Here is a step-by-step video explanation:

Santiago

44,107 Aufrufe • vor 1 Jahr

Anthropic engineer: "You can build 5 assistants in one afternoon. Each one handles a task you've been doing manually every single day." In 45 minutes he shows exactly how to build them from scratch, step by step. Most people are still doing all of this by hand. Watch the session, then read the step by step guide below on building all of them in a single chat, prompts included.
44:27

Anthropic engineer: "You can build 5 assistants in one afternoon. Each one handles a task you've been doing manually every single day." In 45 minutes he shows exactly how to build them from scratch, step by step. Most people are still doing all of this by hand. Watch the session, then read the step by step guide below on building all of them in a single chat, prompts included.

Anatoli Kopadze

218,529 Aufrufe • vor 21 Tagen

Portfolio 🎉 Check out the Repo through this link: - I'm telling my journey of building my Portfolio step by step. If you want to know how to make a website step by step, then check out the Repo. How is it?
0:23

Portfolio 🎉 Check out the Repo through this link: - I'm telling my journey of building my Portfolio step by step. If you want to know how to make a website step by step, then check out the Repo. How is it?

Ali Reza

37,295 Aufrufe • vor 3 Jahren

How to perform ablution 🚰 This is a step by step guide and take note of the mistakes . 🎙️: Sheikh Abdullah Gadon Kaya 1/3
2:20

How to perform ablution 🚰 This is a step by step guide and take note of the mistakes . 🎙️: Sheikh Abdullah Gadon Kaya 1/3

فَـ

42,176 Aufrufe • vor 2 Jahren

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:
3:36

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:

Andrew Ng

259,920 Aufrufe • vor 1 Jahr

🧠 Janelia researchers have mapped out the step-by-step process of cognitive map formation in the brain’s hippocampus during learning and identified the type of mathematical model that best reproduces this learning process ➡️
1:05

🧠 Janelia researchers have mapped out the step-by-step process of cognitive map formation in the brain’s hippocampus during learning and identified the type of mathematical model that best reproduces this learning process ➡️

HHMI | Janelia

23,530 Aufrufe • vor 1 Jahr

One of the Grok Bot builders: "For the first time I allocated 90% of my work to agents and they did it end to end." In a 30-minute podcast he showed exactly how he uses Grok Bot and how to build an AI agent team from scratch. This beats any paid course on building agents I've seen. Watch it, then read the step-by-step guide on building your AI team for free, with ready-to-copy prompts.
31:10

One of the Grok Bot builders: "For the first time I allocated 90% of my work to agents and they did it end to end." In a 30-minute podcast he showed exactly how he uses Grok Bot and how to build an AI agent team from scratch. This beats any paid course on building agents I've seen. Watch it, then read the step-by-step guide on building your AI team for free, with ready-to-copy prompts.

Anatoli Kopadze

15,823 Aufrufe • vor 2 Tagen

New short course on Pretraining LLMs! Developed with Upstage and taught by their CEO Sung Kim and CSO Lucy Park. While prompting or fine-tuning existing models works well for many general language tasks, pretraining is valuable for specialized domains or languages with limited representation in current models. This course walks you through the LLM pretraining pipeline: 1. Data preparation: Learn to source, clean, and prepare training data using HuggingFace. 2. Model architecture: Configure transformer networks, including modifying existing models. 3. Training: Set up and run training using open-source libraries. 4. Evaluation: Benchmark performance using popular evaluation strategies. As an example use case, you'll also compare the output of a base model with its fine-tuned and further pretrained variants, to see the impact of pretraining on a model's ability to write Python. The course also explores an innovative technique called depth up-scaling, which Upstage used to train their Solar model family, reducing pretraining compute costs by up to 70%. This technique works by first duplicating layers of a smaller pretrained model to form a larger model, and then further pretraining the result. Sign up here!
3:54

New short course on Pretraining LLMs! Developed with Upstage and taught by their CEO Sung Kim and CSO Lucy Park. While prompting or fine-tuning existing models works well for many general language tasks, pretraining is valuable for specialized domains or languages with limited representation in current models. This course walks you through the LLM pretraining pipeline: 1. Data preparation: Learn to source, clean, and prepare training data using HuggingFace. 2. Model architecture: Configure transformer networks, including modifying existing models. 3. Training: Set up and run training using open-source libraries. 4. Evaluation: Benchmark performance using popular evaluation strategies. As an example use case, you'll also compare the output of a base model with its fine-tuned and further pretrained variants, to see the impact of pretraining on a model's ability to write Python. The course also explores an innovative technique called depth up-scaling, which Upstage used to train their Solar model family, reducing pretraining compute costs by up to 70%. This technique works by first duplicating layers of a smaller pretrained model to form a larger model, and then further pretraining the result. Sign up here!

Andrew Ng

85,695 Aufrufe • vor 2 Jahren

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!
0:56

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!

Arena.ai

329,034 Aufrufe • vor 9 Monaten

Revolutionizing Move Programming with OpenLedger In this demo, we showcase how Move datasets contributed by data providers to OpenLedger’s datanets are used to fine-tune specialized models with LoRA fine-tuning. As seen in the video, we showcase an example on how builders can deploy a Move-specialized model that powers Co-pilot agents using our no-code model fine-tuning platform. This is the future of AI and Web3 innovation. Watch this space to see more specialised models and data feeds being built for next generation agents on top of OpenLedger #Move
3:58

Revolutionizing Move Programming with OpenLedger In this demo, we showcase how Move datasets contributed by data providers to OpenLedger’s datanets are used to fine-tune specialized models with LoRA fine-tuning. As seen in the video, we showcase an example on how builders can deploy a Move-specialized model that powers Co-pilot agents using our no-code model fine-tuning platform. This is the future of AI and Web3 innovation. Watch this space to see more specialised models and data feeds being built for next generation agents on top of OpenLedger #Move

OpenLedger

61,693 Aufrufe • vor 1 Jahr

Amazon AI engineer just explained how to build agentic loops from scratch in under 10-minutes. this is one of the clearest explanations of AI agentic loops you’ll find anywhere. Loop + model + agent + hooks + MCP = an autonomous, self-improving system. People are paying $500 for courses that teach less than this. Watch it, then read the step-by-step guide below on building loops for your own agents.
8:29

Amazon AI engineer just explained how to build agentic loops from scratch in under 10-minutes. this is one of the clearest explanations of AI agentic loops you’ll find anywhere. Loop + model + agent + hooks + MCP = an autonomous, self-improving system. People are paying $500 for courses that teach less than this. Watch it, then read the step-by-step guide below on building loops for your own agents.

Codez

26,868 Aufrufe • vor 1 Monat

From an artist's mind, to the game: every detail tells a story. Episode 3 of From The Ward showcases the step by step process of how Joel and the team at Infinity Ward take iconic characters and gear from rough sketch, to your loadout in Call of Duty: Modern Warfare 4.
9:04

From an artist's mind, to the game: every detail tells a story. Episode 3 of From The Ward showcases the step by step process of how Joel and the team at Infinity Ward take iconic characters and gear from rough sketch, to your loadout in Call of Duty: Modern Warfare 4.

Call of Duty

212,657 Aufrufe • vor 2 Monaten