Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

$TETSUO Update Setup flask embeddings service using a local model for the vector dbs that the reinforcement learning component uses to measure responses with its previous storyline 🚀

beeldcoin's profile picture

BEELD 🐝/acc

84,894 subscribers

25,536 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von tetsuo.ai
tetsuo.aivor 1 Jahr

LMFAO 😭

Profilbild von hitaro
hitarovor 1 Jahr

What a wonderful dev , TITSUUUUOO! 🇨🇦🇺🇸

Profilbild von tetsuo.ai
tetsuo.aivor 1 Jahr

TITSUUUUOO!!!

Profilbild von Paschamo
Paschamovor 1 Jahr

Need also AI Agent for my physical Art studio :) lazy Artist here 😂🎨

Profilbild von tetsuo.ai
tetsuo.aivor 1 Jahr

lol, lazy dev here. nice to meet you.

Profilbild von makintosh
makintoshvor 1 Jahr

$TETSUO ready to make history

Profilbild von Jia Zhen
Jia Zhenvor 1 Jahr

TITS UP TETSUOOOOOOO

Profilbild von tetsuo.ai
tetsuo.aivor 1 Jahr

😂

Profilbild von RPS_Crypto
RPS_Cryptovor 1 Jahr

$TETSUO 💎

Ähnliche Videos

I built a Pinterest clone that uses AI to find similar images I crawled tumblr and collected lots of images, then used a model to get vector embeddings. When you click an image it finds the most similar embeddings and returns the images
0:52

I built a Pinterest clone that uses AI to find similar images I crawled tumblr and collected lots of images, then used a model to get vector embeddings. When you click an image it finds the most similar embeddings and returns the images

ab

15,330 Aufrufe • vor 2 Jahren

building an audio similarity search engine.. given an input track it will find others that sound similar using vector embeddings from a machine learning model with an index of 1.1 million electronic music tracks
1:42

building an audio similarity search engine.. given an input track it will find others that sound similar using vector embeddings from a machine learning model with an index of 1.1 million electronic music tracks

hurf

308,518 Aufrufe • vor 2 Jahren

Trying to teach my new model to run using reinforcement learning (Hyfydy + depRL)
0:45

Trying to teach my new model to run using reinforcement learning (Hyfydy + depRL)

Thomas Geijtenbeek

975,745 Aufrufe • vor 1 Jahr

E-2 Thrust Vector Control testing is underway! This test includes frequency sweeps starting at a maximum gimbal angle of ±7 degrees, using hardware from a previous engine revision. After completing additional testing on the component stand, the actuator will be deployed to the test site for its first gimballed test fire.
0:40

E-2 Thrust Vector Control testing is underway! This test includes frequency sweeps starting at a maximum gimbal angle of ±7 degrees, using hardware from a previous engine revision. After completing additional testing on the component stand, the actuator will be deployed to the test site for its first gimballed test fire.

LΛUNCHER

73,012 Aufrufe • vor 2 Monaten

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)
0:24

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

naklecha

46,302 Aufrufe • vor 1 Jahr

BYD just rolled out its new God’s Eye 5.0 update in China, which now builds on the end-to-end architecture and “reinforcement learning”. BYD says this software is now intended to feel more “human-like” than previous software versions.
2:44

BYD just rolled out its new God’s Eye 5.0 update in China, which now builds on the end-to-end architecture and “reinforcement learning”. BYD says this software is now intended to feel more “human-like” than previous software versions.

Nic Cruz Patane

36,622 Aufrufe • vor 5 Monaten

robot named CyberRunner, developed by researchers at ETH Zurich, which uses Al and model-based reinforcement learning to master the classic Labyrinth board game in just six hours
0:20

robot named CyberRunner, developed by researchers at ETH Zurich, which uses Al and model-based reinforcement learning to master the classic Labyrinth board game in just six hours

Science girl

120,161 Aufrufe • vor 10 Monaten

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:
2:41

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:

Andrew Ng

86,457 Aufrufe • vor 1 Jahr

ReZero: A small model that learns to search - it never gives up 🔥 ReZero trains with synthetic search engines that force the model to retry, refine, and persist until it finds a better answer (never give up 💪). It's built on Meta's Llama 3.2B. Instead of optimizing for recall or speed, we train the model to retry when it's wrong - using reinforcement learning to build persistence into the search process. - Model: - Code: Thanks to AI at Meta for the Llama 3.2B base, Unsloth AI for AutoDidact (the framework we built on), and Colin Kealty for quantizing the model!
0:38

ReZero: A small model that learns to search - it never gives up 🔥 ReZero trains with synthetic search engines that force the model to retry, refine, and persist until it finds a better answer (never give up 💪). It's built on Meta's Llama 3.2B. Instead of optimizing for recall or speed, we train the model to retry when it's wrong - using reinforcement learning to build persistence into the search process. - Model: - Code: Thanks to AI at Meta for the Llama 3.2B base, Unsloth AI for AutoDidact (the framework we built on), and Colin Kealty for quantizing the model!

Menlo Research

13,948 Aufrufe • vor 1 Jahr

Its nice to see the recent excitement around Q-learning! Here's a clip from a video all about Deep Reinforcement Learning, including Deep Q Learning #machinelearning #ai
2:19

Its nice to see the recent excitement around Q-learning! Here's a clip from a video all about Deep Reinforcement Learning, including Deep Q Learning #machinelearning #ai

Steven Brunton

164,993 Aufrufe • vor 2 Jahren

how to learn something from the first principles (with a live demo on reinforcement learning)
39:05

how to learn something from the first principles (with a live demo on reinforcement learning)

Ajeet ( opensox.ai )

229,818 Aufrufe • vor 1 Monat

DeepMind training bipedal robots to play soccer using deep reinforcement learning.
0:27

DeepMind training bipedal robots to play soccer using deep reinforcement learning.

MachinePix

16,986,259 Aufrufe • vor 2 Jahren

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world
0:26

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world

simp 4 satoshi

19,542 Aufrufe • vor 8 Monaten

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.
1:10

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.

RAI Institute

76,576 Aufrufe • vor 1 Jahr

Developed by a Swiss-led team, a robot uses reinforcement learning, a type of AI that improves decision-making through repeated attempts to play badminton against human opponents
1:57

Developed by a Swiss-led team, a robot uses reinforcement learning, a type of AI that improves decision-making through repeated attempts to play badminton against human opponents

Reuters

56,015 Aufrufe • vor 1 Jahr

New short course on Building Applications with Vector Databases, taught by Pinecone’s Tim Tully! At the heart of a vector database is the ability to store a collection of vectors and then query against that, meaning input a new vector and find similar ones. This is useful for many AI applications. In this course, you'll learn how to use vector databases to build: (i) Semantic Search: Create a text search tool that goes beyond keyword matching, and instead focuses on the meaning of content. (ii) RAG (retrieval augmented generation): Enhance your LLM output by incorporating context from sources the model wasn't trained on. (iii) Recommender System: Combine semantic search and RAG to recommend topics, and demonstrate it with a news article recommender. (iv) Hybrid Search: Build an application that finds items using both images and descriptive text -- by combining both sparse and dense vector representations of the data -- using an eCommerce dataset as an example. (v) Image Similarity: Use image vector embeddings to create an app to compare facial features, using a database of public figures to determine the likeness between them. (vi) Anomaly Detection: Build an anomaly detection app that identifies unusual patterns in network communication logs. I hope you’ll enjoy learning how to build all these types of applications! Please sign up here:
2:19

New short course on Building Applications with Vector Databases, taught by Pinecone’s Tim Tully! At the heart of a vector database is the ability to store a collection of vectors and then query against that, meaning input a new vector and find similar ones. This is useful for many AI applications. In this course, you'll learn how to use vector databases to build: (i) Semantic Search: Create a text search tool that goes beyond keyword matching, and instead focuses on the meaning of content. (ii) RAG (retrieval augmented generation): Enhance your LLM output by incorporating context from sources the model wasn't trained on. (iii) Recommender System: Combine semantic search and RAG to recommend topics, and demonstrate it with a news article recommender. (iv) Hybrid Search: Build an application that finds items using both images and descriptive text -- by combining both sparse and dense vector representations of the data -- using an eCommerce dataset as an example. (v) Image Similarity: Use image vector embeddings to create an app to compare facial features, using a database of public figures to determine the likeness between them. (vi) Anomaly Detection: Build an anomaly detection app that identifies unusual patterns in network communication logs. I hope you’ll enjoy learning how to build all these types of applications! Please sign up here:

Andrew Ng

137,073 Aufrufe • vor 2 Jahren

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!
2:19

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

Y Combinator

17,143 Aufrufe • vor 1 Jahr

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.
0:20

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.

Jousef Murad

433,091 Aufrufe • vor 2 Jahren

[RLHF] by Hand ✍️ Yesterday, Jan Leike (Jan Leike) announced he is joining #Anthropic to lead their "super-alignment" mission. He is the co-inventor of Reinforcement Learning with Human Feedback (#RLHF). How does RLHF work? [1] Given ↳ Reward Model (RM) ↳ Large Language Model (LLM) ↳ Two (Prompt, Next) Pairs 🟪 TRAIN RM Goal: Learn to give higher rewards to winners [2] Preferences ↳ A human reviews the two pairs and picks a "winner" ↳ (doc is, him) Embeddings ↳ This prompt has never received human feedback directly ↳ [S] is the special start symbol [11] Transformer ↳ Attention (yellow) ↳ Feed Forward (4x2 weight and bias matrix) ↳ Output: 3 "transformed" feature vector, one per position ↳ More details in my previous post 8. Transformer [] [12] Output Probabilities ↳ Apply a linear layer to map each transformed feature vector to a probability distribution over the vocabulary. [13] Sample ↳ Apply the greedy method, which is to pick the word with the highest score ↳ For output 1 and 2, the model accurately predicts the next word ↳ For 3rd output position, the model's predicts "him" [14] Reward Model ↳ The new pair (CEO is, him) is fed to the reward model ↳ The process is same as [3]-[6] ↳ Output: Reward = 3 [15] Loss Gradient ↳ We set the loss as the negative of the reward. ↳ The loss gradient is simply a constant -1. ↳ Run backpropagation and gradient descent to update LLM's weights and biases (red border)
1:01

[RLHF] by Hand ✍️ Yesterday, Jan Leike (Jan Leike) announced he is joining #Anthropic to lead their "super-alignment" mission. He is the co-inventor of Reinforcement Learning with Human Feedback (#RLHF). How does RLHF work? [1] Given ↳ Reward Model (RM) ↳ Large Language Model (LLM) ↳ Two (Prompt, Next) Pairs 🟪 TRAIN RM Goal: Learn to give higher rewards to winners [2] Preferences ↳ A human reviews the two pairs and picks a "winner" ↳ (doc is, him) Embeddings ↳ This prompt has never received human feedback directly ↳ [S] is the special start symbol [11] Transformer ↳ Attention (yellow) ↳ Feed Forward (4x2 weight and bias matrix) ↳ Output: 3 "transformed" feature vector, one per position ↳ More details in my previous post 8. Transformer [] [12] Output Probabilities ↳ Apply a linear layer to map each transformed feature vector to a probability distribution over the vocabulary. [13] Sample ↳ Apply the greedy method, which is to pick the word with the highest score ↳ For output 1 and 2, the model accurately predicts the next word ↳ For 3rd output position, the model's predicts "him" [14] Reward Model ↳ The new pair (CEO is, him) is fed to the reward model ↳ The process is same as [3]-[6] ↳ Output: Reward = 3 [15] Loss Gradient ↳ We set the loss as the negative of the reward. ↳ The loss gradient is simply a constant -1. ↳ Run backpropagation and gradient descent to update LLM's weights and biases (red border)

Tom Yeh

79,758 Aufrufe • vor 2 Jahren