Загрузка видео...

Не удалось загрузить видео

На главную

trained my own with trl + openenv blog with open artifacts (code, models, dataset, rl env...) soon!

SergioPaniego's profile picture

Sergio Paniego

7,031 subscribers

90,257 просмотров • 2 месяцев назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 13

Фото профиля Saad
Saad2 месяцев назад

I’m trying something similar too

Фото профиля Gajesh
Gajesh2 месяцев назад

how much did this process cost and how many TFLOPs / GPUs went in this? (would like to try smth like this)

Фото профиля Sergio Paniego
Sergio Paniego2 месяцев назад

i'll add all the details about it on the final blog, i'm releasing it tomorrow

Фото профиля Akash Mahajan
Akash Mahajan2 месяцев назад

@adithya_s_k Awesome looking forward to it!

Фото профиля Kevin Hu
Kevin Hu2 месяцев назад

looking forward!

Фото профиля Sagar
Sagar2 месяцев назад

Open artifacts is the part that matters. Waiting on that blog!

Фото профиля tani
tani2 месяцев назад

nice work - how much did it end up costing?

Фото профиля Sergio Paniego
Sergio Paniego2 месяцев назад

i'll add details about it on the blog! dropping tomorrow

Фото профиля Gon
Gon2 месяцев назад

Eres un crack Sergio. La verdad es que la charla que diste en seLIA sobre TRL y Openenv estuvo muy interesante (yo soy el chaval que se acercó a darte la lata al final)

Фото профиля Sergio Paniego
Sergio Paniego2 месяцев назад

gracias, me acuerdo! jaja

Фото профиля Gon
Gon2 месяцев назад

El año que viene volveré a darte la lata

Фото профиля Starling
Starling2 месяцев назад

What beauty 💙

Фото профиля Nelson Chu
Nelson Chu2 месяцев назад

Interested in controlling a watercolor app to paint?

Похожие видео

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!
0:34

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!

Adithya S K

117,964 просмотров • 2 месяцев назад

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥
0:21

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥

Together AI

28,338 просмотров • 1 год назад

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀
0:22

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀

Adithya S K

26,931 просмотров • 1 месяц назад

A composite agent harness composed of system1 (multi-agent jevs) + system2 (astra) out-micros an insane computer in my WC3FT RL env (will open-source soon)
1:12

A composite agent harness composed of system1 (multi-agent jevs) + system2 (astra) out-micros an insane computer in my WC3FT RL env (will open-source soon)

Peter Wang

188,012 просмотров • 1 месяц назад

I had 14 tabs open just to keep up with AI. arXiv, Papers With Code, every leaderboard, HuggingFace, half a dozen RL-env hubs... So I built one screen for all of it. The Bloomberg terminal for AI research. It's called Sophon 🧵
2:25

I had 14 tabs open just to keep up with AI. arXiv, Papers With Code, every leaderboard, HuggingFace, half a dozen RL-env hubs... So I built one screen for all of it. The Bloomberg terminal for AI research. It's called Sophon 🧵

serafim

48,633 просмотров • 5 месяцев назад

We used RL to train models that create curated context from long documents for downstream use by agents. The models sometimes learn to invent their own abbreviations and shorthand. Optimizing with RL for downstream use produces very different artifacts from ordinary summaries: shorter, denser, creatively concise. We call these neural cheat-sheets.
0:24

We used RL to train models that create curated context from long documents for downstream use by agents. The models sometimes learn to invent their own abbreviations and shorthand. Optimizing with RL for downstream use produces very different artifacts from ordinary summaries: shorter, denser, creatively concise. We call these neural cheat-sheets.

Applied Compute

37,368 просмотров • 4 месяцев назад

One of the first policies successfully trained with obstacles. Am I the first person to train models in RL with this many rigid bodies?
0:23

One of the first policies successfully trained with obstacles. Am I the first person to train models in RL with this many rigid bodies?

kache

31,437 просмотров • 2 месяцев назад

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals
0:20

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals

Adithya S K

68,926 просмотров • 1 месяц назад

Video understanding isn't just recognizing —it demands reasoning across thousands of frames. Meet Long-RL🚀 Highlights: 🧠 Dataset: LongVideo-Reason — 52K QAs with reasoning. ⚡ System: MR-SP - 2.1× faster RL for long videos. 📈 Scalability: Hour-long videos (3,600 frames) RL on a single node (8×A100s). 🖼️📝🎵 RL training for video, text, audio — works with VILA, Qwen series, and image/video generation models 🎨🎬 📄 Paper: 🎥 Demo: 💻 Code:
1:19

Video understanding isn't just recognizing —it demands reasoning across thousands of frames. Meet Long-RL🚀 Highlights: 🧠 Dataset: LongVideo-Reason — 52K QAs with reasoning. ⚡ System: MR-SP - 2.1× faster RL for long videos. 📈 Scalability: Hour-long videos (3,600 frames) RL on a single node (8×A100s). 🖼️📝🎵 RL training for video, text, audio — works with VILA, Qwen series, and image/video generation models 🎨🎬 📄 Paper: 🎥 Demo: 💻 Code:

Yukang Chen

31,876 просмотров • 1 год назад

excited to announce that Cloudflare Artifacts is now in open beta! with Artifacts, you can give every application and agent its own repo that you can manage programmatically plus you can use it to store and deploy your Workers code (and ofc it integrates with Workers Previews)
0:21

excited to announce that Cloudflare Artifacts is now in open beta! with Artifacts, you can give every application and agent its own repo that you can manage programmatically plus you can use it to store and deploy your Workers code (and ofc it integrates with Workers Previews)

dina kozlov 🐀

166,435 просмотров • 1 месяц назад

train YOLOv9 on your dataset tutorial - run inference with a pre-trained COCO model - fine-tune model on custom dataset - evaluate the trained model - run inference with a fine-tuned model blogpost: ↓ read more
0:30

train YOLOv9 on your dataset tutorial - run inference with a pre-trained COCO model - fine-tune model on custom dataset - evaluate the trained model - run inference with a fine-tuned model blogpost: ↓ read more

SkalskiP

111,876 просмотров • 2 лет назад

OpenEnv has a new home: starting today, it's coordinated by a committee that includes Meta-PyTorch, Reflection, Unsloth, Modal, Prime Intellect, Nvidia, Mercor, Fleet AI, and Hugging Face frontier labs train their models and their harnesses together. Claude knows Claude Code. GPT-5.5 knows Codex. that's not an accident, it's training. open-source models deserve the same magic, but pulling that off requires infrastructure that belongs to everyone, not one lab OpenEnv is that layer. one api, any harness, any trainer, any environment rewards and training loops stay in TRL, Unsloth, wherever you already work. OpenEnv is the socket they all plug into get involved!
0:20

OpenEnv has a new home: starting today, it's coordinated by a committee that includes Meta-PyTorch, Reflection, Unsloth, Modal, Prime Intellect, Nvidia, Mercor, Fleet AI, and Hugging Face frontier labs train their models and their harnesses together. Claude knows Claude Code. GPT-5.5 knows Codex. that's not an accident, it's training. open-source models deserve the same magic, but pulling that off requires infrastructure that belongs to everyone, not one lab OpenEnv is that layer. one api, any harness, any trainer, any environment rewards and training loops stay in TRL, Unsloth, wherever you already work. OpenEnv is the socket they all plug into get involved!

Sergio Paniego

32,760 просмотров • 5 месяцев назад

Building good RL environments is hard. We're introducing a way to turn anything into RL-environments with REA using the open source AgentEnv framework from Scale Labs Any site, app, or game can now easily be turned into an env 😉
0:29

Building good RL environments is hard. We're introducing a way to turn anything into RL-environments with REA using the open source AgentEnv framework from Scale Labs Any site, app, or game can now easily be turned into an env 😉

reatools

54,812 просмотров • 17 дней назад

None of the video gen models do a real CRT terminal animation look. So I trained my own with fal. CRT-anim : open-source LoRA for LTX-2.3 22B. Runs on fal + ComfyUI.
1:04

None of the video gen models do a real CRT terminal animation look. So I trained my own with fal. CRT-anim : open-source LoRA for LTX-2.3 22B. Runs on fal + ComfyUI.

Lovis Odin

42,051 просмотров • 6 месяцев назад

We just released the world's first open-source humanoid physical strike AI! The AI is trained with large-scale self-play RL with a pre-trained ASE model from Jason Peng. Thank ZiyiBird for this amazing work.
1:11

We just released the world's first open-source humanoid physical strike AI! The AI is trained with large-scale self-play RL with a pre-trained ASE model from Jason Peng. Thank ZiyiBird for this amazing work.

Flood Sung

101,796 просмотров • 3 лет назад

📈 Scale open models with Hugging Face Text Generation Inference! 🚀 Customize with LoRA adapters ⚙️ Optimize with PEFT and TRL ☁️ Deploy on Google Cloud Platform with ease 🤖 Watch the demo from #GemmaDeveloperDay Tokyo →
0:39

📈 Scale open models with Hugging Face Text Generation Inference! 🚀 Customize with LoRA adapters ⚙️ Optimize with PEFT and TRL ☁️ Deploy on Google Cloud Platform with ease 🤖 Watch the demo from #GemmaDeveloperDay Tokyo →

Google for Developers

23,085 просмотров • 1 год назад

Together Post-Training is live Turn open models into custom models you own, with SFT or RL. You define the data, rewards, environments and the training loop itself. We run the hard infrastructure underneath it, tuned for quality and speed.
1:34

Together Post-Training is live Turn open models into custom models you own, with SFT or RL. You define the data, rewards, environments and the training loop itself. We run the hard infrastructure underneath it, tuned for quality and speed.

Together AI

36,915 просмотров • 18 дней назад

Today we presented our work on Action Recognition with 3D pose and tracking at #CVPR. We also released our code, models, and dataset of 1.5 million human trajectories. Code: Project Page:
0:26

Today we presented our work on Action Recognition with 3D pose and tracking at #CVPR. We also released our code, models, and dataset of 1.5 million human trajectories. Code: Project Page:

Jathushan Rajasegaran

132,016 просмотров • 3 лет назад

Turned Scott Wu’s pub card game into a Math RL environment Simple rules and rewards, and plenty of headroom for small models to hillclimb on and built on OpenEnv 👀
0:45

Turned Scott Wu’s pub card game into a Math RL environment Simple rules and rewards, and plenty of headroom for small models to hillclimb on and built on OpenEnv 👀

Adithya S K

17,833 просмотров • 15 дней назад