Adithya S K's banner

Adithya S K

@adithya_s_k • 16,646 subscribers

Scaling RL Envs @huggingface 🤗 • Founded @cognitivelab_ai Prev : Research @MSFTResearch • ML @apple • 22

Shorts

This is hugeeee for open-source RL environments. You can now discover environments across OpenEnv, Verifiers, Harbor, NeMo Gym, and more, all on the Hugging Face Hub. A common home for RL environments is long overdue. Excited for what’s coming next !

This is hugeeee for open-source RL environments. You can now discover environments across OpenEnv, Verifiers, Harbor, NeMo Gym, and more, all on the Hugging Face Hub. A common home for RL environments is long overdue. Excited for what’s coming next !

16,350 görüntüleme

You can now do RL weight sync over HF Buckets. > Async GRPO + LoRA in TRL > train on one Job, serve vLLM on others > sync just the small delta adapter through a Bucket. Trainer, inference and storage, all on Hugging Face infra. Beautifully optimised loop by @DirhoussssiAmine 👇 3h27 → 53 min for the same reward.

You can now do RL weight sync over HF Buckets. > Async GRPO + LoRA in TRL > train on one Job, serve vLLM on others > sync just the small delta adapter through a Bucket. Trainer, inference and storage, all on Hugging Face infra. Beautifully optimised loop by @DirhoussssiAmine 👇 3h27 → 53 min for the same reward.

18,551 görüntüleme

Introducing RL Environment Creator Skill Now any one can create RL environments $ npx skills add adithya-s-k/RL_Envs_101 > You can create environments across multiple frameworks like OpenEnv, OpenReward, Verifiers, NemoGym ... > the repo has live working examples of environments that your coding agent can reference > The skill is design to first understand what type of model you are training and create an environment while keeping that in mind ps. There’s a lot more to building RL environments that can be used for training. One major aspect is the data, which this skill can’t directly solve. However, the skill will help with implementing tools, rewards, and other components of an RL environment, making it easier to go from idea to implementation quickly across different frameworks. Let me know if you’d be interested in a detailed, end-to-end blog/tutorial on building an environment and actually training a model for a useful use case.

Introducing RL Environment Creator Skill Now any one can create RL environments $ npx skills add adithya-s-k/RL_Envs_101 > You can create environments across multiple frameworks like OpenEnv, OpenReward, Verifiers, NemoGym ... > the repo has live working examples of environments that your coding agent can reference > The skill is design to first understand what type of model you are training and create an environment while keeping that in mind ps. There’s a lot more to building RL environments that can be used for training. One major aspect is the data, which this skill can’t directly solve. However, the skill will help with implementing tools, rewards, and other components of an RL environment, making it easier to go from idea to implementation quickly across different frameworks. Let me know if you’d be interested in a detailed, end-to-end blog/tutorial on building an environment and actually training a model for a useful use case.

47,002 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

We collaborated with @scaleAI to build a high-fidelity port simulation RL environment where AI agents tackle real-world logistics challenges

We collaborated with @scaleAI to build a high-fidelity port simulation RL environment where AI agents tackle real-world logistics challenges

61,306 görüntüleme • 11 gün önce

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!

117,964 görüntüleme • 1 ay önce

Releasing SmolDataEnvs 🤗 5K+ Verifiable RL Environment tasks for hill-climbing small models in code and data science. Completely open source: environments, evals, training

Releasing SmolDataEnvs 🤗 5K+ Verifiable RL Environment tasks for hill-climbing small models in code and data science. Completely open source: environments, evals, training

55,392 görüntüleme • 1 ay önce

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals

68,799 görüntüleme • 1 ay önce

Introducing RL Environment Explorer 🧭 There are now 12M+ RL task entries across RL environments on the Hugging Face Hub. You can now explore, visualize, and run RL environments across: OpenEnv • Harbor • MiMo • Verifiers • NeMo Gym All in one place

Introducing RL Environment Explorer 🧭 There are now 12M+ RL task entries across RL environments on the Hugging Face Hub. You can now explore, visualize, and run RL environments across: OpenEnv • Harbor • MiMo • Verifiers • NeMo Gym All in one place

27,593 görüntüleme • 17 gün önce

Now you can also create animations like Grant Sanderson 👉🏻 excited to introduce manim_skills $ npx skills add adithya-s-k/manim_skill This animation was created just by prompting 👇

Now you can also create animations like Grant Sanderson 👉🏻 excited to introduce manim_skills $ npx skills add adithya-s-k/manim_skill This animation was created just by prompting 👇

278,515 görüntüleme • 9 ay önce

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀

26,631 görüntüleme • 1 ay önce

Excited to release TaskSmith 🔨 > a specialised harness for generating RL environments from code Not a general coding agent with a long prompt, but a specialised orchestrator. Every stage is built for one job: "turn a PR into the best RL environment possible"

Excited to release TaskSmith 🔨 > a specialised harness for generating RL environments from code Not a general coding agent with a long prompt, but a specialised orchestrator. Every stage is built for one job: "turn a PR into the best RL environment possible"

17,132 görüntüleme • 24 gün önce

7K+ RL environments from Xiaomi across coding, cyber, general, music, and more. You can now explore, visualize, and actually run them. Pick an environment → pick a model → run the rollout → watch exactly what happens RL environments are a lot more interesting when you can actually play with them.

7K+ RL environments from Xiaomi across coding, cyber, general, music, and more. You can now explore, visualize, and actually run them. Pick an environment → pick a model → run the rollout → watch exactly what happens RL environments are a lot more interesting when you can actually play with them.

17,971 görüntüleme • 26 gün önce

Introducing Vibemotion The first ever AI that turns a single prompt into stunning motion graphics and videos in minutes Vibemotion

Introducing Vibemotion The first ever AI that turns a single prompt into stunning motion graphics and videos in minutes Vibemotion

207,206 görüntüleme • 1 yıl önce

Introducing Repo2RLEnv Turn any repository into runnable, verifiable coding environments built from real PRs and commits for coding-agent evaluation or RL training > uv pip install repo2rlenv

Introducing Repo2RLEnv Turn any repository into runnable, verifiable coding environments built from real PRs and commits for coding-agent evaluation or RL training > uv pip install repo2rlenv

67,436 görüntüleme • 4 ay önce

You can now turn PRs into RL environments at scale !!

You can now turn PRs into RL environments at scale !!

13,774 görüntüleme • 1 ay önce

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

96,933 görüntüleme • 2 yıl önce

I read a lot of open-source code and that’s mostly how I learn to write better code. But it often takes a while to understand different projects their structure, how things are connected and GitHub’s UX isn’t that great for that. built "Gitvizz" to solve that exact problem it instantly turn your codebase into interactive graph so you can see how everything’s wired Check it out at - gitvizz. com ps: thats a real horse

I read a lot of open-source code and that’s mostly how I learn to write better code. But it often takes a while to understand different projects their structure, how things are connected and GitHub’s UX isn’t that great for that. built "Gitvizz" to solve that exact problem it instantly turn your codebase into interactive graph so you can see how everything’s wired Check it out at - gitvizz. com ps: thats a real horse

35,313 görüntüleme • 1 yıl önce

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

22,243 görüntüleme • 8 ay önce

Ever felt lost in your own codebase ? 👉🏻 Meet Gitvizz - instantly turn your codebase into interactive graphs so you can see how everything’s wired Check it out at gitvizz[.]com

Ever felt lost in your own codebase ? 👉🏻 Meet Gitvizz - instantly turn your codebase into interactive graphs so you can see how everything’s wired Check it out at gitvizz[.]com

24,206 görüntüleme • 1 yıl önce

Here is quick tutorial on the quickest way to repoduce/run NanoChat with minimal GPU setup time using Modal

Here is quick tutorial on the quickest way to repoduce/run NanoChat with minimal GPU setup time using Modal

17,996 görüntüleme • 1 yıl önce

Daha fazla içerik yok.