Adithya S K's banner

Adithya S K

@adithya_s_k • 16,646 subscribers

Scaling RL Envs @huggingface 🤗 • Founded @cognitivelab_ai Prev : Research @MSFTResearch • ML @apple • 22

Shorts

This is hugeeee for open-source RL environments. You can now discover environments across OpenEnv, Verifiers, Harbor, NeMo Gym, and more, all on the Hugging Face Hub. A common home for RL environments is long overdue. Excited for what’s coming next !

This is hugeeee for open-source RL environments. You can now discover environments across OpenEnv, Verifiers, Harbor, NeMo Gym, and more, all on the Hugging Face Hub. A common home for RL environments is long overdue. Excited for what’s coming next !

16,350 次观看

You can now do RL weight sync over HF Buckets. > Async GRPO + LoRA in TRL > train on one Job, serve vLLM on others > sync just the small delta adapter through a Bucket. Trainer, inference and storage, all on Hugging Face infra. Beautifully optimised loop by @DirhoussssiAmine 👇 3h27 → 53 min for the same reward.

You can now do RL weight sync over HF Buckets. > Async GRPO + LoRA in TRL > train on one Job, serve vLLM on others > sync just the small delta adapter through a Bucket. Trainer, inference and storage, all on Hugging Face infra. Beautifully optimised loop by @DirhoussssiAmine 👇 3h27 → 53 min for the same reward.

18,551 次观看

Introducing RL Environment Creator Skill Now any one can create RL environments $ npx skills add adithya-s-k/RL_Envs_101 > You can create environments across multiple frameworks like OpenEnv, OpenReward, Verifiers, NemoGym ... > the repo has live working examples of environments that your coding agent can reference > The skill is design to first understand what type of model you are training and create an environment while keeping that in mind ps. There’s a lot more to building RL environments that can be used for training. One major aspect is the data, which this skill can’t directly solve. However, the skill will help with implementing tools, rewards, and other components of an RL environment, making it easier to go from idea to implementation quickly across different frameworks. Let me know if you’d be interested in a detailed, end-to-end blog/tutorial on building an environment and actually training a model for a useful use case.

Introducing RL Environment Creator Skill Now any one can create RL environments $ npx skills add adithya-s-k/RL_Envs_101 > You can create environments across multiple frameworks like OpenEnv, OpenReward, Verifiers, NemoGym ... > the repo has live working examples of environments that your coding agent can reference > The skill is design to first understand what type of model you are training and create an environment while keeping that in mind ps. There’s a lot more to building RL environments that can be used for training. One major aspect is the data, which this skill can’t directly solve. However, the skill will help with implementing tools, rewards, and other components of an RL environment, making it easier to go from idea to implementation quickly across different frameworks. Let me know if you’d be interested in a detailed, end-to-end blog/tutorial on building an environment and actually training a model for a useful use case.

47,002 次观看

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

We collaborated with @scaleAI to build a high-fidelity port simulation RL environment where AI agents tackle real-world logistics challenges

We collaborated with @scaleAI to build a high-fidelity port simulation RL environment where AI agents tackle real-world logistics challenges

61,306 次观看 • 11 天前

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!

You can literally RL a 4B VLM to ace GeoGuesser 🌍 > Open-source code, RL environment, dataset, training setup, evals, and everything you need to reproduce it end-to-end > dropping soon!!

117,964 次观看 • 1 个月前

Releasing SmolDataEnvs 🤗 5K+ Verifiable RL Environment tasks for hill-climbing small models in code and data science. Completely open source: environments, evals, training

Releasing SmolDataEnvs 🤗 5K+ Verifiable RL Environment tasks for hill-climbing small models in code and data science. Completely open source: environments, evals, training

55,392 次观看 • 1 个月前

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals

we RL trained a 4B VLM to play GeoGuesser > environment, dataset, training recipe, evals, and code are all open-source. > runs on a single A100 > beat gpt 5.4 mini, haiku, qwen 3.5 122B and came close to sonnet on evals

68,799 次观看 • 1 个月前

Introducing RL Environment Explorer 🧭 There are now 12M+ RL task entries across RL environments on the Hugging Face Hub. You can now explore, visualize, and run RL environments across: OpenEnv • Harbor • MiMo • Verifiers • NeMo Gym All in one place

Introducing RL Environment Explorer 🧭 There are now 12M+ RL task entries across RL environments on the Hugging Face Hub. You can now explore, visualize, and run RL environments across: OpenEnv • Harbor • MiMo • Verifiers • NeMo Gym All in one place

27,593 次观看 • 17 天前

Now you can also create animations like Grant Sanderson 👉🏻 excited to introduce manim_skills $ npx skills add adithya-s-k/manim_skill This animation was created just by prompting 👇

Now you can also create animations like Grant Sanderson 👉🏻 excited to introduce manim_skills $ npx skills add adithya-s-k/manim_skill This animation was created just by prompting 👇

278,515 次观看 • 9 个月前

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀

Multi-harness RL training is coming to OpenEnv > pick a model. pick a harness. pick a sandbox. train > Claude Code. Codex. Gemini CLI. OpenCode. Pi. Kimi. OpenHands. and many more. > Async RL loop. fully open-source. end-to-end, harbor compatible dropping soon 👀

26,631 次观看 • 1 个月前

Excited to release TaskSmith 🔨 > a specialised harness for generating RL environments from code Not a general coding agent with a long prompt, but a specialised orchestrator. Every stage is built for one job: "turn a PR into the best RL environment possible"

Excited to release TaskSmith 🔨 > a specialised harness for generating RL environments from code Not a general coding agent with a long prompt, but a specialised orchestrator. Every stage is built for one job: "turn a PR into the best RL environment possible"

17,132 次观看 • 24 天前

7K+ RL environments from Xiaomi across coding, cyber, general, music, and more. You can now explore, visualize, and actually run them. Pick an environment → pick a model → run the rollout → watch exactly what happens RL environments are a lot more interesting when you can actually play with them.

7K+ RL environments from Xiaomi across coding, cyber, general, music, and more. You can now explore, visualize, and actually run them. Pick an environment → pick a model → run the rollout → watch exactly what happens RL environments are a lot more interesting when you can actually play with them.

17,971 次观看 • 26 天前

Introducing Vibemotion The first ever AI that turns a single prompt into stunning motion graphics and videos in minutes Vibemotion

Introducing Vibemotion The first ever AI that turns a single prompt into stunning motion graphics and videos in minutes Vibemotion

207,206 次观看 • 1 年前

Introducing Repo2RLEnv Turn any repository into runnable, verifiable coding environments built from real PRs and commits for coding-agent evaluation or RL training > uv pip install repo2rlenv

Introducing Repo2RLEnv Turn any repository into runnable, verifiable coding environments built from real PRs and commits for coding-agent evaluation or RL training > uv pip install repo2rlenv

67,436 次观看 • 4 个月前

You can now turn PRs into RL environments at scale !!

You can now turn PRs into RL environments at scale !!

13,774 次观看 • 1 个月前

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

96,933 次观看 • 2 年前

I read a lot of open-source code and that’s mostly how I learn to write better code. But it often takes a while to understand different projects their structure, how things are connected and GitHub’s UX isn’t that great for that. built "Gitvizz" to solve that exact problem it instantly turn your codebase into interactive graph so you can see how everything’s wired Check it out at - gitvizz. com ps: thats a real horse

I read a lot of open-source code and that’s mostly how I learn to write better code. But it often takes a while to understand different projects their structure, how things are connected and GitHub’s UX isn’t that great for that. built "Gitvizz" to solve that exact problem it instantly turn your codebase into interactive graph so you can see how everything’s wired Check it out at - gitvizz. com ps: thats a real horse

35,313 次观看 • 1 年前

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

Introducing Omnidocs - Unified Visual Document processing toolkit ✅ 6+ document processing tasks ✅ 15+ Model supported ✅ Runs on consumer GPU/ Mac ✅ Supports multiple backend - Pytorch, vllm, mlx, open responses API Get started → pip install omnidocs✅

22,243 次观看 • 8 个月前

Ever felt lost in your own codebase ? 👉🏻 Meet Gitvizz - instantly turn your codebase into interactive graphs so you can see how everything’s wired Check it out at gitvizz[.]com

Ever felt lost in your own codebase ? 👉🏻 Meet Gitvizz - instantly turn your codebase into interactive graphs so you can see how everything’s wired Check it out at gitvizz[.]com

24,206 次观看 • 1 年前

Here is quick tutorial on the quickest way to repoduce/run NanoChat with minimal GPU setup time using Modal

Here is quick tutorial on the quickest way to repoduce/run NanoChat with minimal GPU setup time using Modal

17,996 次观看 • 1 年前

没有更多内容可加载