#vllm

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Introducing RSI-Inference Bench from 🍎 Apple ML Research 🌐 💻 Can AI agents improve the systems that run AI? We spent $100K API tokens, 50K GPU hours to find out. We built environments and benchmark from real-world #vLLM and #SGLang tasks, covering the full lifecycle of model inference engineering: 🚀 Day-0 Model Support ⚡ Inference Optimization 🔧 Bug Fix → Unsaturated: best agent at 26.7% pass@1 → Comprehensive coverage of the inference stack → Verifiable rewards: binary and continuous Watch the video to find out more!
2:02
onloglogn's profile picture

Introducing RSI-Inference Bench from 🍎 Apple ML Research 🌐 💻 Can AI agents improve the systems that run AI? We spent $100K API tokens, 50K GPU hours to find out. We built environments and benchmark from real-world #vLLM and #SGLang tasks, covering the full lifecycle of model inference engineering: 🚀 Day-0 Model Support ⚡ Inference Optimization 🔧 Bug Fix → Unsaturated: best agent at 26.7% pass@1 → Comprehensive coverage of the inference stack → Verifiable rewards: binary and continuous Watch the video to find out more!

Ruixiang Zhang

79,918 views • 1 month ago

Introducing 𝗩𝗲𝗹𝗮 𝟮.𝟬: Our newest 𝗢𝗽𝗲𝗻 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗼𝘂𝘁𝗶𝗻𝗴 𝗠𝗼𝗱𝗲𝗹𝘀, bringing 𝘀𝗽𝗮𝗻-𝗹𝗲𝘃𝗲𝗹 𝗱𝗲𝗰𝗶𝘀𝗶𝗼𝗻𝘀 to System One. HF Collection 🤗: #OpenSource #AI #LLM #vLLM #HuggingFace
1:42
XunzhuoLiu's profile picture

Introducing 𝗩𝗲𝗹𝗮 𝟮.𝟬: Our newest 𝗢𝗽𝗲𝗻 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗼𝘂𝘁𝗶𝗻𝗴 𝗠𝗼𝗱𝗲𝗹𝘀, bringing 𝘀𝗽𝗮𝗻-𝗹𝗲𝘃𝗲𝗹 𝗱𝗲𝗰𝗶𝘀𝗶𝗼𝗻𝘀 to System One. HF Collection 🤗: #OpenSource #AI #LLM #vLLM #HuggingFace

Xunzhuo

30,808 views • 1 month ago

Introducing d3-turbo: our newest state-of-the-art multimodal foundation decision model⚡ #1 on both Jev Decision Index boards. It points(box), follows and sees images in your questions. StateOnce brings 15x faster than d3 flash 🤗 #vLLM #Jev #Decision
0:41
XunzhuoLiu's profile picture

Introducing d3-turbo: our newest state-of-the-art multimodal foundation decision model⚡ #1 on both Jev Decision Index boards. It points(box), follows and sees images in your questions. StateOnce brings 15x faster than d3 flash 🤗 #vLLM #Jev #Decision

Xunzhuo

21,223 views • 26 days ago

No more content to load