Loading video...

Video Failed to Load

Go Home

Introducing OpenBench 0.1: Open, Reproducible Evals 🧵

aarush's profile picture

Aarush Sah

8,109 subscribers

146,605 views • 1 year ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇
1:11

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

Moo Jin Kim

227,128 views • 2 years ago

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵
1:40

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵

serafim

135,868 views • 8 months ago

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you
1:26

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

Leonard Tang

36,496 views • 1 year ago

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵
0:31

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Resemble AI

24,082 views • 1 year ago

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:
1:11

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,510 views • 1 year ago

📣 Introducing... 🧵👇
0:26

📣 Introducing... 🧵👇

exploits.club

11,402 views • 2 years ago

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.
2:07

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

sunny madra

167,340 views • 11 months ago

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵
0:57

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

Ai2

87,476 views • 5 months ago

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory
8:56

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory

Warp

301,843 views • 27 days ago

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵
0:41

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵

TrueNorth AI

39,217 views • 1 month ago

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory
1:22

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory

Chelsea Finn

98,986 views • 2 years ago

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS
1:39

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS

Michigan State Football

153,450 views • 3 years ago

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱
0:33

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱

Project Nema

195,623 views • 1 year ago

Introducing IntelliPickz 2.0 Here's everything that's new 🧵👇
0:30

Introducing IntelliPickz 2.0 Here's everything that's new 🧵👇

IntelliPickz

19,674 views • 5 days ago

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓
1:00

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓

tricks.gg

73,963 views • 1 year ago

Introducing AgentX: InferenceXs new agentic inference performance benchmark. (1/2)🧵
2:18

Introducing AgentX: InferenceXs new agentic inference performance benchmark. (1/2)🧵

SemiAnalysis

71,140 views • 21 days ago