Loading video...

Video Failed to Load

Go Home

Introducing OpenBench 0.1: Open, Reproducible Evals 🧵

aarush's profile picture

Aarush Sah

8,112 subscribers

146,417 views • 10 months ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇
1:11

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

Moo Jin Kim

226,922 views • 2 years ago

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵
1:40

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵

serafim

135,547 views • 4 months ago

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you
1:26

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

Leonard Tang

35,871 views • 1 year ago

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:
1:11

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

93,811 views • 1 year ago

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵
0:31

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Resemble AI

24,082 views • 9 months ago

📣 Introducing... 🧵👇
0:26

📣 Introducing... 🧵👇

exploits.club

11,341 views • 1 year ago

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵
0:57

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

Ai2

85,267 views • 2 months ago

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.
2:07

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

sunny madra

167,297 views • 8 months ago

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory
1:22

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory

Chelsea Finn

98,616 views • 2 years ago

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS
1:39

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS

Michigan State Football

153,389 views • 2 years ago

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱
0:33

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱

Project Nema

195,452 views • 1 year ago

CEB PhysEng 0.1 Simulate hundreds.... thousands of objects in seconds. Download for free, link in the thread 🧵
0:34

CEB PhysEng 0.1 Simulate hundreds.... thousands of objects in seconds. Download for free, link in the thread 🧵

Carlos Barreto

14,581 views • 11 months ago

📢Introducing THORSwap ⚡ #BetterThanCEX Referral Program Invite your friends & Earn with each THORChain swap on THORSwap ⚡ #BetterThanCEX! Simply visit and register/set your THORName to earn 10-20BPS (0.1-0.2%) in rewards (bonus via $vTHOR holding) Embrace your Chadness today!⚡1/🧵
0:31

📢Introducing THORSwap ⚡ #BetterThanCEX Referral Program Invite your friends & Earn with each THORChain swap on THORSwap ⚡ #BetterThanCEX! Simply visit and register/set your THORName to earn 10-20BPS (0.1-0.2%) in rewards (bonus via $vTHOR holding) Embrace your Chadness today!⚡1/🧵

THORSwap ⚡ #BetterThanCEX

37,809 views • 1 year ago

Introducing the new Cursor Directory: ◇ Global search for rules and MCPs ◇ Dedicated MCP Store ◇ Video learning section ◇ Popular rules ◇ Sign up - More coming soon Link to open source ⬇️🧵
0:28

Introducing the new Cursor Directory: ◇ Global search for rules and MCPs ◇ Dedicated MCP Store ◇ Video learning section ◇ Popular rules ◇ Sign up - More coming soon Link to open source ⬇️🧵

Pontus Abrahamsson — oss/acc

64,865 views • 1 year ago

Introducing: BOLTS ⚡️ Push your favorite tokens on Bubblemaps now 🧵
0:26

Introducing: BOLTS ⚡️ Push your favorite tokens on Bubblemaps now 🧵

Bubblemaps

162,314 views • 4 months ago

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓
1:00

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓

tricks.gg

73,718 views • 1 year ago

A thread 🧵 🧵 of Some old commercial advertisement ever. Open the 🧵🧵 1. Pizza hut in 1995
0:30

A thread 🧵 🧵 of Some old commercial advertisement ever. Open the 🧵🧵 1. Pizza hut in 1995

Earth_Seeker

866,483 views • 10 months ago

Introducing the Send Mobile by SEND ecosystem 📱 An open-source React Native kit to build iOS and Android mobile apps on Solana in ~15 minutes Ft. 18+ protocol integrations 🧵
0:45

Introducing the Send Mobile by SEND ecosystem 📱 An open-source React Native kit to build iOS and Android mobile apps on Solana in ~15 minutes Ft. 18+ protocol integrations 🧵

Solana

905,942 views • 1 year ago

Introducing Ava AI: Entire CX Phone Call Center For Shopify Merchants 🧵
14:27

Introducing Ava AI: Entire CX Phone Call Center For Shopify Merchants 🧵

Kai

20,323 views • 7 months ago