Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing OpenBench 0.1: Open, Reproducible Evals 🧵

aarush's profile picture

Aarush Sah

8,109 subscribers

146,605 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇
1:11

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

Moo Jin Kim

227,128 Aufrufe • vor 2 Jahren

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵
1:40

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵

serafim

135,868 Aufrufe • vor 8 Monaten

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you
1:26

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

Leonard Tang

36,496 Aufrufe • vor 1 Jahr

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵
0:31

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Resemble AI

24,082 Aufrufe • vor 1 Jahr

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:
1:11

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,510 Aufrufe • vor 1 Jahr

📣 Introducing... 🧵👇
0:26

📣 Introducing... 🧵👇

exploits.club

11,402 Aufrufe • vor 2 Jahren

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.
2:07

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

sunny madra

167,340 Aufrufe • vor 11 Monaten

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵
0:57

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

Ai2

87,476 Aufrufe • vor 5 Monaten

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory
8:56

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory

Warp

301,843 Aufrufe • vor 27 Tagen

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵
0:41

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵

TrueNorth AI

39,217 Aufrufe • vor 1 Monat

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory
1:22

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory

Chelsea Finn

98,986 Aufrufe • vor 2 Jahren

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS
1:39

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS

Michigan State Football

153,450 Aufrufe • vor 3 Jahren

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱
0:33

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱

Project Nema

195,623 Aufrufe • vor 1 Jahr

Introducing IntelliPickz 2.0 Here's everything that's new 🧵👇
0:30

Introducing IntelliPickz 2.0 Here's everything that's new 🧵👇

IntelliPickz

19,674 Aufrufe • vor 5 Tagen

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓
1:00

Introducing [tricks .gg] – The all-in-one Valorant platform. 🚀 🧵↓

tricks.gg

73,963 Aufrufe • vor 1 Jahr

Introducing AgentX: InferenceXs new agentic inference performance benchmark. (1/2)🧵
2:18

Introducing AgentX: InferenceXs new agentic inference performance benchmark. (1/2)🧵

SemiAnalysis

71,140 Aufrufe • vor 21 Tagen