Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing OpenBench 0.1: Open, Reproducible Evals ๐Ÿงต

aarush's profile picture

Aarush Sah

8,109 subscribers

146,605 Aufrufe โ€ข vor 1 Jahr โ€ขvia X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossiโ€ข Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfรผgbar

Kommentare vom Original-Post werden hier angezeigt

ร„hnliche Videos

โœจ Introducing ๐Ž๐ฉ๐ž๐ง๐•๐‹๐€ โ€” an open-source vision-language-action model for robotics! ๐Ÿ‘ - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals ๐Ÿฆพ - trained on 970k episodes from OpenX dataset ๐Ÿค– - fully open: model/code/data all online ๐Ÿค— ๐Ÿงต๐Ÿ‘‡
1:11

โœจ Introducing ๐Ž๐ฉ๐ž๐ง๐•๐‹๐€ โ€” an open-source vision-language-action model for robotics! ๐Ÿ‘ - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals ๐Ÿฆพ - trained on 970k episodes from OpenX dataset ๐Ÿค– - fully open: model/code/data all online ๐Ÿค— ๐Ÿงต๐Ÿ‘‡

Moo Jin Kim

227,218 Aufrufe โ€ข vor 2 Jahren

Introducing 1Code Open source Cursor-like UI for Claude Code. ๐Ÿงต
1:40

Introducing 1Code Open source Cursor-like UI for Claude Code. ๐Ÿงต

serafim

136,200 Aufrufe โ€ข vor 9 Monaten

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you
1:26

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

Leonard Tang

36,496 Aufrufe โ€ข vor 1 Jahr

Introducing Chatterbox Multilingual ๐ŸŒŽ 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in ๐Ÿงต
0:31

Introducing Chatterbox Multilingual ๐ŸŒŽ 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in ๐Ÿงต

Resemble AI

24,082 Aufrufe โ€ข vor 1 Jahr

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:
1:11

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,534 Aufrufe โ€ข vor 1 Jahr

๐Ÿ“ฃ Introducing... ๐Ÿงต๐Ÿ‘‡
0:26

๐Ÿ“ฃ Introducing... ๐Ÿงต๐Ÿ‘‡

exploits.club

11,434 Aufrufe โ€ข vor 2 Jahren

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.
2:07

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

sunny madra

167,340 Aufrufe โ€ข vor 1 Jahr

Today we're releasing WildDet3Dโ€”an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. ๐Ÿงต
0:57

Today we're releasing WildDet3Dโ€”an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. ๐Ÿงต

Ai2

88,758 Aufrufe โ€ข vor 6 Monaten

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you ๐Ÿงต
0:41

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you ๐Ÿงต

TrueNorth AI

39,217 Aufrufe โ€ข vor 3 Monaten

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory
8:56

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory

Warp

303,402 Aufrufe โ€ข vor 2 Monaten

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short ๐Ÿงต on the backstory
1:22

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short ๐Ÿงต on the backstory

Chelsea Finn

98,986 Aufrufe โ€ข vor 2 Jahren

Introducing Pomerado (YC F26): the faster, cheaper, and more reliable alternative to browser use. Open source. Sign up for free to supercharge your agents ๐Ÿงต
1:56

Introducing Pomerado (YC F26): the faster, cheaper, and more reliable alternative to browser use. Open source. Sign up for free to supercharge your agents ๐Ÿงต

Akshay

489,996 Aufrufe โ€ข vor 8 Tagen

New Threads. ๐Ÿงต๐Ÿงต And introducing for the first time the ๐‘บ๐’‰๐’‚๐’…๐’๐’˜ uniform. #RELENTLESS
1:39

New Threads. ๐Ÿงต๐Ÿงต And introducing for the first time the ๐‘บ๐’‰๐’‚๐’…๐’๐’˜ uniform. #RELENTLESS

Michigan State Football

153,515 Aufrufe โ€ข vor 3 Jahren

Introducing: Claws Out AI Agent Demo Day Intelligence Cubed: d/acc-Driven Open Source Modelverse by Fernando Jia, Founder Cubed Full video below ๐Ÿ‘‡๐Ÿงต
0:50

Introducing: Claws Out AI Agent Demo Day Intelligence Cubed: d/acc-Driven Open Source Modelverse by Fernando Jia, Founder Cubed Full video below ๐Ÿ‘‡๐Ÿงต

ETHDenver ๐Ÿ”๐Ÿฆฌ๐Ÿฆ„

48,092 Aufrufe โ€ข vor 8 Monaten

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: ๐Ÿงต๐Ÿชฑ
0:33

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: ๐Ÿงต๐Ÿชฑ

Project Nema

195,698 Aufrufe โ€ข vor 1 Jahr

Introducing the Decision Index 0.1 โš–๏ธ a rigorous leaderboard comparing jev with 30+ open weights decision models 35+ benchmarks. asking 130K questions to each model testing knowledge ๐Ÿง , automation โš™๏ธ, understanding ๐Ÿค”and even creativity ๐ŸŽจ
1:15

Introducing the Decision Index 0.1 โš–๏ธ a rigorous leaderboard comparing jev with 30+ open weights decision models 35+ benchmarks. asking 130K questions to each model testing knowledge ๐Ÿง , automation โš™๏ธ, understanding ๐Ÿค”and even creativity ๐ŸŽจ

apolinario (poli)

44,235 Aufrufe โ€ข vor 1 Monat

Introducing AstaBrief 8B, an open model that turns complex research questions + literature excerpts into cited reports. Run it locally on your own hardware, with open weights + training data you can inspect & build on. ๐Ÿงต ๐Ÿค— Download:
1:31

Introducing AstaBrief 8B, an open model that turns complex research questions + literature excerpts into cited reports. Run it locally on your own hardware, with open weights + training data you can inspect & build on. ๐Ÿงต ๐Ÿค— Download:

Ai2

32,667 Aufrufe โ€ข vor 1 Monat