正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introducing OpenBench 0.1: Open, Reproducible Evals 🧵

Aarush Sah

8,109 subscribers

146,605 次观看 • 1 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning. It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵

We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning. It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵

Ai2

34,149 次观看 • 8 天前

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

Moo Jin Kim

227,218 次观看 • 2 年前

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵

Introducing 1Code Open source Cursor-like UI for Claude Code. 🧵

serafim

136,200 次观看 • 10 个月前

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

How do we understand & evaluate the fuzzy space of LLM outputs? We clone your Subject Matter Expert annotator into a Judge. Introducing EVALS EVALS EVALS Create a custom Judge that works for you

Leonard Tang

36,496 次观看 • 1 年前

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,534 次观看 • 1 年前

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Resemble AI

24,082 次观看 • 1 年前

📣 Introducing... 🧵👇

📣 Introducing... 🧵👇

exploits.club

11,434 次观看 • 2 年前

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

Informative discussion on the The All-In Podcast about our Groq Inc cloud service. We specifically built and open-sourced OpenBench to evaluate LLM performance and security.

sunny madra

167,340 次观看 • 1 年前

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

Today we're releasing WildDet3D—an open model for monocular 3D object detection in the wild. It works with text, clicks, or 2D boxes, and on zero-shot evals it nearly doubles the best prior scores. 🧵

Ai2

88,846 次观看 • 7 个月前

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵

Introducing Position Watcher. Deploy an AI agent to manage every position you open on Hyperliquid , 24/7. Here's what it does for you 🧵

TrueNorth AI

39,217 次观看 • 3 个月前

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory

Introducing Warp Factories: open, flexible infrastructure for building cloud software factories. - Configure your factory as code - Use any model and any harness - Measure quality with evals and benchmarks on your own data - Built-in self-improvement and memory

Warp

303,813 次观看 • 2 个月前

Introducing Pomerado (YC F26): the faster, cheaper, and more reliable alternative to browser use. Open source. Sign up for free to supercharge your agents 🧵

Introducing Pomerado (YC F26): the faster, cheaper, and more reliable alternative to browser use. Open source. Sign up for free to supercharge your agents 🧵

Akshay

573,589 次观看 • 20 天前

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS

New Threads. 🧵🧵 And introducing for the first time the 𝑺𝒉𝒂𝒅𝒐𝒘 uniform. #RELENTLESS

Michigan State Football

153,515 次观看 • 3 年前

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents A short 🧵 on the backstory

Chelsea Finn

98,986 次观看 • 2 年前

Introducing: Claws Out AI Agent Demo Day Intelligence Cubed: d/acc-Driven Open Source Modelverse by Fernando Jia, Founder Cubed Full video below 👇🧵

Introducing: Claws Out AI Agent Demo Day Intelligence Cubed: d/acc-Driven Open Source Modelverse by Fernando Jia, Founder Cubed Full video below 👇🧵

ETHDenver 🏔🦬🦄

48,092 次观看 • 8 个月前

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱

Introducing HYPERWORM: The first verifiable digital organism onchain. Our open-source model adapted from Nematoduino runs in Marlin TEE network on Hyperliquid EVM. Visit: 🧵🪱

Project Nema

195,698 次观看 • 1 年前

Introducing the Decision Index 0.1 ⚖️ a rigorous leaderboard comparing jev with 30+ open weights decision models 35+ benchmarks. asking 130K questions to each model testing knowledge 🧠, automation ⚙️, understanding 🤔and even creativity 🎨

Introducing the Decision Index 0.1 ⚖️ a rigorous leaderboard comparing jev with 30+ open weights decision models 35+ benchmarks. asking 130K questions to each model testing knowledge 🧠, automation ⚙️, understanding 🤔and even creativity 🎨

apolinario (poli)

44,399 次观看 • 1 个月前

CEB PhysEng 0.1 Simulate hundreds.... thousands of objects in seconds. Download for free, link in the thread 🧵

CEB PhysEng 0.1 Simulate hundreds.... thousands of objects in seconds. Download for free, link in the thread 🧵

Carlos Barreto

15,005 次观看 • 1 年前

Introducing AstaBrief 8B, an open model that turns complex research questions + literature excerpts into cited reports. Run it locally on your own hardware, with open weights + training data you can inspect & build on. 🧵 🤗 Download:

Introducing AstaBrief 8B, an open model that turns complex research questions + literature excerpts into cited reports. Run it locally on your own hardware, with open weights + training data you can inspect & build on. 🧵 🤗 Download:

Ai2

32,667 次观看 • 1 个月前