Загрузка видео...

Не удалось загрузить видео

На главную

Ego2Web A Web Agent Benchmark Grounded in Egocentric Videos paper:

_akhaliq's profile picture

AK

511,941 subscribers

17,070 просмотров • 4 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!
1:25

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!

Xin Eric Wang

11,529 просмотров • 3 месяцев назад

EgoLifter Open-world 3D Segmentation for Egocentric Perception In this paper we present EgoLifter, a novel system that can automatically segment scenes captured from egocentric sensors into a complete decomposition of individual 3D objects. The system is specifically
0:20

EgoLifter Open-world 3D Segmentation for Egocentric Perception In this paper we present EgoLifter, a novel system that can automatically segment scenes captured from egocentric sensors into a complete decomposition of individual 3D objects. The system is specifically

AK

41,117 просмотров • 2 лет назад

🛑📢 HD-EPIC: A Highly-Detailed Egocentric Video Dataset New collected videos 263 annotations/min: recipe, nutrition, actions, sounds, 3D object movement &fixture associations, masks. 26K VQA benchmark to challenge current VLMs 1/N
1:50

🛑📢 HD-EPIC: A Highly-Detailed Egocentric Video Dataset New collected videos 263 annotations/min: recipe, nutrition, actions, sounds, 3D object movement &fixture associations, masks. 26K VQA benchmark to challenge current VLMs 1/N

Dima Damen

22,308 просмотров • 1 год назад

1/ [NeurIPS D&B] Introducing HourVideo: A benchmark for hour-long video-language understanding!🚀 500 egocentric videos, 18 total tasks & ~13k questions! Performance: GPT-4➡️25.7% Gemini 1.5 Pro➡️37.3% Humans➡️85.0% We highlight a significant gap in multimodal capabilities🧵👇
0:25

1/ [NeurIPS D&B] Introducing HourVideo: A benchmark for hour-long video-language understanding!🚀 500 egocentric videos, 18 total tasks & ~13k questions! Performance: GPT-4➡️25.7% Gemini 1.5 Pro➡️37.3% Humans➡️85.0% We highlight a significant gap in multimodal capabilities🧵👇

Keshigeyan Chandrasegaran

111,369 просмотров • 1 год назад

How capable are web agents at solving knowledge work tasks? 🤔 Are LLMs up to the challenge? 🤖 Introducing WorkArena: a benchmark where agents meet the world 𝘸𝘪𝘭𝘥 web of enterprise software 🌐🖥️ Paper: Website: 🧵 1/7
0:25

How capable are web agents at solving knowledge work tasks? 🤔 Are LLMs up to the challenge? 🤖 Introducing WorkArena: a benchmark where agents meet the world 𝘸𝘪𝘭𝘥 web of enterprise software 🌐🖥️ Paper: Website: 🧵 1/7

Alexandre Lacoste

24,536 просмотров • 2 лет назад

we are kicking off Paper video tutorials in a big way! upcoming videos will cover our pen tool and tokens launches and new agent model explorations what else would you like to see?
3:36

we are kicking off Paper video tutorials in a big way! upcoming videos will cover our pen tool and tokens launches and new agent model explorations what else would you like to see?

Paper

28,663 просмотров • 2 месяцев назад

wow... GPT 5.6 Sol Passed the Replit Benchmark. In one prompt 5.6 on Codex created a full Replit clone with DB, Sandboxes, and an agent that builds and edits full web apps. Only Fable and GPT 5.6 have passed this benchmark. 5.6 is much better at designing iOS apps than 5.5 as well.
0:57

wow... GPT 5.6 Sol Passed the Replit Benchmark. In one prompt 5.6 on Codex created a full Replit clone with DB, Sandboxes, and an agent that builds and edits full web apps. Only Fable and GPT 5.6 have passed this benchmark. 5.6 is much better at designing iOS apps than 5.5 as well.

Riley Brown

123,242 просмотров • 23 дней назад

1️⃣ Ego-Exo4D A new foundational dataset + benchmark suite to support research on video learning & multimodal perception, co-developed with 14 university partners. Details ➡️ Core to the work is videos of skilled human activities, simultaneously capturing both first-person "egocentric" + multiple “exocentric” views.
2:51

1️⃣ Ego-Exo4D A new foundational dataset + benchmark suite to support research on video learning & multimodal perception, co-developed with 14 university partners. Details ➡️ Core to the work is videos of skilled human activities, simultaneously capturing both first-person "egocentric" + multiple “exocentric” views.

AI at Meta

133,666 просмотров • 2 лет назад

Today we’re releasing Ramp SWE-Bench: a private, production-grounded coding benchmark created from real engineering problems we've faced at Ramp.
0:27

Today we’re releasing Ramp SWE-Bench: a private, production-grounded coding benchmark created from real engineering problems we've faced at Ramp.

Ramp Labs

186,116 просмотров • 1 месяц назад

Paper is now a canvas for Cursor, Claude Code, Codex. Any agent can read and write to your design.
1:03

Paper is now a canvas for Cursor, Claude Code, Codex. Any agent can read and write to your design.

Paper

12,452,471 просмотров • 4 месяцев назад

From egocentric glove data to a MANO hand model, replayed in Rerun.
0:28

From egocentric glove data to a MANO hand model, replayed in Rerun.

Yu Xiang

39,229 просмотров • 6 месяцев назад

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.
1:21

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.

AI at Meta

33,607 просмотров • 1 год назад

Anything you can do in Notion, your agent can do… on mobile. Before, Agent on mobile ran in a web view. Now, it’s native, faster, so quick ideas don’t have to wait.
0:20

Anything you can do in Notion, your agent can do… on mobile. Before, Agent on mobile ran in a web view. Now, it’s native, faster, so quick ideas don’t have to wait.

Notion

60,969 просмотров • 7 месяцев назад

Sprint planner agent: don’t create/move your tickets manually, let your agent take care of them Designed in Paper, animation with Motion inside Zed
0:24

Sprint planner agent: don’t create/move your tickets manually, let your agent take care of them Designed in Paper, animation with Motion inside Zed

Jeet

31,129 просмотров • 2 месяцев назад

pi-web-access is an extension that provides web search (and more) for Pi coding agent. The latest update introduces a new UX pattern: you can hit `Ctrl+S` to intercept agent searches mid-flight to inspect and curate exactly what makes it into the agent conversation. pi install npm:pi-web-access
0:34

pi-web-access is an extension that provides web search (and more) for Pi coding agent. The latest update introduces a new UX pattern: you can hit `Ctrl+S` to intercept agent searches mid-flight to inspect and curate exactly what makes it into the agent conversation. pi install npm:pi-web-access

Nico Bailon

29,352 просмотров • 5 месяцев назад

Existing IR/RAG benchmarks are unrealistic: they’re often derived from easily retrievable topics, rather than grounded in solving real user problems. 🧵Introducing 𝐅𝐫𝐞𝐬𝐡𝐒𝐭𝐚𝐜𝐤, a challenging RAG benchmark on niche, recent topics. Work done during intern Databricks 🧱
0:25

Existing IR/RAG benchmarks are unrealistic: they’re often derived from easily retrievable topics, rather than grounded in solving real user problems. 🧵Introducing 𝐅𝐫𝐞𝐬𝐡𝐒𝐭𝐚𝐜𝐤, a challenging RAG benchmark on niche, recent topics. Work done during intern Databricks 🧱

Nandan Thakur

40,063 просмотров • 1 год назад

Announcing Agent S3 — our most advanced computer-use agent yet — achieving 69.9% on OSWorld, just shy of the 72% human benchmark. Today also marks one year since Simular launched the first generation of Agent S. From 20% to 69.9% in just twelve months. What a year. Let that sink in. 🧠💻 🧵👇
0:43

Announcing Agent S3 — our most advanced computer-use agent yet — achieving 69.9% on OSWorld, just shy of the 72% human benchmark. Today also marks one year since Simular launched the first generation of Agent S. From 20% to 69.9% in just twelve months. What a year. Let that sink in. 🧠💻 🧵👇

Ang Li

444,496 просмотров • 10 месяцев назад

The way this Paper Mario dialogue instantly activated me like a sleeper agent is INSANE
0:24

Sensitive content

The way this Paper Mario dialogue instantly activated me like a sleeper agent is INSANE

Sam

17,261 просмотров • 2 лет назад

How well do today’s frontier models handle long-horizon, multi-step web agent tasks, such as identifying the top 25 U.S. CS PhD programs with ML/AI faculty likely accepting students and compiling the results into a structured sheet? Check out our new work on Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks Paper: Leaderboard: We introduce Odysseys, a benchmark of 200 long-horizon tasks derived from real browsing sessions and evaluated on the live Internet. We show that binary pass/fail is inadequate in this setting and propose rubric-based evaluation, which better aligns with human judgment and provides more informative signals. Across leading models, the best achieves only 44.5% success, leaving substantial headroom. We further introduce a Trajectory Efficiency metric (rubric score per step) and find efficiency remains extremely low (1.15%), highlighting a key bottleneck. Odysseys provides a realistic benchmark for measuring progress toward web agents capable of sustained, efficient, real-world operation. See a more detailed thread by Jing Yu Koh.
1:12

How well do today’s frontier models handle long-horizon, multi-step web agent tasks, such as identifying the top 25 U.S. CS PhD programs with ML/AI faculty likely accepting students and compiling the results into a structured sheet? Check out our new work on Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks Paper: Leaderboard: We introduce Odysseys, a benchmark of 200 long-horizon tasks derived from real browsing sessions and evaluated on the live Internet. We show that binary pass/fail is inadequate in this setting and propose rubric-based evaluation, which better aligns with human judgment and provides more informative signals. Across leading models, the best achieves only 44.5% success, leaving substantial headroom. We further introduce a Trajectory Efficiency metric (rubric score per step) and find efficiency remains extremely low (1.15%), highlighting a key bottleneck. Odysseys provides a realistic benchmark for measuring progress toward web agents capable of sustained, efficient, real-world operation. See a more detailed thread by Jing Yu Koh.

Russ Salakhutdinov

22,518 просмотров • 3 месяцев назад

Introducing vision mode: now your coding agent can take screenshots and record videos of your web app! In the demo below, we asked Tidewave to implement a feature, record videos of the feature working on both desktop and mobile resolutions, and deliver them to Slack.
0:45

Introducing vision mode: now your coding agent can take screenshots and record videos of your web app! In the demo below, we asked Tidewave to implement a feature, record videos of the feature working on both desktop and mobile resolutions, and deliver them to Slack.

José Valim

11,923 просмотров • 3 месяцев назад