Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Ego2Web A Web Agent Benchmark Grounded in Egocentric Videos paper:

_akhaliq's profile picture

AK

502,900 subscribers

17,013 Aufrufe • vor 2 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!
1:25

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!

Xin Eric Wang

11,482 Aufrufe • vor 1 Monat

EgoLifter Open-world 3D Segmentation for Egocentric Perception In this paper we present EgoLifter, a novel system that can automatically segment scenes captured from egocentric sensors into a complete decomposition of individual 3D objects. The system is specifically
0:20

EgoLifter Open-world 3D Segmentation for Egocentric Perception In this paper we present EgoLifter, a novel system that can automatically segment scenes captured from egocentric sensors into a complete decomposition of individual 3D objects. The system is specifically

AK

41,117 Aufrufe • vor 2 Jahren

🛑📢 HD-EPIC: A Highly-Detailed Egocentric Video Dataset New collected videos 263 annotations/min: recipe, nutrition, actions, sounds, 3D object movement &fixture associations, masks. 26K VQA benchmark to challenge current VLMs 1/N
1:50

🛑📢 HD-EPIC: A Highly-Detailed Egocentric Video Dataset New collected videos 263 annotations/min: recipe, nutrition, actions, sounds, 3D object movement &fixture associations, masks. 26K VQA benchmark to challenge current VLMs 1/N

Dima Damen

20,952 Aufrufe • vor 1 Jahr

How capable are web agents at solving knowledge work tasks? 🤔 Are LLMs up to the challenge? 🤖 Introducing WorkArena: a benchmark where agents meet the world 𝘸𝘪𝘭𝘥 web of enterprise software 🌐🖥️ Paper: Website: 🧵 1/7
0:25

How capable are web agents at solving knowledge work tasks? 🤔 Are LLMs up to the challenge? 🤖 Introducing WorkArena: a benchmark where agents meet the world 𝘸𝘪𝘭𝘥 web of enterprise software 🌐🖥️ Paper: Website: 🧵 1/7

Alexandre Lacoste

24,504 Aufrufe • vor 2 Jahren

we are kicking off Paper video tutorials in a big way! upcoming videos will cover our pen tool and tokens launches and new agent model explorations what else would you like to see?
3:36

we are kicking off Paper video tutorials in a big way! upcoming videos will cover our pen tool and tokens launches and new agent model explorations what else would you like to see?

Paper

27,371 Aufrufe • vor 20 Tagen

1️⃣ Ego-Exo4D A new foundational dataset + benchmark suite to support research on video learning & multimodal perception, co-developed with 14 university partners. Details ➡️ Core to the work is videos of skilled human activities, simultaneously capturing both first-person "egocentric" + multiple “exocentric” views.
2:51

1️⃣ Ego-Exo4D A new foundational dataset + benchmark suite to support research on video learning & multimodal perception, co-developed with 14 university partners. Details ➡️ Core to the work is videos of skilled human activities, simultaneously capturing both first-person "egocentric" + multiple “exocentric” views.

AI at Meta

133,666 Aufrufe • vor 2 Jahren

Today we’re releasing Ramp SWE-Bench: a private, production-grounded coding benchmark created from real engineering problems we've faced at Ramp.
0:27

Today we’re releasing Ramp SWE-Bench: a private, production-grounded coding benchmark created from real engineering problems we've faced at Ramp.

Ramp Labs

170,595 Aufrufe • vor 5 Tagen

introducing Egocentric-1M. the largest egocentric video dataset in the world, and our next step in building the internet for physical AI.
1:02

introducing Egocentric-1M. the largest egocentric video dataset in the world, and our next step in building the internet for physical AI.

Eddy Xu

330,535 Aufrufe • vor 2 Monaten

From egocentric glove data to a MANO hand model, replayed in Rerun.
0:28

From egocentric glove data to a MANO hand model, replayed in Rerun.

Yu Xiang

39,229 Aufrufe • vor 5 Monaten

Cool research by Reality Labs at Meta to allow touch typing on any surface using egocentric camera-based hand-tracking as input. Full paper here:
1:27

Cool research by Reality Labs at Meta to allow touch typing on any surface using egocentric camera-based hand-tracking as input. Full paper here:

jessica

34,280 Aufrufe • vor 1 Jahr

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.
1:21

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.

AI at Meta

33,607 Aufrufe • vor 1 Jahr

Anything you can do in Notion, your agent can do… on mobile. Before, Agent on mobile ran in a web view. Now, it’s native, faster, so quick ideas don’t have to wait.
0:20

Anything you can do in Notion, your agent can do… on mobile. Before, Agent on mobile ran in a web view. Now, it’s native, faster, so quick ideas don’t have to wait.

Notion

60,936 Aufrufe • vor 6 Monaten

Sprint planner agent: don’t create/move your tickets manually, let your agent take care of them Designed in Paper, animation with Motion inside Zed
0:24

Sprint planner agent: don’t create/move your tickets manually, let your agent take care of them Designed in Paper, animation with Motion inside Zed

Jeet

29,818 Aufrufe • vor 28 Tagen

pi-web-access is an extension that provides web search (and more) for Pi coding agent. The latest update introduces a new UX pattern: you can hit `Ctrl+S` to intercept agent searches mid-flight to inspect and curate exactly what makes it into the agent conversation. pi install npm:pi-web-access
0:34

pi-web-access is an extension that provides web search (and more) for Pi coding agent. The latest update introduces a new UX pattern: you can hit `Ctrl+S` to intercept agent searches mid-flight to inspect and curate exactly what makes it into the agent conversation. pi install npm:pi-web-access

Nico Bailon

29,352 Aufrufe • vor 3 Monaten

Existing IR/RAG benchmarks are unrealistic: they’re often derived from easily retrievable topics, rather than grounded in solving real user problems. 🧵Introducing 𝐅𝐫𝐞𝐬𝐡𝐒𝐭𝐚𝐜𝐤, a challenging RAG benchmark on niche, recent topics. Work done during intern Databricks 🧱
0:25

Existing IR/RAG benchmarks are unrealistic: they’re often derived from easily retrievable topics, rather than grounded in solving real user problems. 🧵Introducing 𝐅𝐫𝐞𝐬𝐡𝐒𝐭𝐚𝐜𝐤, a challenging RAG benchmark on niche, recent topics. Work done during intern Databricks 🧱

Nandan Thakur

40,063 Aufrufe • vor 1 Jahr

Announcing Agent S3 — our most advanced computer-use agent yet — achieving 69.9% on OSWorld, just shy of the 72% human benchmark. Today also marks one year since Simular launched the first generation of Agent S. From 20% to 69.9% in just twelve months. What a year. Let that sink in. 🧠💻 🧵👇
0:43

Announcing Agent S3 — our most advanced computer-use agent yet — achieving 69.9% on OSWorld, just shy of the 72% human benchmark. Today also marks one year since Simular launched the first generation of Agent S. From 20% to 69.9% in just twelve months. What a year. Let that sink in. 🧠💻 🧵👇

Ang Li

444,496 Aufrufe • vor 8 Monaten

The way this Paper Mario dialogue instantly activated me like a sleeper agent is INSANE
0:24

Sensitive content

The way this Paper Mario dialogue instantly activated me like a sleeper agent is INSANE

Sam

17,261 Aufrufe • vor 2 Jahren

How well do today’s frontier models handle long-horizon, multi-step web agent tasks, such as identifying the top 25 U.S. CS PhD programs with ML/AI faculty likely accepting students and compiling the results into a structured sheet? Check out our new work on Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks Paper: Leaderboard: We introduce Odysseys, a benchmark of 200 long-horizon tasks derived from real browsing sessions and evaluated on the live Internet. We show that binary pass/fail is inadequate in this setting and propose rubric-based evaluation, which better aligns with human judgment and provides more informative signals. Across leading models, the best achieves only 44.5% success, leaving substantial headroom. We further introduce a Trajectory Efficiency metric (rubric score per step) and find efficiency remains extremely low (1.15%), highlighting a key bottleneck. Odysseys provides a realistic benchmark for measuring progress toward web agents capable of sustained, efficient, real-world operation. See a more detailed thread by Jing Yu Koh.
1:12

How well do today’s frontier models handle long-horizon, multi-step web agent tasks, such as identifying the top 25 U.S. CS PhD programs with ML/AI faculty likely accepting students and compiling the results into a structured sheet? Check out our new work on Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks Paper: Leaderboard: We introduce Odysseys, a benchmark of 200 long-horizon tasks derived from real browsing sessions and evaluated on the live Internet. We show that binary pass/fail is inadequate in this setting and propose rubric-based evaluation, which better aligns with human judgment and provides more informative signals. Across leading models, the best achieves only 44.5% success, leaving substantial headroom. We further introduce a Trajectory Efficiency metric (rubric score per step) and find efficiency remains extremely low (1.15%), highlighting a key bottleneck. Odysseys provides a realistic benchmark for measuring progress toward web agents capable of sustained, efficient, real-world operation. See a more detailed thread by Jing Yu Koh.

Russ Salakhutdinov

22,404 Aufrufe • vor 1 Monat

Introducing vision mode: now your coding agent can take screenshots and record videos of your web app! In the demo below, we asked Tidewave to implement a feature, record videos of the feature working on both desktop and mobile resolutions, and deliver them to Slack.
0:45

Introducing vision mode: now your coding agent can take screenshots and record videos of your web app! In the demo below, we asked Tidewave to implement a feature, record videos of the feature working on both desktop and mobile resolutions, and deliver them to Slack.

José Valim

11,879 Aufrufe • vor 2 Monaten

Agents with gpt-4o from scratch 🔥 in 11 minutes we'll build: 🌎 Web Search Agent (2:40) 📈 Finance Agent (3:30) 🫡 Hackernews Agent (5:50) 📊 Data Analysis Agent (8:10) 🗒️ Research Agent (9:35) code:
11:27

Agents with gpt-4o from scratch 🔥 in 11 minutes we'll build: 🌎 Web Search Agent (2:40) 📈 Finance Agent (3:30) 🫡 Hackernews Agent (5:50) 📊 Data Analysis Agent (8:10) 🗒️ Research Agent (9:35) code:

Ashpreet Bedi

697,070 Aufrufe • vor 2 Jahren