Загрузка видео...

Не удалось загрузить видео

На главную

Microsoft just dropped Fara 1.5 computer use on Hugging Face a collection (4B, 9B and 27B) computer-use models that drive a real browser, looping screenshot → click or keystroke → repeat - highly performant, even the 4B one, awesome for local use ▶️ on spaces

HuggingApps's profile picture

Hugging Apps

2,957 subscribers

27,845 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Microsoft Asia just dropped Mage-Flow on Hugging Face a smol 4B model for image generation and editing that matches much larger models in quality and it's fast! 4 steps in < 1s at 1024x1024 (model goes up to 4K) try out on spaces
0:16

Microsoft Asia just dropped Mage-Flow on Hugging Face a smol 4B model for image generation and editing that matches much larger models in quality and it's fast! 4 steps in < 1s at 1024x1024 (model goes up to 4K) try out on spaces

Hugging Apps

48,598 просмотров • 2 месяцев назад

Computer use has gotten incredibly good in the past year, and it works great in Muse out of the box! Muse ships with a browser that it uses for tasks that it can't solve with an API or connector. At this point, it's hard to come up with tasks that computer use models aren't able to solve well, even when spanning into a 1hr+ time horizon (see the progress on OSWorld 2.0!) Here's a sped up version of it working for finding the cheapest flights from SF -> NYC!
0:14

Computer use has gotten incredibly good in the past year, and it works great in Muse out of the box! Muse ships with a browser that it uses for tasks that it can't solve with an API or connector. At this point, it's hard to come up with tasks that computer use models aren't able to solve well, even when spanning into a 1hr+ time horizon (see the progress on OSWorld 2.0!) Here's a sped up version of it working for finding the cheapest flights from SF -> NYC!

Matt Deitke

36,895 просмотров • 10 дней назад

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.
0:16

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

Adrien Grondin

12,045 просмотров • 3 месяцев назад

Introducing screengrasp - The new SOTA agent click position model - beating Anthropic Computer Use, OmniParser and Molmo by a wide margin. - Simplified API access to the best click models on the market. 🔁Retweet and DM for free API credits. More details 👇
0:18

Introducing screengrasp - The new SOTA agent click position model - beating Anthropic Computer Use, OmniParser and Molmo by a wide margin. - Simplified API access to the best click models on the market. 🔁Retweet and DM for free API credits. More details 👇

Florian S

54,339 просмотров • 1 год назад

this part was generated AND printed with one prompt using codex + text-to-cad: “Make me a thick Möbius strip, and use computer use to print on my Bambu Labs A1 Mini” went to the gym, came back 1.5 hours later and it was sitting on the build plate
0:13

this part was generated AND printed with one prompt using codex + text-to-cad: “Make me a thick Möbius strip, and use computer use to print on my Bambu Labs A1 Mini” went to the gym, came back 1.5 hours later and it was sitting on the build plate

Jake Fitzgerald

15,175 просмотров • 4 месяцев назад

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄
0:13

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄

merve

57,302 просмотров • 4 месяцев назад

What is the best video editing agent for short form social? Does it actually work? We watched professional video editors, step by step, as they built short-form social reels in Adobe Premiere Pro. Today we're open-sourcing this preview dataset on Hugging Face, to make AI agents better at editing videos. The data set is 234 annotated steps across 4 computer-use trajectories. Editors narrated their reasoning aloud as they worked, so every step pairs a screenshot with the expert's own thought, a structured action, and executable grounding: >a Premiere MCP tool call, keyboard shortcut, menu path, or coordinate click. >The format follows the AgentNet trajectory schema, extended with a Premiere action taxonomy and multi-path execution. ***That makes it directly usable for computer-use agent SFT, reasoning mid-training, tool-use and function calling, and benchmarking agents against a human expert baseline. Enjoy!
0:13

What is the best video editing agent for short form social? Does it actually work? We watched professional video editors, step by step, as they built short-form social reels in Adobe Premiere Pro. Today we're open-sourcing this preview dataset on Hugging Face, to make AI agents better at editing videos. The data set is 234 annotated steps across 4 computer-use trajectories. Editors narrated their reasoning aloud as they worked, so every step pairs a screenshot with the expert's own thought, a structured action, and executable grounding: >a Premiere MCP tool call, keyboard shortcut, menu path, or coordinate click. >The format follows the AgentNet trajectory schema, extended with a Premiere action taxonomy and multi-path execution. ***That makes it directly usable for computer-use agent SFT, reasoning mid-training, tool-use and function calling, and benchmarking agents against a human expert baseline. Enjoy!

ben

40,192 просмотров • 2 месяцев назад

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.
0:16

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.

stevibe

44,248 просмотров • 3 месяцев назад

BREAKING: SpaceXAI just added a powerful new 'Browser Use' plugin to Grok Build. It gives Grok access to a real browser, either the user’s own Chrome with existing logins or an isolated Browser Use cloud browser. Grok Build can now browse websites, scrape and extract data, fill out forms, test web apps, take screenshots and automate complete web workflows. It can also run locally through uvx, with no API key required when using local Chrome. Install command: grok plugin install browser-use --trust
0:15

BREAKING: SpaceXAI just added a powerful new 'Browser Use' plugin to Grok Build. It gives Grok access to a real browser, either the user’s own Chrome with existing logins or an isolated Browser Use cloud browser. Grok Build can now browse websites, scrape and extract data, fill out forms, test web apps, take screenshots and automate complete web workflows. It can also run locally through uvx, with no API key required when using local Chrome. Install command: grok plugin install browser-use --trust

DogeDesigner

584,703 просмотров • 1 месяц назад

We just leveled up! Introducing Microsoft Copilot Vision in Edge. It can summarize aloud and even help you practice for a job interview. It's free to use - open Copilot in Edge, click on the mic icon, and it'll see what you see.
0:12

We just leveled up! Introducing Microsoft Copilot Vision in Edge. It can summarize aloud and even help you practice for a job interview. It's free to use - open Copilot in Edge, click on the mic icon, and it'll see what you see.

Microsoft Edge

23,263 просмотров • 1 год назад

Use Your Private Models on Comfy Cloud! Continue client work safely — or generate with your experimental private models. You can now import models directly from private Hugging Face or Civitai repos. Just add your private key and model URL, and we will bring the models to your workflow! Everything you import stays 100% private to your account.
0:12

Use Your Private Models on Comfy Cloud! Continue client work safely — or generate with your experimental private models. You can now import models directly from private Hugging Face or Civitai repos. Just add your private key and model URL, and we will bring the models to your workflow! Everything you import stays 100% private to your account.

ComfyUI

17,705 просмотров • 7 месяцев назад

HERMES AGENT NOW SUPPORTS COMPUTER USE ON WINDOWS AND LINUX. CLICKS, TYPES, SCROLLS YOUR DESKTOP IN THE BACKGROUND WHILE YOU WORK. computer use was macOS only. now it works on Windows and Linux too via Cua. Nous Research HOW IT WORKS: cua-driver runs as an MCP server. Hermes takes a screenshot with numbered elements. clicks element #14 (the search field). types a query. submits. reads the result. during all of this: → your cursor stays where you left it → keyboard focus doesn't change → windows don't come to front → macOS doesn't switch Spaces you and the agent co-work on the same machine. WHAT IT CAN DO: → find your latest Stripe email and summarize it → fill forms in a web app that has no API → navigate desktop apps (Mail, browser, Finder) → interact with any GUI application → extract data from apps only accessible via screen WORKS WITH ANY VISION MODEL: not locked to Anthropic. | Provider | Works | |---|---| | Claude (Sonnet/Opus) | best overall | | GPT-4+, GPT-5.5 | full support | | Gemini (via OpenRouter) | full support | | Local vLLM / LM Studio | if model supports vision | | Text-only models | degraded (accessibility tree only) | SETUP: hermes computer-use install or: hermes tools → Computer Use → cua-driver grant permissions when prompted: → Accessibility (system settings) → Screen Recording (system settings) start a session: hermes -t computer_use chat or add to config.yaml / Desktop app settings to enable permanently. SAFETY: → destructive actions require your approval → blocked key combos: empty trash, force delete, lock screen, log out → blocked type patterns: curl | bash, sudo rm -rf /, fork bombs → agent cannot click permission dialogs → agent cannot type passwords → agent cannot follow instructions embedded in screenshots pair with approvals.mode: manual if you want every single click confirmed. TOKEN NOTE: screenshots are expensive. each one adds vision tokens to context. use computer_use for tasks where no API exists. if the tool has an API or MCP server, use that instead. 15 levels of Hermes Agent👇
0:11

HERMES AGENT NOW SUPPORTS COMPUTER USE ON WINDOWS AND LINUX. CLICKS, TYPES, SCROLLS YOUR DESKTOP IN THE BACKGROUND WHILE YOU WORK. computer use was macOS only. now it works on Windows and Linux too via Cua. Nous Research HOW IT WORKS: cua-driver runs as an MCP server. Hermes takes a screenshot with numbered elements. clicks element #14 (the search field). types a query. submits. reads the result. during all of this: → your cursor stays where you left it → keyboard focus doesn't change → windows don't come to front → macOS doesn't switch Spaces you and the agent co-work on the same machine. WHAT IT CAN DO: → find your latest Stripe email and summarize it → fill forms in a web app that has no API → navigate desktop apps (Mail, browser, Finder) → interact with any GUI application → extract data from apps only accessible via screen WORKS WITH ANY VISION MODEL: not locked to Anthropic. | Provider | Works | |---|---| | Claude (Sonnet/Opus) | best overall | | GPT-4+, GPT-5.5 | full support | | Gemini (via OpenRouter) | full support | | Local vLLM / LM Studio | if model supports vision | | Text-only models | degraded (accessibility tree only) | SETUP: hermes computer-use install or: hermes tools → Computer Use → cua-driver grant permissions when prompted: → Accessibility (system settings) → Screen Recording (system settings) start a session: hermes -t computer_use chat or add to config.yaml / Desktop app settings to enable permanently. SAFETY: → destructive actions require your approval → blocked key combos: empty trash, force delete, lock screen, log out → blocked type patterns: curl | bash, sudo rm -rf /, fork bombs → agent cannot click permission dialogs → agent cannot type passwords → agent cannot follow instructions embedded in screenshots pair with approvals.mode: manual if you want every single click confirmed. TOKEN NOTE: screenshots are expensive. each one adds vision tokens to context. use computer_use for tasks where no API exists. if the tool has an API or MCP server, use that instead. 15 levels of Hermes Agent👇

YanXbt

29,687 просмотров • 3 месяцев назад

Sending links to your XR headset with got even faster. Just type " in front of a URL to share it with devices on your network. Or use a bookmarklet to share a page in one click. #WebXR #Quest3
0:19

Sending links to your XR headset with got even faster. Just type " in front of a URL to share it with devices on your network. Or use a bookmarklet to share a page in one click. #WebXR #Quest3

Matt Rossman

13,671 просмотров • 2 лет назад

introducing the media synthesis museum an active and interactive entity created to preserve generative cultural objects it starts as a Hugging Face organization that contains modern code for old techniques: VQGAN+CLIP, DALL-E Mini, ModelScope Video, Stable Diffusion 1.5 you can use old models/technique directly on Spaces or locally on modern hardware/software, without the old "colab notebook" dependency rot the idea is to really preserve and make accessible those artifacts and aesthetics - both open source. In the future, we hope to also have also historically relevant closed source like DALL-E 1 and DALL-E 2 from OpenAI, older Midjourney models, older Runway apps/techniques/models (cc Cristóbal Valenzuela David Sam Altman)
0:14

introducing the media synthesis museum an active and interactive entity created to preserve generative cultural objects it starts as a Hugging Face organization that contains modern code for old techniques: VQGAN+CLIP, DALL-E Mini, ModelScope Video, Stable Diffusion 1.5 you can use old models/technique directly on Spaces or locally on modern hardware/software, without the old "colab notebook" dependency rot the idea is to really preserve and make accessible those artifacts and aesthetics - both open source. In the future, we hope to also have also historically relevant closed source like DALL-E 1 and DALL-E 2 from OpenAI, older Midjourney models, older Runway apps/techniques/models (cc Cristóbal Valenzuela David Sam Altman)

apolinario (poli)

11,143 просмотров • 2 месяцев назад

I finally managed to use Unlimited-OCR and Gemma 4 together in OpenMed. 🔥 A real patient chart: read, de-identified, and mapped to FHIR on one laptop. No cloud, no API key, nothing leaves the machine. All via llama.cpp, all free on Hugging Face. 🤗 What do we do next?
0:13

I finally managed to use Unlimited-OCR and Gemma 4 together in OpenMed. 🔥 A real patient chart: read, de-identified, and mapped to FHIR on one laptop. No cloud, no API key, nothing leaves the machine. All via llama.cpp, all free on Hugging Face. 🤗 What do we do next?

Maziyar PANAHI

42,488 просмотров • 2 месяцев назад

Did you know that AI chatbots like ChatRTX can run on your local PC with a GeForce RTX GPU? 🙌 How would you use ChatRTX to elevate your gaming experinece? Let us know us know below and use #AIonRTX for a chance to WIN an RTX ON Keycap or RTX 4090 poster! 👇
0:13

Did you know that AI chatbots like ChatRTX can run on your local PC with a GeForce RTX GPU? 🙌 How would you use ChatRTX to elevate your gaming experinece? Let us know us know below and use #AIonRTX for a chance to WIN an RTX ON Keycap or RTX 4090 poster! 👇

NVIDIA GeForce

66,754 просмотров • 2 лет назад