正在加载视频...

视频加载失败

Microsoft silently updated OmniParser on the hub 👀 60% faster than v1 - sub-second latency on a 4090! "OmniParser is a general screen parsing tool, which interprets/converts UI screenshot to structured format, to improve existing LLM based UI agent." Bonus: you can try it out for free!

95,750 次观看 • 1 年前 •via X (Twitter)

11 条评论

Vaibhav (VB) Srivastav 的头像
Vaibhav (VB) Srivastav1 年前

Model checkpoint:

Vaibhav (VB) Srivastav 的头像
Vaibhav (VB) Srivastav1 年前

Try out the model for free here:

AssemblyAI 的头像
AssemblyAI1 年前

Our speech-to-text models are the most accurate on the market with top rankings across industry benchmarks. - The highest accuracy rates—up to 95% - Up to 30% fewer hallucinations than other leaders - Low latency—63 minutes converts in 35 seconds Try via API for free today 👇

Rohith 的头像
Rohith1 年前

Super hard to use omnitool and its very slow even on my 4080. Like taking 1min+ just for the Image parsing.

Vaibhav (VB) Srivastav 的头像
Vaibhav (VB) Srivastav1 年前

are you using the GPU, could be that you're running the op via CPU

moonbi 🇪🇺🪢 的头像
moonbi 🇪🇺🪢1 年前

The problem is u need huge gpu till run it

Cybersphere AI 的头像
Cybersphere AI1 年前

Setup is a nightmare on Windows. The setup is: FUSE-based (horribly slow) Assumes Linux KVM is present (Not true on Windows) Not built with Windows users in mind (requiring modifications to scripts) The devs need to release a setup procedure optimised for Windows.

Shabah 的头像
Shabah1 年前

This is really interesting

Electe 的头像
Electe1 年前

@huggingface @huggingface, incredible improvements with OmniParser. Speed like this can truly enhance workflows and drive productivity. 🚀 #Innovation

Tenkaizen 的头像
Tenkaizen1 年前

That's impressive progress. Faster parsing opens up so many possibilities for UI agents

Korey 🧘🏾‍♂️ 的头像
Korey 🧘🏾‍♂️1 年前

such a project, want to build some code samples with this.

相关视频

AG-UI makes building agentic applications dramatically easier. Here's how it works. This is a model for a simple chatbot: User → LLM → Response But interactive agents that render UI, pause for approvals, and ask users for input need a much more complex model. When building these agents, a response from the LLM will include a series of state changes as the agent runs: • Agent started a task • Agent called a tool • Agent updated its state • Agent streams these tokens • Agent is waiting on a human • Agent is resuming the task The Agent-User Interaction Protocol (AG-UI) treats the LLM response as a stream of events rather than a text endpoint. In practice, here is what you get as an agent runs: 1. Lifecycle events so your UI knows where the agent is. 2. Text messages that stream tokens. 3. Tool calls so your UI can prefill a form with any required arguments. 4. State updates that keep your UI in sync with the agent. 5. Special events for human approvals, rich media, and custom needs. All of these events travel over standard transports (SSE, WebSockets, or plain HTTP) as JSON. As a result, you can build a frontend that stays in sync with the agent's progress without having to invent a custom process to make this happen. For example, building a human-in-the-loop workflow becomes an off-the-shelf component you can integrate rather than build from scratch. CopilotKit🪁 is the creator of AG-UI, and you can use it when building frontend applications pretty much anywhere: • React • Angular • Vue • React Native • Slack • Teams • Discord • WhatsApp • Telegram Here is the link for you to check it out: Thanks to the CopilotKit team for partnering with me on this post.

Santiago

17,438 次观看 • 10 天前