Sensitive content

This media may contain sensitive content.

Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

llama.cpp with it's integrated WebUI is effectively the most lightweight and self-contained agent that you can run locally. Here are a few more examples of using Hugging Face MCP to search for models

Georgi Gerganov

59,006 subscribers

11,070 Aufrufe • vor 3 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You really can just do things! Use *any* Hugging Face space as a MCP server along with your Local Models! 🔥 Here in we use Qwen 3 30B A3B with ggml llama.cpp and Hugging Face tiny agents to create images via FLUX powered by ZeroGPU ⚡ It's quite a bit crazy to see local models be capable of so much and just be able to understand/ infer from tool description! There's a lot of potential here in automating video generation workflows, content curation and a lot more.. Bonus: you can plug any other Inference Provider if you don't want to run locally too! npx @ huggingface/tiny-agents run [TASK] oh, and we provide both typescript and python client! 🐐

You really can just do things! Use any Hugging Face space as a MCP server along with your Local Models! 🔥 Here in we use Qwen 3 30B A3B with ggml llama.cpp and Hugging Face tiny agents to create images via FLUX powered by ZeroGPU ⚡ It's quite a bit crazy to see local models be capable of so much and just be able to understand/ infer from tool description! There's a lot of potential here in automating video generation workflows, content curation and a lot more.. Bonus: you can plug any other Inference Provider if you don't want to run locally too! npx @ huggingface/tiny-agents run [TASK] oh, and we provide both typescript and python client! 🐐

Vaibhav (VB) Srivastav

39,113 Aufrufe • vor 1 Jahr

Wan 2.2 just launched! 1080p, 30fps, and the best part... It's open-source, and you can run it locally for FREE! Great work from Wan Here are a few quick examples I did:

Wan 2.2 just launched! 1080p, 30fps, and the best part... It's open-source, and you can run it locally for FREE! Great work from Wan Here are a few quick examples I did:

Alex Patrascu

45,621 Aufrufe • vor 11 Monaten

AI search for papers is here Search anything you want with papers Here are a few examples of what you can do: Semantically search by sentences & phrases. Example: evaluating factuality in LLM outputs Search by concepts. Example: latent diffusion Search by authors names. Example: Ilya Sutskever Hugging Face just crossed 50,000 papers (all the majors ones of the past two years should be covered), with dozens added every day & just enabled semantic search. It's becoming the best place to do collaborative research.

AI search for papers is here Search anything you want with papers Here are a few examples of what you can do: Semantically search by sentences & phrases. Example: evaluating factuality in LLM outputs Search by concepts. Example: latent diffusion Search by authors names. Example: Ilya Sutskever Hugging Face just crossed 50,000 papers (all the majors ones of the past two years should be covered), with dozens added every day & just enabled semantic search. It's becoming the best place to do collaborative research.

AK

35,896 Aufrufe • vor 1 Jahr

New short course: Open Source Models with Hugging Face 🤗, taught by Maria Khalusova, Marc Sun, and Younes Belkada! Hugging Face has been a game changer by letting you quickly grab any of hundreds of thousands of already-trained open source models to assemble into new applications. This course teaches you best practices for building this way, including how to search and choose among models. You’ll learn to use the Transformers library and walk through multiple models for text, audio, and image processing, including zero-shot image segmentation, zero-shot audio classification, and speech recognition. You'll also learn to use multimodal models for visual question answering, image search, and image captioning. Finally, you’ll learn how to demo what you build locally, on the cloud, or via an API using Gradio and Hugging Face Spaces. You can sign up here:

New short course: Open Source Models with Hugging Face 🤗, taught by Maria Khalusova, Marc Sun, and Younes Belkada! Hugging Face has been a game changer by letting you quickly grab any of hundreds of thousands of already-trained open source models to assemble into new applications. This course teaches you best practices for building this way, including how to search and choose among models. You’ll learn to use the Transformers library and walk through multiple models for text, audio, and image processing, including zero-shot image segmentation, zero-shot audio classification, and speech recognition. You'll also learn to use multimodal models for visual question answering, image search, and image captioning. Finally, you’ll learn how to demo what you build locally, on the cloud, or via an API using Gradio and Hugging Face Spaces. You can sign up here:

Andrew Ng

224,538 Aufrufe • vor 2 Jahren

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Xuan-Son Nguyen

973,573 Aufrufe • vor 1 Jahr

DeepSeek-R1. Now running *locally* on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

DeepSeek-R1. Now running locally on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

Umbrel ☂️

36,562 Aufrufe • vor 1 Jahr

You can run Kimi-K2-Thinking, the most strongest agentic model, in Jan through Hugging Face. Add it to your Hugging Face Inference models to use it.

You can run Kimi-K2-Thinking, the most strongest agentic model, in Jan through Hugging Face. Add it to your Hugging Face Inference models to use it.

👋 Jan

40,181 Aufrufe • vor 8 Monaten

3. Agent factory: Foundry is the complete app platform for building apps and agents. We are adding support for more models from Grok, Hugging Face, Meta, Mistral, and more. Plus: Agentic retrieval in Azure AI Search, Foundry Agent Service, integration with Copilot Studio, and more. And we are ensuring the tools you already use for identity, management, and security will now all extend to agents too. The NFL has already used Foundry, along with our data stack, to run its recent Combine.

3. Agent factory: Foundry is the complete app platform for building apps and agents. We are adding support for more models from Grok, Hugging Face, Meta, Mistral, and more. Plus: Agentic retrieval in Azure AI Search, Foundry Agent Service, integration with Copilot Studio, and more. And we are ensuring the tools you already use for identity, management, and security will now all extend to agents too. The NFL has already used Foundry, along with our data stack, to run its recent Combine.

Satya Nadella

180,396 Aufrufe • vor 1 Jahr

Introducing Lucy: 1.7B model that Google for you It's an agentic‑search model that can even run on your phone. - Agentic search on tap - Lucy calls tools ( ‑aware) - Fits in your pocket - runs on CPU or mobile Under the hood: - Built on Qwen's Qwen3‑1.7B - Smooth multi‑category rewards replace brittle if‑else scoring - Task‑vector RLVR optimizes the "thinking" tag for targeted search moves. Benchmarks: - SimpleQA + MCP = 78.3 - Close to Jan‑Nano-4B (80.7) Run locally: - Demo uses vLLM in Jan - You can spin it up with Georgi Gerganov's llama.cpp or vLLM Models on Hugging Face: - Lucy 1.7B 40k: - Lucy 1.7B 128K:

Introducing Lucy: 1.7B model that Google for you It's an agentic‑search model that can even run on your phone. - Agentic search on tap - Lucy calls tools ( ‑aware) - Fits in your pocket - runs on CPU or mobile Under the hood: - Built on Qwen's Qwen3‑1.7B - Smooth multi‑category rewards replace brittle if‑else scoring - Task‑vector RLVR optimizes the "thinking" tag for targeted search moves. Benchmarks: - SimpleQA + MCP = 78.3 - Close to Jan‑Nano-4B (80.7) Run locally: - Demo uses vLLM in Jan - You can spin it up with Georgi Gerganov's llama.cpp or vLLM Models on Hugging Face: - Lucy 1.7B 40k: - Lucy 1.7B 128K:

Menlo Research

20,205 Aufrufe • vor 11 Monaten

I can search a database with 32 million records in less than 50 milliseconds. This speed is insane! There's no reason your search is slow. There's no reason you aren't using this library when building applications with a lot of data. Take a look at typesense |. It's an open-source search engine. It's crazy fast and easy to use. They are sponsoring this post. Here is their GitHub repository: You can use the library in Python, JavaScript, PHP, Ruby, Swift, and pretty much any other programming language out there. Here are some of the things you can do with Typesense: • Vector search over embeddings • Conversational search for RAG applications • Image similarity search • Voice search And it does all of this extremely fast. A few interesting notes about the library: • Optimized for developer happiness • Works out of the box for most use cases • Very intuitive API • Easy to deploy and scale Probably the best way to compare them is against ElasticSearch. The latter is much more complex to configure and run with a steep learning curve. Check their GitHub repository. They have examples, tutorials, and everything you need.

I can search a database with 32 million records in less than 50 milliseconds. This speed is insane! There's no reason your search is slow. There's no reason you aren't using this library when building applications with a lot of data. Take a look at typesense |. It's an open-source search engine. It's crazy fast and easy to use. They are sponsoring this post. Here is their GitHub repository: You can use the library in Python, JavaScript, PHP, Ruby, Swift, and pretty much any other programming language out there. Here are some of the things you can do with Typesense: • Vector search over embeddings • Conversational search for RAG applications • Image similarity search • Voice search And it does all of this extremely fast. A few interesting notes about the library: • Optimized for developer happiness • Works out of the box for most use cases • Very intuitive API • Easy to deploy and scale Probably the best way to compare them is against ElasticSearch. The latter is much more complex to configure and run with a steep learning curve. Check their GitHub repository. They have examples, tutorials, and everything you need.

Santiago

160,154 Aufrufe • vor 1 Jahr

It's here! The ultimate course on Humanitarian Use of OpenStreetMap Data! 🎓 🗺️ 💻 A free, self-paced, online, and self-contained training that will equip you with the skills to start using open map data for humanitarian purposes. Sign up today here:

It's here! The ultimate course on Humanitarian Use of OpenStreetMap Data! 🎓 🗺️ 💻 A free, self-paced, online, and self-contained training that will equip you with the skills to start using open map data for humanitarian purposes. Sign up today here:

Humanitarian OpenStreetMap Team

10,325 Aufrufe • vor 1 Jahr

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

dylan

27,390 Aufrufe • vor 1 Jahr

You can now run Claude Code locally for FREE. → Using open-source models → Locally and fully private → Full agent + tool workflows Here's the FULL step-by-step tutorial to get it all set up in less than 10 minutes:

You can now run Claude Code locally for FREE. → Using open-source models → Locally and fully private → Full agent + tool workflows Here's the FULL step-by-step tutorial to get it all set up in less than 10 minutes:

Alvaro Cintas

1,315,865 Aufrufe • vor 5 Monaten

You can now run supermemory locally. Introducing the supermemory local - Fully self-contained. Comes with our graph engine, embedding model, etc. - Run on any machine, with your OpenClaw🦞, hermes, claude, etc. - SDKs to add memory to your agent, or build your company brain.

You can now run supermemory locally. Introducing the supermemory local - Fully self-contained. Comes with our graph engine, embedding model, etc. - Run on any machine, with your OpenClaw🦞, hermes, claude, etc. - SDKs to add memory to your agent, or build your company brain.

Dhravya Shah

643,395 Aufrufe • vor 26 Tagen

GitHub agents are live on Zola. using MCP servers (git-mcp), you can chat with any repo, fetch docs, search code, and more. demo with prompt-kit repo

GitHub agents are live on Zola. using MCP servers (git-mcp), you can chat with any repo, fetch docs, search code, and more. demo with prompt-kit repo

Ibelick

10,964 Aufrufe • vor 1 Jahr

figuring out how to upgrade go version using gpt-oss:120b, ollama's web search MCP server, and OpenAI codex open source models for coding are here

figuring out how to upgrade go version using gpt-oss:120b, ollama's web search MCP server, and OpenAI codex open source models for coding are here

parth

37,958 Aufrufe • vor 9 Monaten

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k context length), fine-tuned for reasoning and tool use in Jan. You can run the model in Jan, llama.cpp, or vLLM. To enable search in Jan, go to Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper. Use the model: - Jan-v1-4B: - Jan-v1-4B-GGUF: Credit to the Qwen team for Qwen3 4B Thinking & Georgi Gerganov for llama.cpp.

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k context length), fine-tuned for reasoning and tool use in Jan. You can run the model in Jan, llama.cpp, or vLLM. To enable search in Jan, go to Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper. Use the model: - Jan-v1-4B: - Jan-v1-4B-GGUF: Credit to the Qwen team for Qwen3 4B Thinking & Georgi Gerganov for llama.cpp.

👋 Jan

690,215 Aufrufe • vor 10 Monaten

Microsoft CTO Kevin Scott says MCP is becoming the HTTP of the agentic web. Like HTTP, it's lightweight, composable, and interoperable. Microsoft is betting on MCP as the backbone for agent communication, scale, and evolution.

Microsoft CTO Kevin Scott says MCP is becoming the HTTP of the agentic web. Like HTTP, it's lightweight, composable, and interoperable. Microsoft is betting on MCP as the backbone for agent communication, scale, and evolution.

vitrupo

115,827 Aufrufe • vor 1 Jahr

Introducing Agent Wikis! I've been using llm wikis (or knowledge bases) for research and videos for a while to ensure the information I'm providing is always up-to-date and accurate. Now you can access them for free! Just point your agent at to access wikis on many topics, including Hermes Agent, Hyperframes, Google Ads, and llama.cpp. They can be queried through a simple MCP server. Everything has been designed to be agent-friendly and lightweight (no context bloat). This is a beta release, so please let me know of any bugs or issues (I'm sure there are one or two). You can also join the waitlist if you would like us to create and maintain your own private wiki, or if you are a project owner you can request one for your project to make sure your users (and their agents) don't run into any common issues (and also be featured on the site). Thank you!

Introducing Agent Wikis! I've been using llm wikis (or knowledge bases) for research and videos for a while to ensure the information I'm providing is always up-to-date and accurate. Now you can access them for free! Just point your agent at to access wikis on many topics, including Hermes Agent, Hyperframes, Google Ads, and llama.cpp. They can be queried through a simple MCP server. Everything has been designed to be agent-friendly and lightweight (no context bloat). This is a beta release, so please let me know of any bugs or issues (I'm sure there are one or two). You can also join the waitlist if you would like us to create and maintain your own private wiki, or if you are a project owner you can request one for your project to make sure your users (and their agents) don't run into any common issues (and also be featured on the site). Thank you!

tonbi

19,167 Aufrufe • vor 24 Tagen

We just launched Fulfil x MCP integration with Claude Now you can ask Fulfil questions that actually matter and get answers in seconds. It takes few seconds to setup and here are some examples of questions you could be asking 👇

We just launched Fulfil x MCP integration with Claude Now you can ask Fulfil questions that actually matter and get answers in seconds. It takes few seconds to setup and here are some examples of questions you could be asking 👇

Sharoon Thomas

20,998 Aufrufe • vor 11 Monaten