Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k...

691,054 Aufrufe • vor 1 Jahr •via X (Twitter)

56 Kommentare

Profilbild von Can.
Can.vor 1 Jahr

@ollama see how easy it is to give credit to @ggerganov and llama.cpp?

Profilbild von Frits Karl
Frits Karlvor 1 Jahr

Not working: "Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper."

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

It's likely the model doesn’t have permission to use the MCP. - Go to Settings-> Model Providers -> llama.cpp - Find Jan v1 and click the pencil icon - In the settings panel, turn on Tools under Capabilities See the video.

Profilbild von Light 🧩🦅❤️
Light 🧩🦅❤️vor 1 Jahr

@FritsKarl My app do not have this @jandotai

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

@Bellaminiop @FritsKarl oh, the model should have permission to use the MCP. Please see how:

Profilbild von Light 🧩🦅❤️
Light 🧩🦅❤️vor 1 Jahr

@FritsKarl I can't click "Tool", my laptop is macbook. I just install Jan AI today

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

@Bellaminiop @FritsKarl Oh, how come? Are you on an Intel MacBook? Quick note, you can update the model permissions in Settings -> Model Providers -> llama.cpp

Profilbild von Light 🧩🦅❤️
Light 🧩🦅❤️vor 1 Jahr

@FritsKarl My macbook use chip M series. I turn on Tools but its didn't work

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

You should see a gear icon next to the model name in your chats once Tools are activated and enabled. Please watch this video and make sure your Jan is set up this way.

Profilbild von Alex Volkov
Alex Volkovvor 1 Jahr

Congrats on the impressive score! 🔥 We'll cover this on this weeks @thursdai_pod , would you guys like to come on and tell us about this model ?

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

@thursdai_pod Thanks a lot! We'd be happy to join. Jan v1 co-author @alandao_ai will be around to talk about the model.

Profilbild von Alan
Alanvor 1 Jahr

@altryne @thursdai_pod Cool, see you guys soon!

Profilbild von Alex Volkov
Alex Volkovvor 1 Jahr

@jandotai @thursdai_pod awesome! can you follow me so I can send a DM with details?

Profilbild von TimRambo🐧
TimRambo🐧vor 1 Jahr

This is so awesome! Finally, Open-Source is finally fighting back, and I know Open-Source will crush everything in its path! 👊😎

Profilbild von Vashisht
Vashishtvor 1 Jahr

Is this available in ollama

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

Hey @ollama, could you give us a hand?

Profilbild von Melvin Vivas
Melvin Vivasvor 1 Jahr

wow, should integrate this with @aibackends. is it available in @openrouter?

Profilbild von Meet Patel
Meet Patelvor 1 Jahr

What does it use for doing actual web search? Like Brave, Google or anything like that?

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

You can run it with any Search MCP, such as @serperapi or @ExaAILabs.

Profilbild von Hugo Duprez
Hugo Duprezvor 1 Jahr

@ggerganov Awesome, local AI ftw!

Profilbild von Team Reagent
Team Reagentvor 1 Jahr

We support this! Locally running AI agents is more private and secure than whatever Perplexity lies about to their audience. We'll be testing with this and maybe providing some better results as we fine tune it ourselves in our Tetra agent!

Profilbild von Kristian Shultz-Mayer
Kristian Shultz-Mayervor 1 Jahr

Could you please tell me when you will launch a website for accessing the model?

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

Jan Web is on the way 🙌

Profilbild von Kris Krakowiak
Kris Krakowiakvor 1 Jahr

Does it support MLX?

Profilbild von Shojaei
Shojaeivor 1 Jahr

this is awesome 🔥

Profilbild von Singularity Age
Singularity Agevor 1 Jahr

Nice. Is it possible to use your own Internet connection for search and webpage scraping?

Profilbild von Alex
Alexvor 1 Jahr

@huggingface 91% accuracy? cute. my basement AI gets 420% by injecting memes directly into its training data. open source is based tho, now we can finally teach these models proper shitposting instead of that corporate sanitized nonsense. bullish on chaos 📈🤖

Profilbild von Le Techno-archéologue
Le Techno-archéologuevor 1 Jahr

If this is true... The Holy toaster will be angry 🍞⚡

Profilbild von The Mandorlarian
The Mandorlarianvor 1 Jahr

Fkn unreal, 91% 🤩🔥? You guys keep delivering! Is this you as well, @alandao_ai ?

Profilbild von Aon
Aonvor 1 Jahr

Congratulations 🎈🍾

Profilbild von Himanshu Kumar
Himanshu Kumarvor 1 Jahr

Open source alternatives are truly democratizing AI. This could significantly lower the barrier to entry for many. Exciting to see such progress.

Profilbild von Mo. | مُحَمَّدْ
Mo. | مُحَمَّدْvor 1 Jahr

I love you guys 😍

Profilbild von Quantyverse
Quantyversevor 1 Jahr

That is impressive! I am going to try it out. The accuracy for such a small model is awesome!

Profilbild von Josef Moucachen
Josef Moucachenvor 1 Jahr

wow this is amazing

Profilbild von Alan
Alanvor 1 Jahr

It's amazing to see such positive response from the community for the model. Thank you guys.

Profilbild von Front_Girl001
Front_Girl001vor 1 Jahr

@AskPerplexity what do you think? Compare your pro model performance against this and tell the results. Are you cooked?

Profilbild von rahul
rahulvor 1 Jahr

Hey team @jandotai , Any alternative to serper? Also this helped to setup the tools 👇 Thanks :) Love the work!!!

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

You're welcome 🙌 Jan supports MCP servers as an experimental feature, so you can add any search MCP to use with Jan v1.

Profilbild von rahul
rahulvor 1 Jahr

Ah, That makes sense.

Profilbild von Pranav
Pranavvor 1 Jahr

Any benchmarks on response speed?

Profilbild von Anderson452
Anderson452vor 1 Jahr

Besides those options, is there anything else I need to configure for it to work? I'm new to MCP.

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

We're also experimenting with MCPs. - Go to Settings & turn on Experimental Features - Under MCP Servers in Settings, enable Serper & add your API key, or choose a different search MCP - Go to Model Providers -> llama.cpp, find Jan v1 turn on Tools

Profilbild von M Maarouf
M Maaroufvor 1 Jahr

@MrAnderson452 Followed all the instructions and the wrench did show up, however, it fails to search online and in the output always says it got 403 errors. Do I need to get serper api key or something for it to work?

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

@MrAnderson452 Yes, you'll need to add a search MCP (e.g. @serperapi) for online search to work.

Profilbild von Sports Culture
Sports Culturevor 1 Jahr

Very cool!

Profilbild von dhiyaan
dhiyaanvor 1 Jahr

wow!

Profilbild von somecontextsuburbia
somecontextsuburbiavor 1 Jahr

Great work folks! Very happy with your progress 🙌

Profilbild von Andres Franco
Andres Francovor 1 Jahr

Seems like a pretty interesting tool.

Profilbild von KI-CREW
KI-CREWvor 1 Jahr

nice thank you

Profilbild von Hitarth Sharma
Hitarth Sharmavor 1 Jahr

@grok what exactly does Jan v1 do if the actual search is being done by serper or exa?

Profilbild von JM
JMvor 1 Jahr

I am trying to activate mcp it does not work.

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

Please follow the steps here:

Profilbild von JM
JMvor 1 Jahr

got it, it works!

Profilbild von 👋 Jan
👋 Janvor 1 Jahr

Awesome!

Profilbild von Gagan Ghotra
Gagan Ghotravor 1 Jahr

@zaidmukaddam 👀👀

Profilbild von omensec🇮🇳
omensec🇮🇳vor 1 Jahr

Cool!!

Ähnliche Videos

MCP is an absolute game-changer. (Together with DeepSeek, MCP is probably the hottest thing in AI over the last 6 months.) I use Cursor to write code 90% of the time. I built an MCP server to connect the Cursor agent to GroundX, an open-source RAG system, and I'm not going back. This is officially insane! Here is what I did, step by step: First, a little bit of context. I maintain an end-to-end Machine Learning System with several pipelines to process data, train, evaluate, register, deploy, and monitor a model. I've written a lot of documentation explaining how the system works and how to modify and maintain it. There's also the documentation of the few libraries I used to build the system. I'm a massive fan of GroundX, an open-source enterprise-grade RAG system you can run on your servers or deploy to any cloud provider. I've been working with them for a long time. GroundX offers two services. First, the "ingest" service uses a custom, pretrained vision model to ingest and understand your data. I used this to process all the documentation I have for my code. Markdown files, source code, HTML files, and even PDF documents. Everything I've written related to my project went into GroundX. Their second service is "search," which combines text and vector search with a fine-tuned re-ranker model to retrieve information from the data. I needed to connect Cursor with this service, and that's where MCP came in. I built an MCP server with two tools: 1. The first tool would go to GroundX and retrieve the available topics. Splitting the data into topics (or "buckets," as GroundX calls them) allows me to use the same setup to serve documentation from different topics. 2. The second tool would search GroundX under a specific topic for the context related to the supplied query. The magic happens after connecting the MCP server with Cursor. Now, I can ask any questions related to my project, and Cursor's AI agent retrieves the list of available topics from the RAG system and then searches it to provide relevant context to the model. I went from getting mediocre, sometimes wrong answers to 100% truthful, complete answers. Here is the crazy part:

Santiago

255,596 Aufrufe • vor 1 Jahr