Loading video...

Video Failed to Load

Go Home

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k...

691,054 views • 1 year ago •via X (Twitter)

56 Comments

Can.'s profile picture
Can.1 year ago

@ollama see how easy it is to give credit to @ggerganov and llama.cpp?

Frits Karl's profile picture
Frits Karl1 year ago

Not working: "Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper."

👋 Jan's profile picture
👋 Jan1 year ago

It's likely the model doesn’t have permission to use the MCP. - Go to Settings-> Model Providers -> llama.cpp - Find Jan v1 and click the pencil icon - In the settings panel, turn on Tools under Capabilities See the video.

Light 🧩🦅❤️'s profile picture
Light 🧩🦅❤️1 year ago

@FritsKarl My app do not have this @jandotai

👋 Jan's profile picture
👋 Jan1 year ago

@Bellaminiop @FritsKarl oh, the model should have permission to use the MCP. Please see how:

Light 🧩🦅❤️'s profile picture
Light 🧩🦅❤️1 year ago

@FritsKarl I can't click "Tool", my laptop is macbook. I just install Jan AI today

👋 Jan's profile picture
👋 Jan1 year ago

@Bellaminiop @FritsKarl Oh, how come? Are you on an Intel MacBook? Quick note, you can update the model permissions in Settings -> Model Providers -> llama.cpp

Light 🧩🦅❤️'s profile picture
Light 🧩🦅❤️1 year ago

@FritsKarl My macbook use chip M series. I turn on Tools but its didn't work

👋 Jan's profile picture
👋 Jan1 year ago

You should see a gear icon next to the model name in your chats once Tools are activated and enabled. Please watch this video and make sure your Jan is set up this way.

Alex Volkov's profile picture
Alex Volkov1 year ago

Congrats on the impressive score! 🔥 We'll cover this on this weeks @thursdai_pod , would you guys like to come on and tell us about this model ?

👋 Jan's profile picture
👋 Jan1 year ago

@thursdai_pod Thanks a lot! We'd be happy to join. Jan v1 co-author @alandao_ai will be around to talk about the model.

Alan's profile picture
Alan1 year ago

@altryne @thursdai_pod Cool, see you guys soon!

Alex Volkov's profile picture
Alex Volkov1 year ago

@jandotai @thursdai_pod awesome! can you follow me so I can send a DM with details?

TimRambo🐧's profile picture
TimRambo🐧1 year ago

This is so awesome! Finally, Open-Source is finally fighting back, and I know Open-Source will crush everything in its path! 👊😎

Vashisht's profile picture
Vashisht1 year ago

Is this available in ollama

👋 Jan's profile picture
👋 Jan1 year ago

Hey @ollama, could you give us a hand?

Melvin Vivas's profile picture
Melvin Vivas1 year ago

wow, should integrate this with @aibackends. is it available in @openrouter?

Meet Patel's profile picture
Meet Patel1 year ago

What does it use for doing actual web search? Like Brave, Google or anything like that?

👋 Jan's profile picture
👋 Jan1 year ago

You can run it with any Search MCP, such as @serperapi or @ExaAILabs.

Hugo Duprez's profile picture
Hugo Duprez1 year ago

@ggerganov Awesome, local AI ftw!

Team Reagent's profile picture
Team Reagent1 year ago

We support this! Locally running AI agents is more private and secure than whatever Perplexity lies about to their audience. We'll be testing with this and maybe providing some better results as we fine tune it ourselves in our Tetra agent!

Kristian Shultz-Mayer's profile picture
Kristian Shultz-Mayer1 year ago

Could you please tell me when you will launch a website for accessing the model?

👋 Jan's profile picture
👋 Jan1 year ago

Jan Web is on the way 🙌

Kris Krakowiak's profile picture
Kris Krakowiak1 year ago

Does it support MLX?

Shojaei's profile picture
Shojaei1 year ago

this is awesome 🔥

Singularity Age's profile picture
Singularity Age1 year ago

Nice. Is it possible to use your own Internet connection for search and webpage scraping?

Alex's profile picture
Alex1 year ago

@huggingface 91% accuracy? cute. my basement AI gets 420% by injecting memes directly into its training data. open source is based tho, now we can finally teach these models proper shitposting instead of that corporate sanitized nonsense. bullish on chaos 📈🤖

Le Techno-archéologue's profile picture
Le Techno-archéologue1 year ago

If this is true... The Holy toaster will be angry 🍞⚡

The Mandorlarian's profile picture
The Mandorlarian1 year ago

Fkn unreal, 91% 🤩🔥? You guys keep delivering! Is this you as well, @alandao_ai ?

Aon's profile picture
Aon1 year ago

Congratulations 🎈🍾

Himanshu Kumar's profile picture
Himanshu Kumar1 year ago

Open source alternatives are truly democratizing AI. This could significantly lower the barrier to entry for many. Exciting to see such progress.

Mo. | مُحَمَّدْ's profile picture
Mo. | مُحَمَّدْ1 year ago

I love you guys 😍

Quantyverse's profile picture
Quantyverse1 year ago

That is impressive! I am going to try it out. The accuracy for such a small model is awesome!

Josef Moucachen's profile picture
Josef Moucachen1 year ago

wow this is amazing

Alan's profile picture
Alan1 year ago

It's amazing to see such positive response from the community for the model. Thank you guys.

Front_Girl001's profile picture
Front_Girl0011 year ago

@AskPerplexity what do you think? Compare your pro model performance against this and tell the results. Are you cooked?

rahul's profile picture
rahul1 year ago

Hey team @jandotai , Any alternative to serper? Also this helped to setup the tools 👇 Thanks :) Love the work!!!

👋 Jan's profile picture
👋 Jan1 year ago

You're welcome 🙌 Jan supports MCP servers as an experimental feature, so you can add any search MCP to use with Jan v1.

rahul's profile picture
rahul1 year ago

Ah, That makes sense.

Pranav's profile picture
Pranav1 year ago

Any benchmarks on response speed?

Anderson452's profile picture
Anderson4521 year ago

Besides those options, is there anything else I need to configure for it to work? I'm new to MCP.

👋 Jan's profile picture
👋 Jan1 year ago

We're also experimenting with MCPs. - Go to Settings & turn on Experimental Features - Under MCP Servers in Settings, enable Serper & add your API key, or choose a different search MCP - Go to Model Providers -> llama.cpp, find Jan v1 turn on Tools

M Maarouf's profile picture
M Maarouf1 year ago

@MrAnderson452 Followed all the instructions and the wrench did show up, however, it fails to search online and in the output always says it got 403 errors. Do I need to get serper api key or something for it to work?

👋 Jan's profile picture
👋 Jan1 year ago

@MrAnderson452 Yes, you'll need to add a search MCP (e.g. @serperapi) for online search to work.

Sports Culture's profile picture
Sports Culture1 year ago

Very cool!

dhiyaan's profile picture
dhiyaan1 year ago

wow!

somecontextsuburbia's profile picture
somecontextsuburbia1 year ago

Great work folks! Very happy with your progress 🙌

Andres Franco's profile picture
Andres Franco1 year ago

Seems like a pretty interesting tool.

KI-CREW's profile picture
KI-CREW1 year ago

nice thank you

Hitarth Sharma's profile picture
Hitarth Sharma1 year ago

@grok what exactly does Jan v1 do if the actual search is being done by serper or exa?

JM's profile picture
JM1 year ago

I am trying to activate mcp it does not work.

👋 Jan's profile picture
👋 Jan1 year ago

Please follow the steps here:

JM's profile picture
JM1 year ago

got it, it works!

👋 Jan's profile picture
👋 Jan1 year ago

Awesome!

Gagan Ghotra's profile picture
Gagan Ghotra1 year ago

@zaidmukaddam 👀👀

omensec🇮🇳's profile picture
omensec🇮🇳1 year ago

Cool!!

Related Videos

MCP is an absolute game-changer. (Together with DeepSeek, MCP is probably the hottest thing in AI over the last 6 months.) I use Cursor to write code 90% of the time. I built an MCP server to connect the Cursor agent to GroundX, an open-source RAG system, and I'm not going back. This is officially insane! Here is what I did, step by step: First, a little bit of context. I maintain an end-to-end Machine Learning System with several pipelines to process data, train, evaluate, register, deploy, and monitor a model. I've written a lot of documentation explaining how the system works and how to modify and maintain it. There's also the documentation of the few libraries I used to build the system. I'm a massive fan of GroundX, an open-source enterprise-grade RAG system you can run on your servers or deploy to any cloud provider. I've been working with them for a long time. GroundX offers two services. First, the "ingest" service uses a custom, pretrained vision model to ingest and understand your data. I used this to process all the documentation I have for my code. Markdown files, source code, HTML files, and even PDF documents. Everything I've written related to my project went into GroundX. Their second service is "search," which combines text and vector search with a fine-tuned re-ranker model to retrieve information from the data. I needed to connect Cursor with this service, and that's where MCP came in. I built an MCP server with two tools: 1. The first tool would go to GroundX and retrieve the available topics. Splitting the data into topics (or "buckets," as GroundX calls them) allows me to use the same setup to serve documentation from different topics. 2. The second tool would search GroundX under a specific topic for the context related to the supplied query. The magic happens after connecting the MCP server with Cursor. Now, I can ask any questions related to my project, and Cursor's AI agent retrieves the list of available topics from the RAG system and then searches it to provide relevant context to the model. I went from getting mediocre, sometimes wrong answers to 100% truthful, complete answers. Here is the crazy part:

Santiago

255,596 views • 1 year ago