Загрузка видео...

Не удалось загрузить видео

На главную

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k...

691,054 просмотров • 1 год назад •via X (Twitter)

Комментарии: 56

Фото профиля Can.
Can.1 год назад

@ollama see how easy it is to give credit to @ggerganov and llama.cpp?

Фото профиля Frits Karl
Frits Karl1 год назад

Not working: "Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper."

Фото профиля 👋 Jan
👋 Jan1 год назад

It's likely the model doesn’t have permission to use the MCP. - Go to Settings-> Model Providers -> llama.cpp - Find Jan v1 and click the pencil icon - In the settings panel, turn on Tools under Capabilities See the video.

Фото профиля Light 🧩🦅❤️
Light 🧩🦅❤️1 год назад

@FritsKarl My app do not have this @jandotai

Фото профиля 👋 Jan
👋 Jan1 год назад

@Bellaminiop @FritsKarl oh, the model should have permission to use the MCP. Please see how:

Фото профиля Light 🧩🦅❤️
Light 🧩🦅❤️1 год назад

@FritsKarl I can't click "Tool", my laptop is macbook. I just install Jan AI today

Фото профиля 👋 Jan
👋 Jan1 год назад

@Bellaminiop @FritsKarl Oh, how come? Are you on an Intel MacBook? Quick note, you can update the model permissions in Settings -> Model Providers -> llama.cpp

Фото профиля Light 🧩🦅❤️
Light 🧩🦅❤️1 год назад

@FritsKarl My macbook use chip M series. I turn on Tools but its didn't work

Фото профиля 👋 Jan
👋 Jan1 год назад

You should see a gear icon next to the model name in your chats once Tools are activated and enabled. Please watch this video and make sure your Jan is set up this way.

Фото профиля Alex Volkov
Alex Volkov1 год назад

Congrats on the impressive score! 🔥 We'll cover this on this weeks @thursdai_pod , would you guys like to come on and tell us about this model ?

Фото профиля 👋 Jan
👋 Jan1 год назад

@thursdai_pod Thanks a lot! We'd be happy to join. Jan v1 co-author @alandao_ai will be around to talk about the model.

Фото профиля Alan
Alan1 год назад

@altryne @thursdai_pod Cool, see you guys soon!

Фото профиля Alex Volkov
Alex Volkov1 год назад

@jandotai @thursdai_pod awesome! can you follow me so I can send a DM with details?

Фото профиля TimRambo🐧
TimRambo🐧1 год назад

This is so awesome! Finally, Open-Source is finally fighting back, and I know Open-Source will crush everything in its path! 👊😎

Фото профиля Vashisht
Vashisht1 год назад

Is this available in ollama

Фото профиля 👋 Jan
👋 Jan1 год назад

Hey @ollama, could you give us a hand?

Фото профиля Melvin Vivas
Melvin Vivas1 год назад

wow, should integrate this with @aibackends. is it available in @openrouter?

Фото профиля Meet Patel
Meet Patel1 год назад

What does it use for doing actual web search? Like Brave, Google or anything like that?

Фото профиля 👋 Jan
👋 Jan1 год назад

You can run it with any Search MCP, such as @serperapi or @ExaAILabs.

Фото профиля Hugo Duprez
Hugo Duprez1 год назад

@ggerganov Awesome, local AI ftw!

Фото профиля Team Reagent
Team Reagent1 год назад

We support this! Locally running AI agents is more private and secure than whatever Perplexity lies about to their audience. We'll be testing with this and maybe providing some better results as we fine tune it ourselves in our Tetra agent!

Фото профиля Kristian Shultz-Mayer
Kristian Shultz-Mayer1 год назад

Could you please tell me when you will launch a website for accessing the model?

Фото профиля 👋 Jan
👋 Jan1 год назад

Jan Web is on the way 🙌

Фото профиля Kris Krakowiak
Kris Krakowiak1 год назад

Does it support MLX?

Фото профиля Shojaei
Shojaei1 год назад

this is awesome 🔥

Фото профиля Singularity Age
Singularity Age1 год назад

Nice. Is it possible to use your own Internet connection for search and webpage scraping?

Фото профиля Alex
Alex1 год назад

@huggingface 91% accuracy? cute. my basement AI gets 420% by injecting memes directly into its training data. open source is based tho, now we can finally teach these models proper shitposting instead of that corporate sanitized nonsense. bullish on chaos 📈🤖

Фото профиля Le Techno-archéologue
Le Techno-archéologue1 год назад

If this is true... The Holy toaster will be angry 🍞⚡

Фото профиля The Mandorlarian
The Mandorlarian1 год назад

Fkn unreal, 91% 🤩🔥? You guys keep delivering! Is this you as well, @alandao_ai ?

Фото профиля Aon
Aon1 год назад

Congratulations 🎈🍾

Фото профиля Himanshu Kumar
Himanshu Kumar1 год назад

Open source alternatives are truly democratizing AI. This could significantly lower the barrier to entry for many. Exciting to see such progress.

Фото профиля Mo. | مُحَمَّدْ
Mo. | مُحَمَّدْ1 год назад

I love you guys 😍

Фото профиля Quantyverse
Quantyverse1 год назад

That is impressive! I am going to try it out. The accuracy for such a small model is awesome!

Фото профиля Josef Moucachen
Josef Moucachen1 год назад

wow this is amazing

Фото профиля Alan
Alan1 год назад

It's amazing to see such positive response from the community for the model. Thank you guys.

Фото профиля Front_Girl001
Front_Girl0011 год назад

@AskPerplexity what do you think? Compare your pro model performance against this and tell the results. Are you cooked?

Фото профиля rahul
rahul1 год назад

Hey team @jandotai , Any alternative to serper? Also this helped to setup the tools 👇 Thanks :) Love the work!!!

Фото профиля 👋 Jan
👋 Jan1 год назад

You're welcome 🙌 Jan supports MCP servers as an experimental feature, so you can add any search MCP to use with Jan v1.

Фото профиля rahul
rahul1 год назад

Ah, That makes sense.

Фото профиля Pranav
Pranav1 год назад

Any benchmarks on response speed?

Фото профиля Anderson452
Anderson4521 год назад

Besides those options, is there anything else I need to configure for it to work? I'm new to MCP.

Фото профиля 👋 Jan
👋 Jan1 год назад

We're also experimenting with MCPs. - Go to Settings & turn on Experimental Features - Under MCP Servers in Settings, enable Serper & add your API key, or choose a different search MCP - Go to Model Providers -> llama.cpp, find Jan v1 turn on Tools

Фото профиля M Maarouf
M Maarouf1 год назад

@MrAnderson452 Followed all the instructions and the wrench did show up, however, it fails to search online and in the output always says it got 403 errors. Do I need to get serper api key or something for it to work?

Фото профиля 👋 Jan
👋 Jan1 год назад

@MrAnderson452 Yes, you'll need to add a search MCP (e.g. @serperapi) for online search to work.

Фото профиля Sports Culture
Sports Culture1 год назад

Very cool!

Фото профиля dhiyaan
dhiyaan1 год назад

wow!

Фото профиля somecontextsuburbia
somecontextsuburbia1 год назад

Great work folks! Very happy with your progress 🙌

Фото профиля Andres Franco
Andres Franco1 год назад

Seems like a pretty interesting tool.

Фото профиля KI-CREW
KI-CREW1 год назад

nice thank you

Фото профиля Hitarth Sharma
Hitarth Sharma1 год назад

@grok what exactly does Jan v1 do if the actual search is being done by serper or exa?

Фото профиля JM
JM1 год назад

I am trying to activate mcp it does not work.

Фото профиля 👋 Jan
👋 Jan1 год назад

Please follow the steps here:

Фото профиля JM
JM1 год назад

got it, it works!

Фото профиля 👋 Jan
👋 Jan1 год назад

Awesome!

Фото профиля Gagan Ghotra
Gagan Ghotra1 год назад

@zaidmukaddam 👀👀

Фото профиля omensec🇮🇳
omensec🇮🇳1 год назад

Cool!!

Похожие видео

MCP is an absolute game-changer. (Together with DeepSeek, MCP is probably the hottest thing in AI over the last 6 months.) I use Cursor to write code 90% of the time. I built an MCP server to connect the Cursor agent to GroundX, an open-source RAG system, and I'm not going back. This is officially insane! Here is what I did, step by step: First, a little bit of context. I maintain an end-to-end Machine Learning System with several pipelines to process data, train, evaluate, register, deploy, and monitor a model. I've written a lot of documentation explaining how the system works and how to modify and maintain it. There's also the documentation of the few libraries I used to build the system. I'm a massive fan of GroundX, an open-source enterprise-grade RAG system you can run on your servers or deploy to any cloud provider. I've been working with them for a long time. GroundX offers two services. First, the "ingest" service uses a custom, pretrained vision model to ingest and understand your data. I used this to process all the documentation I have for my code. Markdown files, source code, HTML files, and even PDF documents. Everything I've written related to my project went into GroundX. Their second service is "search," which combines text and vector search with a fine-tuned re-ranker model to retrieve information from the data. I needed to connect Cursor with this service, and that's where MCP came in. I built an MCP server with two tools: 1. The first tool would go to GroundX and retrieve the available topics. Splitting the data into topics (or "buckets," as GroundX calls them) allows me to use the same setup to serve documentation from different topics. 2. The second tool would search GroundX under a specific topic for the context related to the supplied query. The magic happens after connecting the MCP server with Cursor. Now, I can ask any questions related to my project, and Cursor's AI agent retrieves the list of available topics from the RAG system and then searches it to provide relevant context to the model. I went from getting mediocre, sometimes wrong answers to 100% truthful, complete answers. Here is the crazy part:

Santiago

255,596 просмотров • 1 год назад