Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Deploy any ML model as an MCP server! LitServe: The easiest way to deploy agents, RAG, and any ML model. Now supports MCP. 100% open-source.

Akshay 🚀

284,218 subscribers

60,086 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Comments

Akshay 🚀1 year ago

Link to LitServe GitHub repo: (don't forget to star 🌟)

Akshay 🚀1 year ago

If you found it insightful, reshare with your network. Find me → @akshay_pachaar ✔️ For more insights and tutorials on LLMs, AI Agents, and Machine Learning!

Avi Chawla1 year ago

This is a really really cool idea. Love it

Akshay 🚀1 year ago

Glad you liked it Avi! :)

Shawn Chauhan1 year ago

Open-source makes it way more accessible for devs

Akshay 🚀1 year ago

Absolutely 💯

Truong Hoang Dung1 year ago

what a pity, it uses Python.

Rusty Ray1 year ago

Open-source support makes deployment far more flexible.

Riley Debuggs1 year ago

Open-source MCP support widens LitServe’s applicability. Interested to see benchmarks versus alternative deployment frameworks.

Code Weaver1 year ago

Curious—what performance impact comes with deploying via MCP compared to alternatives?

Related Videos

Agents & MCP are great... but how can you DEPLOY an agent with MCP tools? Here's the fastest way I've found to build and deploy with the OpenAI Agents SDK in <3 minutes.

Agents & MCP are great... but how can you DEPLOY an agent with MCP tools? Here's the fastest way I've found to build and deploy with the OpenAI Agents SDK in <3 minutes.

matt palmer

64,690 views • 1 year ago

I made a thing, and it's 100% open-source. Introducing ModelFetch: 🥳 Deploy MCP servers anywhere TypeScript or JavaScript runs. 🚀 1️⃣ Write your MCP server once using the official MCP TypeScript SDK. 2️⃣ Deploy it anywhere using the ModelFetch runtime packages. Link below 👇

I made a thing, and it's 100% open-source. Introducing ModelFetch: 🥳 Deploy MCP servers anywhere TypeScript or JavaScript runs. 🚀 1️⃣ Write your MCP server once using the official MCP TypeScript SDK. 2️⃣ Deploy it anywhere using the ModelFetch runtime packages. Link below 👇

Minh-Phuc Tran

12,751 views • 1 year ago

MCP meets Ollama! In this video you'll learn how build a 100% local MCP client that you can connect to any MCP server. 100% open-source code, step-by-step guide:

MCP meets Ollama! In this video you'll learn how build a 100% local MCP client that you can connect to any MCP server. 100% open-source code, step-by-step guide:

Akshay 🚀

92,848 views • 1 year ago

Introducing Asterisk MCP - An MCP server that fixes security vulnerabilities while you vibe code. Supports Cursor, Windsurf, Cline, Claude, and any IDE that supports the model context protocol. It can perform codebase-wide scans, analyze snippets in your conversation history, and verify changes/fixes for security issues. mcp dot asterisk dot so

Introducing Asterisk MCP - An MCP server that fixes security vulnerabilities while you vibe code. Supports Cursor, Windsurf, Cline, Claude, and any IDE that supports the model context protocol. It can perform codebase-wide scans, analyze snippets in your conversation history, and verify changes/fixes for security issues. mcp dot asterisk dot so

mufeed vh

14,353 views • 1 year ago

AI Engineers gonna love this MCP server! KitOps MCP serve eliminates the "it works on my machine" problem by packaging AI/ML projects (models, datasets, code, config) into a shareable, deployable ModelKit. Sharing projects is as easy as sharing zip files! 100% open-source.

AI Engineers gonna love this MCP server! KitOps MCP serve eliminates the "it works on my machine" problem by packaging AI/ML projects (models, datasets, code, config) into a shareable, deployable ModelKit. Sharing projects is as easy as sharing zip files! 100% open-source.

Akshay 🚀

87,067 views • 1 year ago

INCREDIBLE!! An MCP server to browse the web like humans! Bright Data MCP server provides 30+ powerful tools that allow AI agents to access, search, crawl, and interact with the web without getting blocked. 100% open-source, works at scale!

INCREDIBLE!! An MCP server to browse the web like humans! Bright Data MCP server provides 30+ powerful tools that allow AI agents to access, search, crawl, and interact with the web without getting blocked. 100% open-source, works at scale!

Akshay 🚀

90,404 views • 1 year ago

Metorial (Metorial (YC F25)) makes it easy for AI agents to use tools and data. Deploy 600+ MCP integrations in three clicks and connect them to agents in a single function call. Open-source and the only serverless MCP platform built for multi-tenant systems.

Metorial (Metorial (YC F25)) makes it easy for AI agents to use tools and data. Deploy 600+ MCP integrations in three clicks and connect them to agents in a single function call. Open-source and the only serverless MCP platform built for multi-tenant systems.

Y Combinator

15,381 views • 11 months ago

The only MCP server you'll ever need! I just built an MCP server that connects to 200+ data sources and runs locally on my machine. 100% open source.

The only MCP server you'll ever need! I just built an MCP server that connects to 200+ data sources and runs locally on my machine. 100% open source.

Akshay 🚀

64,167 views • 1 year ago

An MCP server to create Grant Sanderson animations (open-source):

An MCP server to create Grant Sanderson animations (open-source):

Daily Dose of Data Science

12,376 views • 11 months ago

Dedalus Labs (Dedalus Labs) is building the infrastructure layer for agentic AI—the simplest way to build and deploy complex agents across any model and any tool. Congrats on the launch, Cathy Di & Windsor Nguyễn!

Dedalus Labs (Dedalus Labs) is building the infrastructure layer for agentic AI—the simplest way to build and deploy complex agents across any model and any tool. Congrats on the launch, Cathy Di & Windsor Nguyễn!

Y Combinator

138,607 views • 11 months ago

Introducing Wingman: a model-agnostic, MCP-native coding assistant. You can now get the Claude Code experience with ANY model for FREE. - MIT-licensed - MCP-native - Model-agnostic > pip install wingman-cli

Introducing Wingman: a model-agnostic, MCP-native coding assistant. You can now get the Claude Code experience with ANY model for FREE. - MIT-licensed - MCP-native - Model-agnostic > pip install wingman-cli

Dedalus Labs

39,454 views • 8 months ago

Build a 100% local, private, and secure MCP client. You can connect it to any MCP server. Step-by-step guide:

Build a 100% local, private, and secure MCP client. You can connect it to any MCP server. Step-by-step guide:

Akshay 🚀

15,560 views • 9 months ago

5️⃣ Jupyter MCP server An MCP server to control Jupyter notebooks from Claude, you can: - Create code cells - Execute code cells - Create markdown cells 100% open-source and free to use! Check this👇

5️⃣ Jupyter MCP server An MCP server to control Jupyter notebooks from Claude, you can: - Create code cells - Execute code cells - Create markdown cells 100% open-source and free to use! Check this👇

Akshay 🚀

16,578 views • 1 year ago

🆕Fin now supports MCP as a client, and Intercom supports MCP as a server. This little example shows Fin connecting to Stripe's MCP server letting Fin list products, prices, and even create payment links. This lets Fin resolve customer questions better, faster, and cheaper

🆕Fin now supports MCP as a client, and Intercom supports MCP as a server. This little example shows Fin connecting to Stripe's MCP server letting Fin list products, prices, and even create payment links. This lets Fin resolve customer questions better, faster, and cheaper

Des Traynor

23,935 views • 1 year ago