Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Deploy any ML model as an MCP server! LitServe: The easiest way to deploy agents, RAG, and any ML model. Now supports MCP. 100% open-source.

60,086 Aufrufe • vor 1 Jahr •via X (Twitter)

10 Kommentare

Profilbild von Akshay 🚀
Akshay 🚀vor 1 Jahr

Link to LitServe GitHub repo: (don't forget to star 🌟)

Profilbild von Akshay 🚀
Akshay 🚀vor 1 Jahr

If you found it insightful, reshare with your network. Find me → @akshay_pachaar ✔️ For more insights and tutorials on LLMs, AI Agents, and Machine Learning!

Profilbild von Avi Chawla
Avi Chawlavor 1 Jahr

This is a really really cool idea. Love it

Profilbild von Akshay 🚀
Akshay 🚀vor 1 Jahr

Glad you liked it Avi! :)

Profilbild von Shawn Chauhan
Shawn Chauhanvor 1 Jahr

Open-source makes it way more accessible for devs

Profilbild von Akshay 🚀
Akshay 🚀vor 1 Jahr

Absolutely 💯

Profilbild von Truong Hoang Dung
Truong Hoang Dungvor 1 Jahr

what a pity, it uses Python.

Profilbild von Rusty Ray
Rusty Rayvor 1 Jahr

Open-source support makes deployment far more flexible.

Profilbild von Riley Debuggs
Riley Debuggsvor 1 Jahr

Open-source MCP support widens LitServe’s applicability. Interested to see benchmarks versus alternative deployment frameworks.

Profilbild von Code Weaver
Code Weavervor 1 Jahr

Curious—what performance impact comes with deploying via MCP compared to alternatives?

Ähnliche Videos

New course: MCP: Build Rich-Context AI Apps with Anthropic. Learn to build AI apps that access tools, data, and prompts using the Model Context Protocol in this short course, created in partnership with Anthropic Anthropic and taught by Elie Schoppik Elie Schoppik, its Head of Technical Education. Connecting AI applications to external systems that bring rich context to LLM-based applications has often meant writing custom integrations for each use case. MCP is an open protocol that standardizes how LLMs access tools, data, and prompts from external sources, and simplifies how you provide context to your LLM-based applications. For example, you can provide context via third-party tools that let your LLM make API calls to search the web, access data from local docs, retrieve code from a GitHub repo, and so on. MCP, developed by Anthropic, is based on a client-server architecture that defines the communication details between an MCP client, hosted inside the AI application, and an MCP server that exposes tools, resources, and prompt templates. The server can be a subprocess launched by the client that runs locally or an independent process running remotely. In this hands-on course, you'll learn the core architecture behind MCP. You’ll create an MCP-compatible chatbot, build and deploy an MCP server, and connect the chatbot to your MCP server and other open-source servers. Here’s what you’ll do: - Understand why MCP makes AI development less fragmented and standardizes connections between AI applications and external data sources - Learn the core components of the client-server architecture of MCP and the underlying communication mechanism - Build a chatbot with custom tools for searching academic papers, and transform it into an MCP-compatible application - Build a local MCP server that exposes tools, resources, and prompt templates using FastMCP, and test it using MCP Inspector - Create an MCP client inside your chatbot to dynamically connect to your server - Connect your chatbot to reference servers built by Anthropic’s MCP team, such as filesystem, which implements filesystem operations, and fetch, which extracts contents from the web as markdown - Configure Claude Desktop to connect to your server and others, and explore how it abstracts away the low-level logic of MCP clients - Deploy your MCP server remotely and test it with the Inspector or other MCP-compatible applications - Learn about the roadmap for future MCP development, such as multi-agent architecture, MCP registry API, server discovery, authorization, and authentication MCP is an exciting and important technology that lets you build rich-context AI applications that connect to a growing ecosystem of MCP servers, with minimal integration work. Please sign up here!

Andrew Ng

142,010 Aufrufe • vor 1 Jahr