Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Stop hardcoding one model name in your code. Now you can give each request a policy: a small rule for what the call needs It picks the right model for the job, on your own keys This is unhardcoded, our new open source routing for AI models, live today

GenLayer

81,868 subscribers

93,821 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing: Auto Private Model Routing on June Choose Low, Balanced, or High. June picks the right model for every request. Defaults to zero data retention and private models. Powered by Venice. Free to try. Open source. MIT. Try June:

Introducing: Auto Private Model Routing on June Choose Low, Balanced, or High. June picks the right model for every request. Defaults to zero data retention and private models. Powered by Venice. Free to try. Open source. MIT. Try June:

OpenSoftware

111,495 views • 21 days ago

Launching today: the world’s first fully optimized LLM routing stack that can be embedded directly into your product, Merge Embedded Routing Stack. Model sovereignty is now table stakes for any AI product. Users and companies are demanding full control over the AI models running in your product. Right now, no company is able to do this without massive overhead. Until today. Merge makes it easy for your customers to use your product exactly the way they want to. With a single API, you can: 1. Allow customers to bring their own keys, manage their own budgets, and set policies like fallback rules, model allowlists, and more 2. Let each customer connect and switch their own models, right inside your product 3. Optimize each customer for cost, performance, or capability Without Merge, you’d be: - Building routing policies, provider integrations, and LLM key management - Giving your users zero model independence - Receiving endless customer support tickets asking “can I use 5.6 Sol?” Products that fight their customers' model strategy will lose to products that fit it. Merge is the only place that allows your users to produce the exact results they want, with the models they have access to. Give your customers the advantage, without the massive overhead costs.

Launching today: the world’s first fully optimized LLM routing stack that can be embedded directly into your product, Merge Embedded Routing Stack. Model sovereignty is now table stakes for any AI product. Users and companies are demanding full control over the AI models running in your product. Right now, no company is able to do this without massive overhead. Until today. Merge makes it easy for your customers to use your product exactly the way they want to. With a single API, you can: 1. Allow customers to bring their own keys, manage their own budgets, and set policies like fallback rules, model allowlists, and more 2. Let each customer connect and switch their own models, right inside your product 3. Optimize each customer for cost, performance, or capability Without Merge, you’d be: - Building routing policies, provider integrations, and LLM key management - Giving your users zero model independence - Receiving endless customer support tickets asking “can I use 5.6 Sol?” Products that fight their customers' model strategy will lose to products that fit it. Merge is the only place that allows your users to produce the exact results they want, with the models they have access to. Give your customers the advantage, without the massive overhead costs.

Shensi Ding

352,951 views • 25 days ago

Create your own local and free AI agent using an open source model You can combine: - IBM's Granite 3.3 8B AI model - LM Studio to run it on a laptop - Smolagents to build your agent Small AI models are now powerful enough to run an autonomous agent. Thanks to IBM France for sponsoring this content!

Create your own local and free AI agent using an open source model You can combine: - IBM's Granite 3.3 8B AI model - LM Studio to run it on a laptop - Smolagents to build your agent Small AI models are now powerful enough to run an autonomous agent. Thanks to IBM France for sponsoring this content!

Paul Couvert

18,890 views • 1 year ago

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 views • 8 days ago

LM Studio is the most popular way to run open-source LLMs on your own hardware. Your Hermes Agent now runs natively on LM Studio: auto-discovering your models, loading them on demand with the right context size, and using the right reasoning level for each model.

LM Studio is the most popular way to run open-source LLMs on your own hardware. Your Hermes Agent now runs natively on LM Studio: auto-discovering your models, loading them on demand with the right context size, and using the right reasoning level for each model.

Nous Research

186,253 views • 3 months ago

Custom complexity classifiers are now in Merge. Define what counts as complex for your own traffic. Tag your query categories, set the thresholds, it routes each one to a model that fits. Not every query needs your most expensive model. This makes it even easier. :)

Custom complexity classifiers are now in Merge. Define what counts as complex for your own traffic. Tag your query categories, set the thresholds, it routes each one to a model that fits. Not every query needs your most expensive model. This makes it even easier. :)

Shensi Ding

29,538 views • 1 month ago

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 views • 2 years ago

“don’t train your own model” is common ai advice. it's wrong. your token bill's the proof. today, we’re excited to launch castform into open preview. castform is the easiest way for you to train your own model, on your own data. open-weights models are performant and much cheaper. when trained on your task & proprietary data, they beat closed models. the thing standing between you and that was weeks of plumbing & years of ml expertise. with castform, model training is as simple as prompt engineering. castform bring your agent traces or raw corpora. castform turns it into training data, picks the right algorithmic recipes, manages gpus, and gives you an ide to watch and chat with your model as it learns. see what you can build with castform👇

“don’t train your own model” is common ai advice. it's wrong. your token bill's the proof. today, we’re excited to launch castform into open preview. castform is the easiest way for you to train your own model, on your own data. open-weights models are performant and much cheaper. when trained on your task & proprietary data, they beat closed models. the thing standing between you and that was weeks of plumbing & years of ml expertise. with castform, model training is as simple as prompt engineering. castform bring your agent traces or raw corpora. castform turns it into training data, picks the right algorithmic recipes, manages gpus, and gives you an ide to watch and chat with your model as it learns. see what you can build with castform👇

girish

457,932 views • 2 months ago

The biggest model is no longer the advantage. The right model is. Generic AI can do a little of everything, but it rarely optimizes for what matters in production. Oumi is changing that by making custom models fast and accessible. It feels like we are entering the era of building your own AI. Manos Koukoumidis OUMI

The biggest model is no longer the advantage. The right model is. Generic AI can do a little of everything, but it rarely optimizes for what matters in production. Oumi is changing that by making custom models fast and accessible. It feels like we are entering the era of building your own AI. Manos Koukoumidis OUMI

Leonardo

15,584 views • 4 months ago

We deployed a fully private AI agent on NuNet in under 5 minutes 🚀 OpenClaw🦞 running Qwen through ollama , one of the hottest open source model families right now, entirely on decentralized compute. No cloud. No API keys. No data leaving the machine. This is what private AI looks like when you actually build it instead of just talking about it. Your model. Your hardware. Your rules. Full walkthrough showing exactly how it works: What should we deploy next?

We deployed a fully private AI agent on NuNet in under 5 minutes 🚀 OpenClaw🦞 running Qwen through ollama , one of the hottest open source model families right now, entirely on decentralized compute. No cloud. No API keys. No data leaving the machine. This is what private AI looks like when you actually build it instead of just talking about it. Your model. Your hardware. Your rules. Full walkthrough showing exactly how it works: What should we deploy next?

NuNet 🌐

87,598 views • 4 months ago

Introducing the 01 Developer Preview. Order or build your own today: The 01 Light is a portable voice interface that controls your home computer. It can see your screen, use your apps, and learn new skills. This is only the beginning for 01— the open-source foundation for this new era of AI devices.

Introducing the 01 Developer Preview. Order or build your own today: The 01 Light is a portable voice interface that controls your home computer. It can see your screen, use your apps, and learn new skills. This is only the beginning for 01— the open-source foundation for this new era of AI devices.

Interpreter

1,408,808 views • 2 years ago

Okay it works!!!! Now making the interface for it, I named it [ 👋 Hold a product ] You upload your product photo, you take a photo and it generates one with your AI model holding it Then from there you can press [ Talking video ], write a script and your AI model will present the product for you The AI character is from @lucataco93's tweets 😊

Okay it works!!!! Now making the interface for it, I named it [ 👋 Hold a product ] You upload your product photo, you take a photo and it generates one with your AI model holding it Then from there you can press [ Talking video ], write a script and your AI model will present the product for you The AI character is from @lucataco93's tweets 😊

@levelsio

188,528 views • 11 months ago

Ads built the old internet. AI needs a new model. Dylan Patel says OpenAI’s router could make free AI sustainable, routing everyday queries to small models while reserving agents for high-stakes tasks. “This is how I think OpenAI can finally make money off of the free user.”

Ads built the old internet. AI needs a new model. Dylan Patel says OpenAI’s router could make free AI sustainable, routing everyday queries to small models while reserving agents for high-stakes tasks. “This is how I think OpenAI can finally make money off of the free user.”

a16z

75,465 views • 11 months ago

The Policy Checker Page is LIVE! Remember we talked about showing our intermediate model and success heatmap? You can now check them live on our hub! For each intermediate policy, you can: - View its summary — success rate, task type, checkpoints, and more. - Run it directly in your browser to observe its real-time inference. (If it looks a bit choppy, that's expected — the model is inferring live!) - Explore its success heatmap — showing the initial states under which the policy successfully completes the task. This gives the community a lens into our backend policy training, and lays the groundwork for better demonstrating our recover from failure training loop going forward. How to enter ⬇️

The Policy Checker Page is LIVE! Remember we talked about showing our intermediate model and success heatmap? You can now check them live on our hub! For each intermediate policy, you can: - View its summary — success rate, task type, checkpoints, and more. - Run it directly in your browser to observe its real-time inference. (If it looks a bit choppy, that's expected — the model is inferring live!) - Explore its success heatmap — showing the initial states under which the policy successfully completes the task. This gives the community a lens into our backend policy training, and lays the groundwork for better demonstrating our recover from failure training loop going forward. How to enter ⬇️

Axis Robotics

13,134 views • 1 month ago

This approach has made Sonnet the model of choice for developers worldwide. In addition to our new model, we're launching Claude Code, our first coding tool, in a limited research preview. With Claude Code, you can delegate substantial tasks to Claude—right from your terminal.

This approach has made Sonnet the model of choice for developers worldwide. In addition to our new model, we're launching Claude Code, our first coding tool, in a limited research preview. With Claude Code, you can delegate substantial tasks to Claude—right from your terminal.

Anthropic

1,140,511 views • 1 year ago

Kimi K2.7 Code is the first open-weight model you can select in the GitHub Copilot model picker. What does that mean for you? Burke Holland explains how this low-cost, high-performance model gives you more choice and flexibility in your workflow. ▶️

Kimi K2.7 Code is the first open-weight model you can select in the GitHub Copilot model picker. What does that mean for you? Burke Holland explains how this low-cost, high-performance model gives you more choice and flexibility in your workflow. ▶️

GitHub

124,941 views • 1 month ago

Calling a model "open source" because you can use it is like calling a car open source because you can drive it. The real question is whether you can open the hood. Azibi Malawi from DataVLT on what openness at the model layer actually requires.

Calling a model "open source" because you can use it is like calling a car open source because you can drive it. The real question is whether you can open the hood. Azibi Malawi from DataVLT on what openness at the model layer actually requires.

Cluster Protocol

27,006 views • 1 month ago

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.

Databricks

327,800 views • 2 years ago