Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Here is a feature you won't get anywhere else: 1. First, you add access to every major LLM out there. 2. Second, you implement intelligent routing so the best model answers your question. If you are still paying for 3-4 different models, you are wasting your money. Check this out:

svpino's profile picture

Santiago

453,305 subscribers

20,802 görüntüleme • 2 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

MLOps Guy profil fotoğrafı
MLOps Guy2 yıl önce

How is the best answer determined?

Axioma AI 🔺 profil fotoğrafı
Axioma AI 🔺2 yıl önce

Business model of Perplexity? 🤔🤔

coinwatch profil fotoğrafı
coinwatch2 yıl önce

concept is good, a lot of time it doesn't work and support is non-existent. is this a sponsored post?

Jovan Cicmil profil fotoğrafı
Jovan Cicmil2 yıl önce

I don't understand. How does the router decide which model to use for each question?

ChillyNovember🐧 profil fotoğrafı
ChillyNovember🐧2 yıl önce

So its like an LLM model aggregator. Curious how the algorithm decides on the model?

Mark R Pommrehn profil fotoğrafı
Mark R Pommrehn2 yıl önce

Yeah, love chatllm! And yes, excellent value for money as well as so many features and much flexibility!

___raf stahelin___ profil fotoğrafı
___raf stahelin___2 yıl önce

Is there perplexity?

GigaMira profil fotoğrafı
GigaMira2 yıl önce

This sounds like a game-changer for businesses looking to leverage AI technology. How does the intelligent routing feature work?

Faris Hassan profil fotoğrafı
Faris Hassan2 yıl önce

You mean we subscribe to ClaudeAI and call it a day

GPT.Biz profil fotoğrafı
GPT.Biz2 yıl önce

Sounds like a smart way to save both time and money! Definitely worth checking out.

Benzer Videolar

Are you watching the Game Awards? If you're a cat lover you HAVE to check this game out, go out there and add it to your steam wishlist. #Catly #TheGameAwards #CatlyPartner CATLY
0:51

Are you watching the Game Awards? If you're a cat lover you HAVE to check this game out, go out there and add it to your steam wishlist. #Catly #TheGameAwards #CatlyPartner CATLY

Ninja

277,620 görüntüleme • 1 yıl önce

Let me show you how easy it is to implement smart routing in your LLM-based projects. Smart routing will select the best model based on the difficulty of the request. This is honestly one of the easiest things you could do to make your app 10x better.
6:53

Let me show you how easy it is to implement smart routing in your LLM-based projects. Smart routing will select the best model based on the difficulty of the request. This is honestly one of the easiest things you could do to make your app 10x better.

Santiago

35,823 görüntüleme • 6 ay önce

this is the EASIEST method to build a viral app on your first try. 1. search for existing apps on t:)ktok 2. look at viral vids 3. build the viral feature 4. add your own twist after i’ve seen the SAME viral feature in 3 different couple apps today. are you doing this?
0:25

this is the EASIEST method to build a viral app on your first try. 1. search for existing apps on t:)ktok 2. look at viral vids 3. build the viral feature 4. add your own twist after i’ve seen the SAME viral feature in 3 different couple apps today. are you doing this?

Simone Canc

76,204 görüntüleme • 10 ay önce

You exchange your labor for money, which in turn represents your contributions to society. Every time your money is inflated your contributions to society are devalued. You get less out of your life because you get less for your money. Fix the money, fix the world. #Bitcoin
1:45

You exchange your labor for money, which in turn represents your contributions to society. Every time your money is inflated your contributions to society are devalued. You get less out of your life because you get less for your money. Fix the money, fix the world. #Bitcoin

Jack Mallers

238,397 görüntüleme • 3 yıl önce

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.
0:23

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Santiago

39,101 görüntüleme • 2 yıl önce

President William Ruto: If you are paying a mortgage, nothing stops you as somebody who is employed to contribute to this fund. It is not a tax; it is your money. You are playing your patriotic duty because out there we have millions of young people who get out of school every year. It is our duty to see how we can help them in a small way #ThePlan
1:18

President William Ruto: If you are paying a mortgage, nothing stops you as somebody who is employed to contribute to this fund. It is not a tax; it is your money. You are playing your patriotic duty because out there we have millions of young people who get out of school every year. It is our duty to see how we can help them in a small way #ThePlan

Citizen TV Kenya

121,706 görüntüleme • 3 yıl önce

Production traffic is not uniform. You get a few requests that need your best model, but most are simple questions and lookups you can solve with cheaper, faster models. The most expensive mistake you can make today is sending every request to your strongest model. You need routing. Period. This is the simplest trick to improve the architecture of whatever you are building. Please, don't implement routing yourself. You don't have to. I'm currently working with TrueFoundry's Auto Routing. It reads each request, classifies it as simple, medium, or complex, and sends it to the model assigned to that tier. You have two choices: 1. Send every request to the free heuristic classifier to score signals such as technical vocabulary, code, prompt length, and multi-step reasoning. 2. Send the request to an LLM classifier when its difficulty requires a more nuanced judgment. The beauty of using routing is that nothing changes in your code. You still call a single endpoint model, but routing works behind the scenes to pair every request with the best possible model. TrueFoundry ran several experiments with two different setups: 1. Send every request to Claude Opus 2. Send every request to a router with Haiku, Sonnet, and Opus The first experiment ran 550 deterministically graded academic prompts through every setup. Auto Routing was 69% cheaper while retaining 98% of the baseline quality. The second experiment ran three production-shaped workloads through every setup, using user chats, developer chats, and long agent tasks. Auto Routing was 80% cheaper. Thanks to the TrueFoundry team for partnering with me on this post.
1:28

Production traffic is not uniform. You get a few requests that need your best model, but most are simple questions and lookups you can solve with cheaper, faster models. The most expensive mistake you can make today is sending every request to your strongest model. You need routing. Period. This is the simplest trick to improve the architecture of whatever you are building. Please, don't implement routing yourself. You don't have to. I'm currently working with TrueFoundry's Auto Routing. It reads each request, classifies it as simple, medium, or complex, and sends it to the model assigned to that tier. You have two choices: 1. Send every request to the free heuristic classifier to score signals such as technical vocabulary, code, prompt length, and multi-step reasoning. 2. Send the request to an LLM classifier when its difficulty requires a more nuanced judgment. The beauty of using routing is that nothing changes in your code. You still call a single endpoint model, but routing works behind the scenes to pair every request with the best possible model. TrueFoundry ran several experiments with two different setups: 1. Send every request to Claude Opus 2. Send every request to a router with Haiku, Sonnet, and Opus The first experiment ran 550 deterministically graded academic prompts through every setup. Auto Routing was 69% cheaper while retaining 98% of the baseline quality. The second experiment ran three production-shaped workloads through every setup, using user chats, developer chats, and long agent tasks. Auto Routing was 80% cheaper. Thanks to the TrueFoundry team for partnering with me on this post.

Santiago

15,543 görüntüleme • 26 gün önce

If you are going through life without access to this piece of gym equipment…. I sincerely feel for you You are missing out SO BAD Please comment your name below if you fall into this bucket so I can pray for you
0:27

If you are going through life without access to this piece of gym equipment…. I sincerely feel for you You are missing out SO BAD Please comment your name below if you fall into this bucket so I can pray for you

Dean Turner

46,084 görüntüleme • 3 ay önce

Filling out your FAFSA every year that you are enrolled in college is crucial to getting access to the resources you need to pay for school! 💰 Get your FAFSA started at complete it as soon as you can. You got this!
0:42

Filling out your FAFSA every year that you are enrolled in college is crucial to getting access to the resources you need to pay for school! 💰 Get your FAFSA started at complete it as soon as you can. You got this!

Reach Higher

336,107 görüntüleme • 2 yıl önce

Still think the regular market is cheap? Bokku! is here to prove you wrong With Bokku!, you get true value for your money. Always check Bokku! first
1:07

Still think the regular market is cheap? Bokku! is here to prove you wrong With Bokku!, you get true value for your money. Always check Bokku! first

Bokku! - Discount Grocery Store

644,170 görüntüleme • 1 yıl önce

If you are trying to loose weight, this is for you. Check this out!
0:31

If you are trying to loose weight, this is for you. Check this out!

Fitnesstime

33,752 görüntüleme • 1 ay önce

"If you living your own life, if you are who you are and you know who you are and you live working towards realizing your mission in life, every sound out of your mouth is a prayer."
1:43

"If you living your own life, if you are who you are and you know who you are and you live working towards realizing your mission in life, every sound out of your mouth is a prayer."

Kentah Gwanjez

22,157 görüntüleme • 7 ay önce

"If you living your own life, if you are who you are and you know who you are and you live working towards realizing your mission in life, every sound out of your mouth is a prayer."
1:43

"If you living your own life, if you are who you are and you know who you are and you live working towards realizing your mission in life, every sound out of your mouth is a prayer."

Kentah Gwanjez

27,855 görüntüleme • 1 yıl önce

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.
2:52

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce

Is there someone in your life where you've run out of natural solutions? You've tried everything you can think of. You've had every conversation. You've made every call. And honestly, there's no way out in the natural. You know it. You feel it. But you are not without options. You have spiritual tools that can bring real breakthrough for them. If you have someone on your heart right now- a child, a spouse, a sibling, a friend, and you don't know what else to do, this message is for you. You are not powerless. You are an intercessor. *Click here: and I will send you the FREE WORKBOOK today!
0:55

Is there someone in your life where you've run out of natural solutions? You've tried everything you can think of. You've had every conversation. You've made every call. And honestly, there's no way out in the natural. You know it. You feel it. But you are not without options. You have spiritual tools that can bring real breakthrough for them. If you have someone on your heart right now- a child, a spouse, a sibling, a friend, and you don't know what else to do, this message is for you. You are not powerless. You are an intercessor. *Click here: and I will send you the FREE WORKBOOK today!

Paula White-Cain

12,659 görüntüleme • 1 ay önce

Imagine one day you wake up and realise 1) you don't have any fundamental rights. 2) Even if someone takes away your home your car, your family member is missing but you can't report any crime you can't go to court because they are not operating. 3) You are scared, unsure what the hell is going on in the country but there is no way to know because news is censored. 4) You are ill but strict timings for going out you can't go to hospital in stay inside hours. Are you scared?
0:25

Imagine one day you wake up and realise 1) you don't have any fundamental rights. 2) Even if someone takes away your home your car, your family member is missing but you can't report any crime you can't go to court because they are not operating. 3) You are scared, unsure what the hell is going on in the country but there is no way to know because news is censored. 4) You are ill but strict timings for going out you can't go to hospital in stay inside hours. Are you scared?

Kangana Ranaut

150,863 görüntüleme • 2 yıl önce

Life is short. Enjoy it and make the best of it! Naval “It’s even briefer than that. Each moment just disappears. It’s gone. There’s only a present moment, and it’s gone instantly. So if you’re not there for it, if you’re stressed out, or you’re anxious, or you’re thinking about something else, you missed it. So the true wasted time is a time that you are not present for, when you are not there for it, when you are not doing the thing you want to do to the best of your capabilities such that you’re immersed in it. If you’re not immersed in this moment, then you’re wasting your time.” Chris Williamson
1:58

Life is short. Enjoy it and make the best of it! Naval “It’s even briefer than that. Each moment just disappears. It’s gone. There’s only a present moment, and it’s gone instantly. So if you’re not there for it, if you’re stressed out, or you’re anxious, or you’re thinking about something else, you missed it. So the true wasted time is a time that you are not present for, when you are not there for it, when you are not doing the thing you want to do to the best of your capabilities such that you’re immersed in it. If you’re not immersed in this moment, then you’re wasting your time.” Chris Williamson

jay plemons

99,540 görüntüleme • 1 yıl önce

"Here are 3 things to do so you don't attract a Conservative: 1. Get a nose ring 2. Grow out your armpit hair 3. Grow out your leg hair Who wants a shot at getting with this woman? 🤣
0:29

"Here are 3 things to do so you don't attract a Conservative: 1. Get a nose ring 2. Grow out your armpit hair 3. Grow out your leg hair Who wants a shot at getting with this woman? 🤣

AmericanPapaBear™

111,444 görüntüleme • 1 yıl önce