Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

"Closed models are cheaper. The reason you need open models is that they give you control". - Nvidia CEO Jensen Huang "One of the things that people misunderstand about open models is this: yes, you can host them yourself, and you can build your own computer. But most people...

24,839 görüntüleme • 1 gün önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 görüntüleme • 24 gün önce

Culture is genetic because behavior is genetic. This beaver never saw a dam in its life. No beavers or anything else ever taught it to build a dam. It wants to build a dam because it is a beaver. Many beavers together build a big dam. That is beaver culture. Humans are not different. Nothing is different. This is what life is. This is how life works. Your body is your mind. A caterpillar wants to build a chrysalis. A bee wants to build a hive. A lion wants to build a pride. You are not special. You are not above your nature. you are INSIDE of it. The thoughts that we think are genetic thoughts. The crimes we commit are genetic crimes. The art we create is genetic art. Just like this beaver, you can give the animal different sticks and it will build a different dam, but it will always build a dam. And you can give humans different "education," but the human will always use it to do what its genes tell it to do. This is the first big answer that you need. This is the biggest piece of the puzzle. This is how to understand people 90% of the way. You just... notice what they do, and get out of the way, and watch them do it. And if they need sticks, you give them sticks. And if you don't like what they do, you have to get away from them. You cannot train dam-building into them or out of them any more than you can with a beaver. A beaver wants to build a dam because it is a beaver. Whatever you see people build, that's what they wanted to build from the sticks they got in the river they were in. Stop pretending you can change it.

hoe_math = PsychoMath

1,189,824 görüntüleme • 11 ay önce

"You can either produce excellence or you can avoid criticism. But you cannot do both of those. The reason that you don't have certain excellence that you want is because you are afraid of getting criticized. You are afraid of the judgment that comes with it. You are afraid of standing out. You are afraid of being alone. You are afraid of people looking at you. You are worried about what people think of you. There are 2 categories of things in this world: 1) Things that are up to you 2) Things that are not up to you Which category does your reputation sit in? Your reputation is not up to you. I'm the one who associates your reputation with something, not you. You just do things. What's up to you? How you act. Your decisions. Your actions. That is up to you. Your reputation is not up to you. Here's how I know that: You all have a reputation about me and it's not in my control. I get to say and do whatever I say and do up here. I am in control of saying it. I am in control of doing it. The moment words leave my lips, who has control over what is done with those words? You! You are in control of what you think of me. And there's no way everybody in this room is going to think the exact same thing about me. No way. When it comes to exceptional, what we've got to understand is you can spend your whole life trying to avoid criticism and earn reputation, and it still won't be in your control. We can waste a lot of time missing out on excellence we could have been producing if we were just simply LESS trying to engineer what we wanted other people to think about us."

Brian Kight

308,812 görüntüleme • 1 yıl önce