Загрузка видео...

Не удалось загрузить видео

На главную

SITUATION EXPLAINED: 70% of frontier model queries could run locally for free. clem 🤗, co-founder and CEO of Hugging Face: "There was an interesting study from Stanford published last year showing that 70% of the queries that people ask to ChatGPT could be accurately answered locally on your laptop....

50,185 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 просмотров • 2 месяцев назад

.Haseeb Qureshi >|< calls any team not running its releases through frontier-model security scanning "delinquent": "We are in a world where the previous rules around cybersecurity no longer apply. Because the reality is, if you can find this bug for $2, the team that was building this also could have done security scanning for $2. What were they doing?" "GLM has been out for a while. Kimi obviously more recent, but even just doing this on Opus would have cost probably four or five times that at most. Supposedly somebody ran Claude Code and found this in two minutes." "So what all this tells you is that there are companies that are going to survive this transition, and there are companies that are not. And there's going to be this kind of COVID-like mass inoculation period that we're going through right now in cybersecurity." "It's probably going to be a very centralizing force, because it means there's gonna be more consolidation toward the companies that have good security practices, have enough money to spend real dollars on security engineering, and are gonna be running every release through thousands of dollars of security scanning from frontier-level models." "If you are not doing that now, you are delinquent. You are already behind. You are putting your users and your company at risk." "AI is kind of an everything technology. It's like this background radiation now that is just touching everything that is software based." Dragonfly >|<

MTS

12,086 просмотров • 1 месяц назад

J-Cal Explains Why Google is UNDERRATED in AI 👀 On E227, the besties discussed Google's value in a post-search world if AI replaces traditional search. @jason broke down why he thinks Google is being slept on: "I think there's a chance that we're underestimating the power of Google's ad network right now." "They have four or five products that are one or two billion users per month. You have YouTube, Google Docs, Android." "They have such a data advantage and such a deep integration into people's lives because they use three or four services, I think Google's gonna figure this out." "It's quite possible that knowing your queries in Gemini, knowing what you're doing in Calendar, knowing what you're watching on YouTube could lead to a stream of more targeted ads that do better and are more valuable." "We've been seeing a number of startups that are figuring out how to use your queries and what you're doing in AI to present to you search results." "So imagine you're doing a Gemini search and on the side of it, it's giving you a rolling list of ads or offers that you might be more interested in." "That could be a better advertising product than even search itself." "I think YouTube search is the place to go all-in." "Right now, when you do a YouTube search, it just gives you 10 links, right? It just gives you that rolling thing." "You should be able to ask a question to YouTube, and you should be able to ask questions to your calendar." "You should be able to say, who have I met with over the last 10 years? Who I'm no longer in touch with and what are they up to?" "And it should do a Gemini search inside of Google Calendar. It's very light right now." "And then if you did that on YouTube, this would train people at the point of pain in a very deep way without sacrificing Google Search queries too aggressively."

The All-In Podcast

58,275 просмотров • 1 год назад

Baseten Head of AI Model Training Charlie O'Neill says the future is many specialized LLMs dedicated to specific tasks, with bigger labs deployed on the frontiers of areas like science and math: "People are thinking about intelligence capabilities in the wrong way. People are thinking about intelligence relativistically. They say, 'OK, the open-source gap is like 6 months behind closed-source, and GLM 5.3 is as good as Opus 4.8,' or whatever." "The best way to think about what models can do for you, and for the world, is in an absolute sense." "So for any given task that you want to do with an LLM, there's some intelligence threshold where below that you can't do the task, and above that you have very diminishing returns to more intelligence on the task." "So when you think about it that way, the game of LLMs over the last 5 years has been, 'OK, we have these things we want to do with them. Closed source hits it first... but open-source can eventually do that task. And then for many reasons, once you have the base level of intelligence required to do it, you probably do want to swap to open-source." "It's not really about the [frontier lab] God model being better. Like, if I'm filing a tax return, there is a limit to how much intelligence I need to do that particular thing." "So I think the world is going to look like — frontier closed-source labs are going to continue to push the frontier. You do want to use the most intelligent model. You have very inelastic demand for intelligence when you're doing frontier science or frontier math." "But for a lot of the economically valuable things, it looks a lot like, 'I'm a Cursor, or I'm one of these big companies who are realizing I can't just be a wrapper anymore. I've been through the life cycle of building a product that people love. And I should be using that information to make my model better at the things that I care about, and not at anything else.'"

TBPN

50,531 просмотров • 22 дней назад