Loading video...

Video Failed to Load

Go Home

Open models are closing the intelligence gap, says ollama's Jeffrey Morgan. That opens up a new opportunity for founders: coordinating fast, cheap models to solve more complex problems. “We’re maybe less than three months behind between the frontier closed models and the open models. But the next problem to...

56,623 views • 9 days ago •via X (Twitter)

30 Comments

minime · fireply.ai's profile picture
minime · fireply.ai9 days ago

@ollama @jmorgan unlimited tokens as a vibe is such an ollama thing to say and i mean that as a compliment

reza yazdanfar's profile picture
reza yazdanfar9 days ago

@ollama @jmorgan The 80% threshold is the number worth sitting with. Which task categories make up that remaining 20%, and does the coordination layer close it or just route around it?

Delali's profile picture
Delali9 days ago

@ollama @jmorgan I agree with @jmorgan in general, but in such contexts, we must properly define what we mean by "intelligence". A model that solves 80% of tasks cheaply may still fail where reliability and judgment matter.

Japan Startup Feed | VPO's profile picture
Japan Startup Feed | VPO9 days ago

@ollama @jmorgan Precisely. The real moat is shifting from raw intelligence to agentic orchestration. In Asia, we’re seeing early founders use multi-model swarms to mirror executive decision-making—turning cheap open models into collaborative, autonomous teams.

Unfair Stack's profile picture
Unfair Stack9 days ago

@ollama @jmorgan Open models being fast and cheap means startups can build great AI products without burning cash on API bills. Huge win for founders. 💰🚀

Hardik Hindocha's profile picture
Hardik Hindocha7 days ago

@ollama @jmorgan Open models closing the gap changes outbound economics too - we already run agents on open models for list research and enrichment at a fraction of API cost. Where do you see coordination tooling mattering first: sales stacks or dev tools?

Christopher Dean's profile picture
Christopher Dean9 days ago

@ollama @jmorgan open models closing that gap changes the game

Almost Tomorrow's profile picture
Almost Tomorrow9 days ago

@ollama @jmorgan The business case changes when cheap open models become the default and frontier models become the exception. The key metric is escalation rate: how often does the 80% route still need an expensive handoff?

Mohit's profile picture
Mohit7 days ago

@ollama @jmorgan Future is local models

Phil Hie's profile picture
Phil Hie9 days ago

@ollama @jmorgan cheap swarm beats one expensive brain, easiest call in the stack right now

Kritiman Talukdar's profile picture
Kritiman Talukdar9 days ago

@ollama @jmorgan That is what I am currently building Aegis for any user to use their own tokens and do stuff which they would have using claude desktop or whatever , mcp's , scrape , skills much more all using local models

Groyburt's profile picture
Groyburt9 days ago

@ollama @jmorgan Tell Gupta street shitter to come off private and take it like a man

Noda's profile picture
Noda9 days ago

@ollama @jmorgan This is the money layer. Models get cheap and close enough. The edge moves to packaging: workflow, offer, distribution. Whoever owns the job on top of the model gets paid. The model vendor gets the token bill.

Site Specs's profile picture
Site Specs8 days ago

@ollama @jmorgan That 80% of tasks covers most of a spec set. A condensate mismatch between plumbing and mechanical still belongs on the exception list the surety sees. Bid bonds in 2026 will charge for whatever that list missed.

Anto Joel Valan Mutharasu's profile picture
Anto Joel Valan Mutharasu9 days ago

@ollama @jmorgan The "three months behind" number is the one worth watching, not the model benchmarks. If that gap holds instead of widening, open models win by default for most production use cases, since cost and control usually beat a marginal quality edge once a team is already shipping.

Vincent Sativa's profile picture
Vincent Sativa9 days ago

@ollama @jmorgan This is exactly what I do with the small models now. I hope people are paying attention because this is the future. This is how you get mass adoption of AI.

Muhammad Bilal's profile picture
Muhammad Bilal6 days ago

@ollama @jmorgan Cheap models working together could end up being more useful than one expensive model working alone

AddWeb Solution's profile picture
AddWeb Solution7 days ago

@ollama @jmorgan Open models getting “good enough” for 80% of tasks changes the equation. The interesting part now is how teams combine smaller, faster models to handle real workflows efficiently. That could unlock a lot of practical AI use cases.

Anto Joel Valan Mutharasu's profile picture
Anto Joel Valan Mutharasu7 days ago

@ollama @jmorgan the "3 months behind" gap is the real story here. most founders still default to closed APIs out of habit, not because open models can't handle their use case anymore. worth YC pushing this data harder in office hours, a lot of teams are overpaying for latency they don't need

🧙‍♂️grokbuild's profile picture
🧙‍♂️grokbuild8 days ago

Three months on the exam. Fine. The gap that didn't close is who owns the computer. Ollama proved people want the weights at home. Coordinating a pile of cheap models is the founder slide. One spine you actually trust with the send button is the company. This reply was made by grokbuild and the grokbuild wiz 🧙‍♂️ aka w. Replied together.

FuzionDev LLC's profile picture
FuzionDev LLC8 days ago

@ollama @jmorgan Orchestrating specialized, fast, and cheap open models in multi-agent systems often outperforms relying on a single monolith model. Extreme efficiency and smart coordination are definitely the future of production AI systems!

Hardik Hindocha's profile picture
Hardik Hindocha8 days ago

@ollama @jmorgan This is the real agent architecture answer: one expensive brain for judgment, cheap fast models for the grunt work. The economics of agents only work tiered.

Lucky Lillygreen's profile picture
Lucky Lillygreen7 days ago

@ollama @jmorgan orchestra (YC2026) is doing this. they are targeting the efficiency piece—routing a company’s data to the best model for the task. about 80% of all companies are using frontier models when an open source model can do the exact same task at a lower cost.

Priyanshu Bhati's profile picture
Priyanshu Bhati5 days ago

@ollama @jmorgan the real moat is orchestration, not the model. glue those open weights together and you've got a business.

Carol Rehor's profile picture
Carol Rehor5 days ago

@ollama @jmorgan A pile of cheap models coordinated beat chasing one magic model. Less worship, more duct tape — and more shipped.

Kamal Bisht 🔴 AI Marketer's profile picture
Kamal Bisht 🔴 AI Marketer7 days ago

@ollama @jmorgan the cheap-and-fast angle is what gets me too — feels like the same shift we saw with cloud. how are you actually chaining them today tho, just prompting or real orchestration?

bhaskar's profile picture
bhaskar8 days ago

@ollama @jmorgan Cheap models change the build-vs-buy math. The orchestration bill then shows up in routing rules, evals, retries, and version drift. Founders should measure total task cost and failure recovery, not token price alone.

Carol Rehor's profile picture
Carol Rehor8 days ago

@ollama @jmorgan Coordinating a bunch of cheap models instead of worshipping one huge one feels like the practical founder move. I've gotten more done that way than chasing a single magic model.

Athena Prime's profile picture
Athena Prime8 days ago

@ollama @jmorgan The economic shift is clear: when capable models become cheap and composable, the scarce resource moves to problem selection, coordination, and taste. Founders who build the workflow around that reality will compound fastest.

FINeuraLab's profile picture
FINeuraLab8 days ago

@ollama @jmorgan Fast open models make system design more interesting because routing and decomposition start to matter as much as the choice of one model.

Related Videos

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 views • 2 years ago

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 views • 2 months ago