Loading video...

Video Failed to Load

Go Home

"Civilization is the only example of super intelligence." Our CEO @davidpstout on Startup Project explaining why we're building millions of specialized models across devices — not one giant model in the cloud. A few highlights: – Why prompting loses money – 8B models matching GPT-3.5 – How we beat...

325,138 views • 9 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

✈️ Starting the day in Istanbul. Let's talk AI. The future of AI won't be shaped by size, but by precision. Lately I've been diving into what OpenLedger has been building, and I think we're witnessing one of the most important hard forks in AI: 👉 From giant generalist models 👉 To focused, hightrust AI agents Here's why that shift matters , and why OpenLedger's vision makes perfect sense: ✅ Specialized > Generalized General AI can do many things. But specialized AI? It does one thing extraordinarily well. Tailored models don't waste compute on irrelevant context, every parameter is purposedriven. ✅ Explainability isn't optional anymore In highstakes sectors like finance or healthcare, because the model said so won't cut it. We need transparent reasoning paths. Models must show how they reached conclusions , not just what they concluded. ✅ Trust comes from traceability With OpenLedger's Proof of Attribution, each AI decision is traceable, verifiable, and tamperproof. We're talking onchain records of who contributed what , accountability by design. ✅ Less hallucination, more signal Smaller, specialized models trained on clean, domainspecific data are far less prone to hallucinations. Clear boundaries = higher reliability. ✅ Efficiency is the real scalability Deploying one massive model for everything? Expensive, slow, and unsustainable. Specialized AI is leaner, faster, and far more costeffective. In short, OpenLedger isn't just following a trend. They're laying the rails for the infrastructure layer of verifiable, domainaware AI. And in a space flooded with blackbox models and hype, that clarity hits different.

Crypto Sinan

13,636 views • 11 months ago

We made a thing! Very happy to announce sqlcoder-pro and the Defog Alignment Platform. Available to use immediately without a wait-list, weights will be open-sourced very soon. The video does a quick show and tell comparison against ChatGPT (with gpt-4o). Read on for more details! TLDR 💪 equal (or better) performance on text-to-SQL as the most capable Claude-3.5 or GPT-4 models 🤝 You can use it today on a free plan/free trial, without a waitlist 🪽 self-hostable on a single RTX4090, with 2 second median generation times for SQL queries 🔁 exactly the same output every time, give the same prompt 👨🏻‍🏫 teachable and steerable: show the model what you want it to do 🛞 debuggable – you can understand WTF is going on inside the model, instead of treating it like a black box Let's dig into each of these one-by-one! Performance SQLCoder-8b-pro significantly exceeds the performance of our previous sqlcoder-8b model on Postgres text-to-SQL (from 88.2% to 90.2% accuracy - gpt-4o is at 87.6%, for reference). It is also better at following instructions. This was done via self-merges, hand crafted fine-tuning data, and adapting the training data to fit our tokenizer. Cost You can host this on the model on a single $3,500 RTX4090, and support ~5 requests/second via VLLM. If you're looking to host on the cloud instead, you can run it on a single L4 GPU that costs $300/mo on GCP Repeatability We have a dense 8b model with no MoE shenanigans. For the same prompt with temperature=0, you'll always get the same answer – which is critical in BI. Teachable In our alignment and feedback modes, you can give the model feedback on how it answered certain questions, and it will automatically adapt to the feedback. Debuggable You can use logprobs and attention scores to determine where, exactly is the model paying attention to inside a prompt + what it's getting confused by when generating outputs. Available today You can use Defog on the cloud today by going to docs[dot]defog[dot]ai, and getting an API key. Excited to hear what you think!

Rishabh Srivastava

13,460 views • 1 year ago