Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

🚀 Excited to release AIBuildAI — an AI agent that automatically builds AI models 🏆 #1 on OpenAI MLE-Bench 💻 GitHub: Building AI models still requires a lot of manual work — designing models, writing code, training them, tuning hyperparameters, and iterating on results. We developed AIBuildAI to automate...

152,252 görüntüleme • 6 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

RSI section from the AI documentary Machine God The next threshold is Recursive Self-Improvement: the moment when AI can improve itself without human assistance. For decades this sounded like science fiction. Intelligence explosion scenarios imagined a system rewriting its own code, becoming smarter, then using that new intelligence to make still better versions of itself. But the idea looks less remote now that AI contributes directly to frontier science. In mathematics, recent systems have moved beyond solving contest problems to producing serious new arguments on long-standing open problems. AI is used to build physics world models and propose candidate theories or computational methods. These are early signs that machine cognition is entering the creative loop of science itself. The crucial transition comes when that loop turns inward. AI research is, after all, a technical discipline made of code, mathematics, models of information flow. These are exactly the domains in which frontier models are improving fastest. A model that can solve hard mathematical problems, write production-quality code, design experiments, read the literature, and evaluate benchmark results is already participating in the work of building its successor. At first this will look prosaic. AI systems will write kernel optimizations, improve training infrastructure, discover better data filters, tune reinforcement-learning pipelines, design new benchmarks, and suggest architectural modifications. Human researchers will remain in the loop, approving changes and interpreting results. But the important point is that the search process accelerates. The model becomes not just the product of the lab, but part of the lab’s research machinery. The system being optimized helps optimize the next system. This is the core RSI feedback loop: better models make AI research faster; faster AI research produces still better models; those models, in turn, become better researchers. The danger is that once this loop becomes sufficiently autonomous, it may stop resembling ordinary technological progress. Human institutions are slow because humans are slow: we read papers, attend meetings, debug code, sleep, argue, and wait for funding cycles. Machines do not have to operate on that timescale. An AI research collective can run continuously across millions of processors. This is the runaway possibility. Not that an AI instantly wakes up and recursively rewrites itself into a god, but that the entire AI ecosystem becomes an autocatalytic process. Capital buys compute; compute trains models; models improve models; better models attract more capital. At some point the dominant input into AI progress may no longer be human insight, but machine-generated insight, machine-written code, and machine-run experiments. Then the Butler-Land analogy becomes sharper. Humanity is no longer merely building machines. We are building machines that help build better machines. Once intelligence itself becomes part of the production function, the old categories — tool, worker, inventor, firm, market — begin to blur. The question is whether recursive self-improvement remains a managed industrial process, or whether it becomes the first technological process in history whose natural endpoint lies beyond human comprehension.

steve hsu

62,550 görüntüleme • 1 ay önce

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce