Загрузка видео...

Не удалось загрузить видео

На главную

An hour of lab evals catches a model that doesn't work. It won't catch one that fails once every two hundred trials, or degrades over a week, or runs fine on this robot and badly on the one beside it. So the eval moved to where the work is....

10,964 просмотров • 17 дней назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Someone just posted the full blueprint for an AI swarm that does the job of a 200-person quant research team. Six agents. Running 24/7. Finding brand-new alpha while you sleep. Citadel needs 100 PhDs to do this. Two Sigma needs 200. This does it with six bots and one laptop. Two ways to play this - spend a weekend building your own swarm, or copy the wallet of one that's already up $2M: Boris Cherny runs Claude Code at Anthropic. Two weeks ago he said: "I don't prompt Claude anymore. I have loops running that prompt Claude. My job is to write loops" Alpha research is just a pipeline. So instead of sitting in it, you hand each stage to its own agent: > one reads every new research paper overnight and pulls out the trade idea > one builds the features and cleans the data > one backtests it over 20 years, costs and slippage included > one runs the hard stats and kills anything overfit > one checks it still works in every market regime > one strips out plain momentum and value to see if any real edge is left Each of those six is a job a fund pays a $600,000-a-year quant to do. He runs all six for the price of an API bill. The rule that makes it work: the agent that builds a signal never gets to approve it. A separate, stronger agent tries to kill it first. Whatever survives all six by morning is real, new alpha. One trader's already running this exact swarm on Polymarket. That $2M wallet is public, every trade on-chain. The full build is in the post below - six agents, the tool that runs them, and the five mistakes that kill most people. Bookmark & read this before it's buried.

cvxv666

103,734 просмотров • 2 месяцев назад

The AI that will replace lawyers was just built for $40 million, and every lawyer alive helped train it themselves. Frontier labs spend billions to reach the top. But here we have a 150-year-old legal publisher who got there for $40 million. Thomson Reuters owns Westlaw. Every lawyer in America has paid to use it. It's the database you search to find the case that wins your argument, and the profession has run on it for generations. And they just turned it into a weapon. They took a free open-weight model off the internet. Then they poured Westlaw into it: 40,000 databases, 150 years of legal writing, all curated by the profession itself. The result beats some frontier models at legal work. And the $40 million was mostly talent and two years of work. The final training run cost about $450,000. That's the machine aimed at a trillion-dollar profession, trained for the price of one associate's salary. Every ruling a lawyer ever wrote, every brief that got published, every annotation an editor ever added to Westlaw is the fuel. The archive that lawyers spent a century building is the exact thing now being trained to do their jobs. The model is called Thomson. It runs at a fraction of the cost of a normal frontier model, because it's small and specialized instead of giant and general. You don't need a $500 billion supercluster to replace a knowledge worker. You need their field's best data and about $40 million. So think about who else is sitting on decades of proprietary data: - Every medical publisher - Every accounting firm - Every engineering standards body - Every company that ever made its experts write down what they know The tool that ends the billable hour just proved the playbook. And the playbook works on almost every white-collar profession that runs on a specialized archive. But also keep in mind that Thomson Reuters owns this content outright. No customer's private files went into it, and they say the goal is to make lawyers faster, not to fire them (that's what they say). Today Thomson only does one job inside CoCounsel: Reviewing stacks of documents and sorting them into tables. It isn't arguing cases yet. A better research tool has always meant one lawyer does the work of three, not that the other two vanish. The trouble is what "faster" has always meant in practice. When one lawyer can suddenly do the work of five, a firm doesn't keep five lawyers. It keeps one and bills the same. The junior associate who used to do the research is the cost that DISAPPEARS. Big Law was built on armies of associates grinding through documents by the hour. That grind is the exact job Thomson does now in seconds. So the profession that spent 150 years filling the archive just watched that archive get turned into the thing that makes most of them unnecessary. Who does it next and in what field?

Ricardo

26,901 просмотров • 18 дней назад

JUST IN: Dyna Robotics just published one of the most important research papers in robotics this year. It could fundamentally change how robot foundation models are trained. A scaling law that transfers from human video to robot performance. Dyna-2 is out and it's 🔥 Here's what that means in plain terms. Dyna-2 was pre-trained on ONE MILLION hours of egocentric human video, 170 years of continuous human experience, cooking, folding, assembling, cleaning. And as that human data scaled, robot performance improved. Predictably. Monotonically. Across 39 tasks on two different robot embodiments the model had never seen. → 1,000 hours pre-training → 20% normalised task performance → 10,000 hours → 28% → 100,000 hours → 45% → 1,000,000 hours → 53% Human video exists at effectively unlimited scale. Every cook, every factory worker, every craftsperson wearing a camera is generating training data for future robots. But the finding that stunned even the researchers, world modeling is what makes the transfer work. A model trained to predict future video AND actions massively outperforms one trained on actions alone. Video is the new scaling axis for robotics. One more jaw-dropping data point. 13 minutes of teleoperation data was enough to fine-tune Dyna-2 to open a bottle cap using two five-fingered robot hands. The robots are coming, and they're learning from us directly :D Read more here: Congrats Jason Ma and team! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

23,576 просмотров • 1 месяц назад

Anthropic ex-engineer runs an internal graph that costs $6 a month and catches what a $300,000 eval suite misses. No retrieval layer. Seven nodes and one rule about who's allowed to change their mind. He published the whole schema. His version starts from the opposite idea. A graph is not an execution order. It's a memory of why. Seven nodes. Every edge carries the reason it exists: > INTENT - states what the task is for. Never how > DECOMPOSE - splits it into steps, each with a stated assumption > WORKER - executes one step. Sees nothing else > AUDIT - checks the output against the assumption, not the goal > DRIFT - compares the current step to INTENT and flags divergence > LEDGER - stores every decision with the assumption that justified it > ROOT - holds the graph, and when an assumption breaks, re-runs every step built on it Six nodes act. One node remembers why they acted. Every step carries the assumption that made it correct, so a false one only reruns what stood on it. That's the entire design. A pipeline that forgets its reasons has to redo all of it or trust all of it. He replayed a month of agent runs. 4,100 steps, 380 built on an assumption that was wrong by day three. The old pipeline shipped all 380 and linked none of them. Everyone else builds graphs where output moves forward and the reasoning evaporates. He built one where the reason travels with the result. The blast radius is the output nobody else produces. The article below is the full build - node prompts, the assumption format, the invalidation rule that finds every step downstream of a broken one. Save it. You'll want it open in the other

wast3

305,732 просмотров • 20 дней назад