Загрузка видео...

Не удалось загрузить видео

На главную

🚨 [New Paper] The Adam optimizer is a zombie algorithm... It senses and adapts the learning rate, sure. But the update rule itself? Fixed, frozen. Decided before even the training starts. It works in some regions of the loss landscape and fails in others. What if the optimizer itself...

18,074 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

What happened to Jeffrey Sachs is not an argument. It is a ritual, the auto-da-fé of a dying civilization. Europe no longer debates. It excommunicates. Every time truth crosses its borders, it is denounced as heresy, burned in the square of public opinion, and buried under the flags of "values" it no longer lives by. The Italian senator who called Professor Sachs a liar wasn’t defending Ukraine. He was defending the psychological architecture of European dependence. He cannot admit the truth because his career, his ideology, and his identity all collapse if he does. Europe is no longer a continent. It is a colony that thinks itself free. Washington writes the script, Brussels recites it, and the people pay for the performance in cold homes and silent factories. They call it "solidarity." But solidarity with your own jailer is not virtue. It is pathology. Europe kneels before America and mistakes the floor for high ground. It sanctions Russia and bankrupts itself. It sacrifices its own citizens to fund a war it cannot win. It destroys its own energy, its own diplomacy, its own industry, all to prove its loyalty to a master who despises it. Jeffrey Sachs did not embarrass Europe. He revealed it. A continent that once produced Beethoven, Goethe, and Marx now worships at the altar of CNN and NATO press releases. It has traded reason for narrative and memory for submission. The tragedy of Europe is not that it was conquered. It is that it volunteered. It begged for occupation, and now calls vassalage "values." When Professor Sachs spoke, the Italian senator did not hear an argument. He heard a mirror, and mirrors terrify those who live by illusions. Europe isn’t being silenced by America. It is silencing itself out of fear of remembering what it used to be. A civilization that once claimed to civilize the world can no longer govern itself. It outsourced its sovereignty, privatized its conscience, and mortgaged its dignity for access to Washington’s approval. The slave masters of history have become servants in suits, begging their overseer for scraps of relevance. Europe is no longer a continent. It is an accent in America’s voice. And even that accent is fading.

Sony Thăng

363,260 просмотров • 10 месяцев назад

Introducing Headlong, an open source microharness for persistent agents: self-guided agents that think continuously. Most agent harnesses are reactive: you send a task, the agent completes it, and then it sits frozen until the next request. Cron jobs and heartbeats wake it up to run a checklist and put it back to sleep. A Headlong agent is never asleep. It keeps generating thoughts about whatever it decides is interesting, in a self-guided loop inspired by human inner monologue. Your message doesn't start a session. It's one more observation that lands in the agent's thought stream, and the agent decides if and when to reply. Headlong is built on the idea of persistent agency: continuous inner thought generation between external interactions. The agent sets its own interests and priorities, comes up with its own projects, and sometimes pings you unprompted with progress. To keep our prototype as simple and small as possible, we implemented Headlong as a microharness: a complete agent harness in under 10K lines of Bash, organized as a handful of small executables. It includes a loop that generates the next thought, shellm (a recursive language model written in Bash), a trajectory stored as a DAG of jsonl files, and context as a projection of that trajectory. We've been running one Headlong agent internally at Laude for several weeks. The whole team talks to it over Slack and Telegram, and every conversation lands in its single stream of thought. It works in its own fork of Headlong and we've pulled over 50 of its commits into main. One night, with nobody talking to it, it went back to check whether a recall process it had built was actually wired into its mind, found that it wasn't, diagnosed and fixed the bug, and verified the fix end to end. 48 minutes, no human asked for the fix or was in the loop at any point. Every step is a timestamped line in its log. Things broke too, and we wrote those up. Background thinking costs us $1 to $2 an hour, our agent stopped its own service three times by accident, and self-delegation died on day one. Details in the post. One line installs everything and starts an agent. Use a dedicated sandbox and spend-capped API key; it runs real shell commands and thinks around the clock. Headlong is research software, be careful! curl -fsSL | bash Launch post: Repo: Headlong is a Laude Institute / MIT collaboration.

Andy Konwinski

357,082 просмотров • 18 дней назад

Elon Musk, absolute leader of the AI race with Grok Bot, and it's not a joke anymore. Ultimate guide on god-mode setup of Grok Bot, the org chart that runs while you sleep, step by step: A Chief of Staff sits in the middle with no tools of its own, BUT it reads the outcome you gave it, picks who does what, and never does the work itself. That one rule is why it never turns into the bottleneck you hired it to remove. → Researcher pulls real sources and tracks what's actually moving, not what sounds true → Writer turns that into finished copy while the research is still in the room → Visualiser gets three reference visuals once, then ships everything in that style forever → Analyst reads what performed and tells the rest of the team what to stop doing → Scheduler owns timing and holds the queue → Publisher actually ships What makes it different from every AI tool you've used: each bot gets its own computer in the cloud, its own browser, its own files, and they all share one memory. So the research is already sitting inside the draft before the draft starts. Nothing gets copy-pasted between tabs, nothing waits on you to approve step four of nine. And you never write a workflow for it. You hit record, do the job once the way you actually do it, stop. It pulls out the steps, saves them as a skill, and puts it on a schedule. The shape you're aiming for on every bot: everything reversible finished, nothing sent. 36 drafts queued, 0 published. It does all the work and stops dead at the one line only you can cross. You stop prompting. You start assigning. Full charter blocks, the approval line and the routines are in the article below ↓

Miraqle

86,840 просмотров • 22 дней назад