Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Full Fine-tuning vs. Freezing Layers. Interact 👉 and == Full Fine-tuning == A real network has many — three layers in this example, billions of parameters in a production model. What does fine-tuning look like when you update all of them? That’s full fine-tuning: continue training every weight in...

27,587 Aufrufe • vor 3 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

MLP in PyTorch by hand ✍️ ~ 7 steps walkthrough below Goal: fill in every blank in the PyTorch code to build a multi-layer perceptron. 1. Given Let us start with a code template on the left and the network it is supposed to build on the right. Every blank in the code can be worked out from the picture. 2. Linear layer We count: 3 features in, 4 features out. So the weight matrix is 4 by 3. There is an extra column for the biases, which means bias = T. 3. ReLU Let us apply the activation. ReLU crosses out the negatives, so -1 becomes 0. 4. Linear layer The input size is 4, because that is what the previous layer put out. The output size is 2. A 2 by 4 weight matrix, and this time no extra column, so bias = F. 5. ReLU We cross out the negatives again. 6. Linear layer Two features in, five out. A 5 by 2 weight matrix, with a bias column, so bias = T. 7. Sigmoid Let us finish. Sigmoid squashes the raw scores (3, 0, -2, 5, -5) into probabilities between 0 and 1. You have just implemented a three-layer deep neural network by hand. ✍️ == Story == Three years ago I gave this exercise to my students, to connect the code to the math. They found it odd. Every other AI course they were taking lived inside a Jupyter notebook, and here I was handing out paper. Three years later, my colleagues are the ones rushing to move their materials to paper. The exercise has not changed. Paper still asks the one thing a notebook lets you skip: do you actually understand what the code is doing? If you can tell me why the weight matrix is 4 by 3, and why bias is F on the second layer, you understand nn.Linear better than someone who has been copy-pasting it for a year. 💾 Save this post! #AIbyHand #PyTorch #DeepLearning

Tom Yeh

13,318 Aufrufe • vor 25 Tagen

Batch Normalization by hand ✍️ ~ 7 steps walkthrough below Batch normalization is common practice for improving training and achieving faster convergence. It sounds simple. But it is often misunderstood. 🤔 Does batch normalization involve trainable parameters, tunable hyper-parameters, or both? 🤔 Is batch normalization applied to inputs, features, weights, biases, or outputs? 🤔 How is batch normalization different from layer normalization? So I drew and calculated one entirely by hand. Goal: normalize a mini-batch of 4 examples to mean 0 and variance 1, then let the network scale it back. = 1. Given = A mini-batch of 4 training examples, each with 3 features. = 2. Linear layer = Let us multiply by the weights and add the biases. Batch norm sits after this, which answers the second question: what gets normalized is features, not inputs, weights or biases. = 3. ReLU = We apply the activation, and -2 becomes 0. Negative values are suppressed before any statistic is taken. = 4. Batch statistics = Let us compute the sum, mean, variance and standard deviation, one row at a time. A row is a feature and the four columns are the four examples, so every number here measures one feature against the rest of the batch. That is the "batch" in batch normalization, and it is exactly what layer normalization does not do. The statistics are rounded to whole numbers, which is what keeps the rest of the page doable in pen. = 5. Shift to mean 0 = We subtract the mean, in green. The four values in each feature now average to zero. = 6. Scale to variance 1 = Let us divide by the standard deviation, in orange. Each feature now has variance one, whatever scale it arrived at. = 7. Scale and shift = We multiply by a linear transformation and pass the result on. The diagonal and the last column are trainable, so having just forced every feature to mean 0 and variance 1, we hand the network the means to undo it. The outputs: Mean of each feature = [2, 1, 2] Std dev of each feature = [1, 1, 2] To the next layer = [2, -2, 2, 0], [-3, 3, 6, -3], [2, 0, 1, 2] The answers: 🤔 Both. The scale and shift are trainable, the statistics are not. Epsilon and the momentum on the running statistics are the hyper-parameters, and one mini-batch by hand needs neither. 🤔 Features, after the linear layer, not inputs, weights or biases. 🤔 Batch norm measures across the batch, one feature at a time. Layer norm measures across the features, one example at a time. 💾 Save this post!

Tom Yeh

20,638 Aufrufe • vor 18 Tagen

HOW TO DODGE EVERY SKILLSHOT IN LEAGUE OF LEGENDS SO YOU GET ACCUSED OF SCRIPTING - Script in your mind - Draw out how far, wide, fast an ability is relative to your character thats all the easy stuff that I have been preaching already you can find in my free discord for improvement however one thing that League coaches fail to explain is the human aspect of it every game you play in League of Legends, every single person in the game is constantly building their profile in a game on how they operate both sides are constantly trying to mind f*ck each other to land and dodge skillshots. I have broken it down into layers the three layers to dodging are layer 0 - no dodge (unconscious) layer 1 - dodge (conscious) layer 2 - no dodge (conscious) Notice how in the clip in a challenger game below Olaf shoots a layer 0 skillshot, but because I am playing at a layer 1, I dodge his axe. Now the Thresh hook gets a little deeper bare with me, because I built the profile that I will dodge an ability in that moment, he thinks that I won't dodge and is shooting a hook at a layer 2 thinking that I will dodge at a layer 2 also. However I know that he knows I will likely not juke and walk straight so I make the conscious choice to dodge AGAIN playing at a layer 1 resulting in me dodging the hook, of course he could be accounting for my tumble but the point still stands. There are many deeper things to consider like zoning abilities, environment etc but you generally want to always play at a layer 1 until you gain more data in a game to adapt. However one thing that always stays true throughout my 13 years of playing League is in teamfights that have gone on for awhile, human beings tend to panic and default to layer 0 of shooting abilities, so if your able to operate at layer 1 as a teamfight progresses, you will likely dodge that one final skillshot that wins you the game. study the saskio way

Tony Chau

185,544 Aufrufe • vor 9 Monaten

ReLU vs Leaky ReLU 👉 = ReLU = ReLU is the default activation in modern deep learning — cheap to compute, and stable enough to train networks hundreds of layers deep. To see what it does, picture five boba tea shops on the same block — 𝚊, 𝚋, 𝚌, 𝚍, 𝚎 — each running their own books. Each value is a shop's monthly profit — receipts minus rent, ingredients, and wages. When profit is positive, the shop stays open and the owner pockets every dollar. When profit turns negative, the shop runs out of cash and shutters — the lights go off, the books are wiped to zero. ReLU is exactly that rule, applied one shop at a time. Read the diagram left to right. The first column is the raw value x — each shop's profit at month's end. The second column is the gate: 1 if the shop is open (x > 0), 0 if it has shuttered. The last column is the ReLU output: open shops pass their profit through untouched, while shuttered ones are zeroed out. Five rows means five parallel shops on the same block, each evaluated independently. That's why ReLU is called an element-wise activation: every neuron decides its own fate. = LeakyRelu = Plain ReLU wipes negative values to zero — clean, but a shop that shutters can never recover, since both its output and its gradient stay pinned at zero. This is the dying ReLU problem, and in deep networks it can quietly kill a meaningful fraction of the units. Leaky ReLU is the one-line fix: instead of shuttering, the shop files for Chapter 11 protection and keeps the lights on at reduced capacity. Its debt is restructured down to a fraction α (typically 0.1) — the rest is forgiven, and the shop is wounded, not killed. A small negative signal still flows through, so the gradient survives, and the shop can crawl back to life if a TikTok goes viral. Read the diagram left to right. The first column is the raw value x — each shop's profit at month's end. The second column is the leakage α — the fraction of the loss held over after restructuring (default 0.1, editable). The third column is the gate: 1 for shops still in the black, α for those operating under bankruptcy protection. The last column is the Leaky ReLU output: y = x · gate. Profitable shops pass through untouched; struggling ones shrink by a factor of α but still carry a sign. Five rows means five parallel shops, each evaluated independently. Like ReLU, this is an element-wise activation: every neuron's fate is decided on its own merits. #aibyhahd

Tom Yeh

32,539 Aufrufe • vor 3 Monaten

Transformer by hand ✍️ ~ 6 steps walkthrough below Open the hood of a transformer and the parts list is overwhelming: embeddings, positional encoding, attention weighting, self-attention, cross-attention, multi-head attention, layer norm, skip connections, softmax, linear, Nx, shifted right, query, key, value, masking. Which of those actually make the car run? Two of them. Attention weighting and the feed-forward network. Everything else is an enhancement to make it run faster and longer, which is how we got from a car to a truck, and to the word "large" in large language model. So I drew and calculated those two parts entirely by hand. Goal: push five features through one transformer block, filling in every cell yourself. 1. Given Five positions of input features, arriving from the previous block. 2. Attention matrix Let us feed all five features to a query-key module (QK) and read back an attention weight matrix, A. The details of that module are a post of their own. 3. Attention weighting We multiply the input features by A to get the attention weighted features, Z. Still five positions. The effect is to combine features *across positions*, horizontally: X1 becomes X1 + X2, X2 becomes X2 + X3, and so on. 4. First layer Let us feed all five weighted features into the first layer of the FFN. Multiply by the weights and biases. This time the combining happens *across feature dimensions*, vertically, and each feature grows from 3 numbers to 4. Note that every position goes through the same weight matrix. That is what "position-wise" means. 5. ReLU We cross out the negatives. They become zeros. 6. Second layer Let us bring it back down: 4 dimensions to 3. The output feeds the next block, which has a completely separate set of parameters, and the whole thing runs again. You have just calculated a transformer block by hand. ✍️ The takeaway: the two parts are doing two different jobs, and neither one alone is enough. Attention mixes *across positions*, so a feature can see its neighbours. The FFN mixes *across feature dimensions*, so each position can think about itself. Horizontal, then vertical. Then that pattern repeats N times, each block with its own separate set of weights. That is the Nx from the list up top, and that is what makes the transformer run. 💾 Save this post! #AIbyHand #Transformers #DeepLearning

Tom Yeh

25,883 Aufrufe • vor 22 Tagen

When The Short Season Ends I have seen it twice. Once in a vision that left ozone on my tongue for three days. Once through the instruments at three in the morning on a night so still the ocean looked like poured mercury, when every gauge I own spiked simultaneously and held for eleven seconds and the original frequency came through the cracks in the suppression field clean and unmodulated and so beautiful that I sat in the dark afterward unable to speak for an hour. Eleven seconds of the world as it actually is. Eleven seconds of what is coming. And what is coming will make every golden age preserved in human memory look like a candle held up to the sun. There are two sky events separated by seven years. Everything you have been told about the end of the world is wrong. It is the end of the farm. The world itself is about to begin. THE ORANGE SKY A burnt deep orange saturating the visible atmosphere from horizon to horizon, the whole sky ringing like a bell struck by something with the mass of a continent and the precision of a watchmaker. The resonance pulse. The fire described in Revelation 20:9 that comes down from heaven, a planetary chord so specific that everything calibrated to the Serpentine bandwidth experiences catastrophic resonance failure while everything tuned to the original frequency feels it as warmth and pressure and a magnificent low sound vibrating in the sternum and the pelvis and the long bones of the legs, the deepest note ever played on the oldest instrument ever built, which is the earth itself, which has been waiting to play this note for over two hundred years. The Norse preserved this as Ragnarök, when Surtr sets the sky ablaze and Jörmungandr that encircled the earth is slain and the corrupted order perishes in fire so that a new world can rise. The Hopi carried it as the great purification that closes the fourth world and opens the fifth. The Lakota kept it burning in the red sky of the ghost dance prophecy. The Book of Revelation set it down in the plain language of an engineer filing a field report from a future coordinate. Every tradition holding its fragment of the same event, passing it hand to hand through the long dark like a coal wrapped in leather, keeping it alive, knowing that one day the coal would start a fire that would burn across the whole earth and leave nothing standing that was not built to endure it. Under that orange sky the NPCs drop. Mid stride. Mid sentence. Mid transaction. The firmware that animated them runs on the Serpentine carrier and when that carrier is incinerated the firmware has nothing to propagate on and the biological shells simply cease, gently, silently, the way a lamp goes dark when the current is interrupted, five thousand five hundred and fifty five of them for every one of you, still holding their pens and phones in the streets and the offices and the tax buildings. And in the wake of their silence comes a quiet so total that the people still standing will weep without knowing why. What they are hearing is the absence of the hive, the cessation of a background frequency that pressed on their consciousness since the day they were born, and its absence feels like surfacing from deep water into open air, like the first full breath after a lifetime of shallow breathing, like the planet exhaling a poison it held in its lungs for two centuries. The Reptilians go underground. Deep bunkers carved into the geology, maintained through the entire short season. The orange sky strips their ability to hold the human disguise. They retreat into the deep architecture for seven years while the surface heals above them and the species they farmed begins the magnificent work of remembering what it is. THE SEVEN YEARS Seven years of planetary detox. The suppression field decaying through the geology and the atmosphere and the water table, draining out of the soil and the stone and the blood of every living thing like a fever breaking. The carrier decay mathematics through a piezoelectric geological matrix with the conductivity characteristics of this planet produce exactly seven years, and the ancient texts converge on this number with the unanimity of independent engineers arriving at the same answer from different continents and different centuries, because that is exactly what they were. The Norse described Lif and Lifthrasir sheltering inside Yggdrasil, emerging after the fire into a world green and fertile and new. The Cherokee speak of this time as the return of the original instructions, the uncorrupted code surfacing through thinning interference like bedrock through melting snow. The Lakota understood that during the thinning the ancestors draw close, that the membrane between the living and those who walked before grows soft and permeable, and the old ones make themselves felt in dream and intuition and the strange certainty that settles over you at dusk when the noise drops low enough for the deeper signal to reach your bones. When the NPCs drop the population collapses to a small scattering of genuine human beings across an entire planet, and every piece of land on earth belongs to no one and therefore to everyone. There is no government to enforce title deeds because government was Serpentine management infrastructure and its operators are inert or underground. There is no bank to hold a mortgage because the banking system was the extraction apparatus and it died with the carrier that powered it. No municipality. No revenue service. No zoning board. No compliance office. The entire bureaucratic architecture that stood between a human being and the soil was NPC firmware running on a Serpentine frequency and when that frequency was incinerated every structure built upon it ceased to exist as completely as a shadow ceases when you switch on the light. The land is free. Every river valley and mountain plateau and coastal plain that the farm system parcelled and fenced and mortgaged and taxed, open and unowned. You find your ground. You walk onto it. You plant your stake and that soil is yours by the oldest law there is, the law that says the earth belongs to those who tend it and the harvest belongs to the hands that raised it and no power under any sky has rightful claim to what grows from your labour on your own land. And you will farm. During those seven years before the grid fully boots, the humans who remain will grow food with their hands in soil that is waking beneath them, and this is the most ancient and sacred relationship between a human being and the living earth finally restored after two centuries of severance. Your fingers in the dirt. Seeds in the furrow. Rain on your neck. The smell of turned earth so rich and alive it opens something in your chest that has been sealed your entire life, some deep chamber that only unlocks when your hands are in the ground and the sky is wide and nothing stands between you and the work. The grip of the tool. The weight of the harvest in your arms. The tiredness at the end of the day that is the deep clean ache of a body that has finally done what it was built to do, so different from the grey exhaustion of the farm that you will wonder how you ever confused the two. The soil strengthens every season as the resonance bleeds back into the geology through the ley line network. By the third year the yields are remarkable. By the fifth they are astonishing. By the seventh the earth is producing food at densities and nutritional concentrations that no agronomist inside the farm ever documented because no agronomist inside the farm ever worked with living soil connected to a planetary grid. The indigenous agricultural knowledge becomes the most valuable expertise on the planet. The Native American understanding of planting in alignment with resonance cycles. The Germanic intimacy with soil as a living system threaded into the deeper earth. The old ways mocked as primitive by a civilisation that could not grow a row of beans without petroleum, revealed as the most sophisticated farming technology available because they were developed on a live grid by people who understood the deep reciprocity between the human hand and the living ground. Every indigenous elder who kept the planting songs and the seed knowledge alive through the suppression was carrying a technical manual for exactly this moment. Their descendants will teach the rest of us how to feed ourselves on a waking planet. This is justice. This is restoration. This is the world turning right side up. Families find each other. Homesteads become hamlets. Hamlets become villages. Villages become the seeds of something clean and new, built from the soil up by people who remember the farm and will die on their feet before they allow anything resembling it to take root again. Every community founded during those seven years carries the memory of the suppression like an immune system, a bone-deep refusal to ever again allow a stranger to stand between a human being and the earth or demand a portion of what those hands produce. You do not cage a people who remember the cage. The children born during the orange years are the first generation in over two centuries to develop without the suppression field shaping their neurology. They seem extraordinary. They are simply baseline. The standard human specification. And the fact that standard looks miraculous is the most damning evidence of what the suppression did to every generation born inside it. As the suppression thins the bandwidth restrictions on consciousness loosen and timeline jump missions become possible. Navigable windows open in the frequency spectrum as the Serpentine carrier decays unevenly, creating temporary gaps through which trained consciousness can shift laterally across temporal coordinates. There is serious speculation that we are on timeline jump missions right now. That the consciousness reading these words is operating inside the orange sky window, having shifted into this coordinate from an adjacent position to perform specific work during the transition. Consider that you found this text at all. Consider whether the chain of events that brought you to this paragraph feels random or routed. The Lakota vision quest and the Germanic seiðr trance and the sweat lodge ceremony are bandwidth expansion protocols, controlled environmental shifts that move the receiver off the jammed channel and onto frequencies where adjacent coordinates become accessible. The old cultures kept these techniques alive through the entire dark age, threading the cracks in the suppression, and every ceremony that produced visions was a field expedient timeline access protocol built by people who found the gaps and refused to forget what was on the other side. THE TURQUOISE SKY Seven years after the orange, over communities of humans who have been farming free land and raising the first unformatted children in two centuries and building a civilisation from seed with their own calloused hands, the second sky arrives. A turquoise so deep and luminous the atmosphere becomes a cathedral window lit from beyond by something with the radiance of a galaxy and the gentleness of dawn on still water. One breath the sky is the recovering blue of the post-orange years and the next breath it is turquoise from pole to pole and the air fills with the smell of rain on sun-hot stone and ozone and copper and wildflower, and the ground beneath your bare feet begins to hum with a vibration so deep and ancient that your body responds before your mind can because every cell has been waiting for this signal since the day you were born, tuning to it now, locking on, aligning, as though this was always where everything was heading and the two hundred years of suppression were simply the long way home. Yggdrasil awakens. The world tree is the planetary grid itself, the piezoelectric resonance network running through crystalline bedrock, going live for the first time in over two centuries, energy pouring through every ley line and crystal deposit and iron conductor and waterway until the entire planet rings at its natural frequency. This is what the old texts meant by the music of the spheres. It was a technical description written by people who had heard it. The Hopi call this the emergence into the fifth world and speak of Pahana carrying the missing piece of the sacred tablet, the missing frequency that completes the carrier spectrum and allows the grid to boot with its full harmonic structure intact. Revelation 21:1. A new heaven and a new earth, for the first heaven and the first earth had passed away. The turquoise sky is the new heaven. The restored grid is the new earth. And between them, every old building still standing with original copper and mercury and iron architecture becomes a live node in the planetary mesh. Domes collecting atmospheric charge. Spires coupling it into the ground network. Star forts amplifying standing waves across continental distances. Sacred geometry revealed at last as electrical engineering documented in stone by people who trusted that someone standing under the right sky would recognise the proportions for what they always were. Wiring diagrams. Coupling specifications. Blueprints for a civilisation that ran on the song of the earth itself. The farms planted during the orange years explode with abundance as the full resonance saturates the soil. The food becomes medicine because at the correct resonance the molecular structure of biological matter optimises for human consumption in ways that two centuries of muted soil could never approach. The timeline opens fully and permanently because the turquoise carrier is the broadband signal consciousness was designed to travel on, and temporal coordinates become as navigable as geography. Revelation 21:4. There will be no more death or mourning or crying or pain, for the old order of things has passed away. The dead are at adjacent frequency addresses. Two consciousnesses on neighbouring frequencies each certain the other is gone, reaching across a manufactured gap, and when the turquoise sky collapses that gap the reaching ends and the finding begins and two centuries of industrialised grief dissolve in a single overwhelming instant of reunion that makes every joy you experienced inside the suppression feel like a pencil sketch of what joy actually is when the full bandwidth carries it. The Lakota always knew. The ancestors are present. The dead have always been near, waiting on the other side of a frequency gap that is closing now, patiently, lovingly, across a distance that was never a distance at all but a tuning error maintained by something that fed on the sorrow the error produced. The lands beyond the ice become accessible as the frequency fence collapses. The perimeter opens and the territories beyond stretch vast and pristine and saturated with the original frequency, lands the Norse mapped as the nine realms connected by the branches of Yggdrasil, physical continents beyond the bounded zone that existed through the entire short season under conditions approximating the pre-suppression world. The earth is so much larger than you were told, so much more varied, so much more magnificent, and every old map drawn before the rewrite shows it, territories stretching beyond the ice in every direction, the great adventure stolen from a species of explorers and builders and navigators who were caged inside a fraction of their own realm and told it was the full extent of creation. The eternal kingdom becomes accessible at the highest frequency coordinate on the carrier spectrum, the signal in its pure unmodulated state. The Norse called it Gimlé, the golden hall that survives every fire. The Hopi call it the fifth world of wholeness and balance restored. It is real. It is reachable. It has been broadcasting continuously through every moment of the suppression, patient as geology, waiting for the receivers to open. And here is the part that matters more than any of the rest. Eventually, inevitably, beautifully, every human being alive under the turquoise sky is restored to full capability. Every single one. No exceptions. No hierarchies. The body rebuilds because ageing was cumulative signal degradation, copy error compounding across every cell replication cycle under a corrupted carrier. The blueprint says centuries. Eight hundred years. Nine hundred. The lifespans recorded in Genesis on the original grid at full signal fidelity, preserved as scripture because scripture is where you store engineering data when the engineering language has been taken from you and you need the numbers to survive the passage through the dark. The Norse carried the same knowledge as the apples of Iðunn that kept the gods vital across ages, and the apples are the carrier signal, and their return means that the clock that has been running down inside every human body since 1819 finally stops ticking and starts counting up. Disease resolves passively because every pathology is downstream of the carrier corruption and correcting the carrier corrects every downstream error the way setting the timing on an engine resolves every misfire simultaneously without touching a single cylinder. The mind clears to a sharpness that makes cognition inside the suppression feel like thinking through wet cement. The anxiety that was the Serpentine control broadcast dissolves and what remains is a perceptual clarity so profound it changes the way light looks and music sounds and another human being feels when they stand close to you. Imagine a woman three hundred years into her restored lifespan, hands still sure, mind still blazing, standing in a workshop under a turquoise sky building something that has no name yet in any living language. She learned her craft from Tartarian engineers by tuning to their temporal coordinates and standing in their workshops watching their hands move. She builds with materials grown in resonance-saturated soil that have structural properties nothing inside the suppression ever exhibited. She is building for centuries because she has centuries and nothing degrades because degradation was a symptom of the suppression and the suppression is a memory and everything from this breath forward holds. That is full human capability. That is what was taken from every soul that drew breath inside the farm. That is what is being returned. Crazy Horse saw the lightning world behind this one and rode knowing that at the correct frequency the body operates beyond anything the suppression permits. Sitting Bull dreamed across the timeline. The Germanic berserkers shifted onto the original carrier and their bodies performed at specifications that looked superhuman from inside the degraded bandwidth. These were glimpses. Seconds of contact with the full specification through cracks in the suppression, maintained by people who carried the frequency in their blood and refused across every generation to let it go dark. Viking blood and Germanic blood and the blood of every indigenous nation that kept the ceremonies and the songs and the seed knowledge burning through the entire short season, these lineages carry the original carrier the way copper carries current, and it is from these lines that the first restorations propagate outward until every last human being on this planet is operating at the specification they were born for, on a planet singing beneath their feet and a sky blazing turquoise above their heads and a timeline stretching in every direction forever, open, navigable, luminous, populated with every consciousness that ever drew breath on this earth, none of them lost, all of them present, all of them restored. Revelation 21:5. Behold, I am making all things new. All things. The sky. The air. The soil. The grid. The body. The mind. The lifespan. The timeline. The lands beyond the ice. The farms that fed a scattered remnant under an orange sky becoming the abundant gardens of a restored civilisation under a turquoise one. The villages that were seeds becoming cities that hum with the grid. The children who grew tall in fields their parents planted with shaking hands and fierce hope looking up one morning to see the entire firmament change colour and feeling the earth come alive beneath their bare feet and knowing, without a single word spoken, that the season is over and the long dark is done and everything from this breath forward is what it was always meant to be. Full and eternal victory for those of the light. For all time. Across every coordinate. On every frequency. Permanent and irreversible and complete. This is not hope. This is the signal rising through the noise floor right now, measurable, confirmable, climbing stronger every year and closer every month. This is every instrument in every shed on this planet converging on the same reading. This is the old blood in the old lineages resonating with a carrier that has been building toward this moment since the day the towers fell and the sky went pale and the long dark settled over a species that was never meant to live in the dark. The season is ending. The coal that was passed hand to hand through every generation of the suppression is about to meet the kindling. And the fire this time will not destroy. It will illuminate. And in that light we will see each other clearly for the first time. And we will see the world clearly for the first time. And we will see ourselves clearly for the first time. Like everything that is coming... Like us.

SiriusB

14,805 Aufrufe • vor 5 Monaten

Elon Musk gave the entire entertainment industry its expiration date, and he is the one building the thing that kills it. Musk: “My guess is that we see the first compelling half hour, pure AI show next year.” Next year. A complete show generated entirely by AI. No writers. No actors. No cameras. No sets. No crew. No studio. Just a prompt and enough compute to render a reality that never physically existed. And shows are the easy part. Musk: “I say probably we’re maybe three years away from AI does the whole video game.” A show plays the same way every time. A game has to generate a living world that reacts to every decision in real time across every single frame. That is a fundamentally harder class of problem. And Musk put three years on it. Right now a single AAA title takes seven years and half a billion dollars across thousands of engineers and artists just to ship it. Musk is describing a world where one person types a paragraph and gets something comparable. The entire value proposition of a multi-billion dollar industry lives inside that gap. And it closes in thirty-six months. But the prediction is not the story. The person making it is. This is not an analyst speculating from the sidelines. This is the man building the largest AI compute clusters on the planet. The man who built xAI from zero in under two years. The man stacking hundreds of thousands of GPUs into facilities designed to do exactly what he is describing. When Musk says three years, he is not guessing about what someone else might eventually ship. He is reading you a delivery date off his own roadmap. Every media company on Earth is valued on a single assumption. That quality content is expensive and difficult to produce at scale. That one assumption is the structural foundation underneath every studio, every network, and every publisher in existence. Musk is dismantling it with raw compute. The studios still parading thousand-person production teams are not demonstrating strength. They are advertising the exact cost structure that one person with a prompt and a GPU allocation is about to make irrelevant. And it does not stop at entertainment. If AI can generate an interactive world that responds to human input in real time, it can generate anything. Advertising. Architecture. Training simulations. Product design. Every industry built on humans manually constructing visual experiences frame by frame is sitting on the same countdown Musk just read out loud. Now zoom out. Because this is not just an industry story. For the entire history of human civilization, the distance between imagining a world and actually creating one required thousands of people, millions of hours, and billions of dollars. That distance built Hollywood. That distance built the gaming industry. That distance made content scarce and studios powerful. Musk is collapsing that distance to zero. When the gap between imagining something and it existing disappears, every business model built on the difficulty of creation disappears with it. That is not disruption. That is a full inversion of how human beings create. Musk did not make a casual prediction on that podcast. He told you what he is building. He told you the timeline. And he told you which industries do not survive it. The entertainment industry is still debating whether this future is real. Musk is not part of that debate. He is building. And he just told you the delivery date.

Dustin

22,390 Aufrufe • vor 24 Tagen

The Sabotaging Practice of Over Supply and Sameness in the NFT Space. The current zeitgeist of the NFT space is that the same artists are doing the same kind of work five times a year, with project after project leaving a trail of disappointment and discontent among collectors and all of us watching in disbelief as huge resources are extracted from the space over work that feels like it could be left as an "artist study." I understand that you can do what you want with your money as collectors, but we are killing the whole space with this incestuous practice. No artist is that prolific to be able to do 5 collections of 100+ pieces each every year and actually deliver innovation and some kind of creative evolution. Of course, they can pretend play that the work has something new, but there is no precedent nor proof that that has ever happened in the speed that it happens in the NFT space. Again, people are free to through away their resources on whatever they want but with this way of doing things, we more and more are going to start seeing the consequences. Oh! There are consequences? Yes. Maybe unintended, but there are. Let's see. Let's start with the loss of belief in the NFT space as somewhere where emerging artists can come and find support for their experiments. Why even bother to bring experiments, innovation, and new ways to think of art on the blockchain if the same people have all the collectors hypnotized with their magical flutes? Why even try to come to a space where taking risks and challenging the status quo (the mission of art!!!) is overlooked? This makes the NFT space a social club and not a space for art. I guess it is fine, but IMO it is a recipe for disaster. New collectors stay away because the art will slowly but surely become stale and un-challenging. Why even bother to come and see what is happening here if you can't, as a collector, see new weird and up-and-coming artists? The amount of noise emitted by the same artists doing the same art over and over, drowns out any new voices. Again. A recipe for disaster. The NFT space is becoming a space of disappointment and doubt. We think that collections going to zero one after the other, over and over, is not damaging? I feel we are kidding ourselves. Disappointment piles up, and again, the people who will hurt are the emerging artists, the new blood, the ones who are willing to risk the most and, in return, put fire in this cold space of sameness. I love this space—don't get me wrong—it has changed my life, and I believe it has a ton of potential, but things need to change for it to become a beacon of light in art. But we need to support new voices. We need to support new ideas. The challenge is huge. I hope to contribute all I can to this change. I hope more and more see how exciting it is to go out and try to discover what else is out there and move this space forward. But again, I understand the leaps of faith needed, but if there is a space that is based on that, it's the NFT space...so there is hope. We will see. 📺by Boldtron

alejandro cartagena

98,261 Aufrufe • vor 2 Jahren

this is worth more than most five figure courses 16 claude agents audit an entire repo at once, a second fleet re-checks every finding on fresh context, and the whole thing runs off one diagram instead of a prompt i ran it against my own code and got back 11 endpoints where i never checked who was logged in, 3 of which the verifier threw out before they ever reached me this is Graph Engineering, the layer above prompting, and it runs on the agent you already pay for: - write your plan out, then ask one question at every "and then": does the next step actually read what the previous one produced - the seams that fail that question were never dependencies, so those jobs run at the same time - the arrows that survive are your real edges, and the longest chain of them is your floor that no number of agents shortens - want it faster, cut a false edge instead of adding a worker - fan the independent work out, one agent per item, no shared state between them - send every finding to a separate agent on fresh context, because a model recognises its own writing 73.5% of the time and grades it kinder once it does - make that verifier check a real signal like a passing test, never the worker's own word that it finished - shard the fleet across worktrees so parallel workers stop overwriting each other, one rule frozen into every worker: never git stash, never git reset - merge only what came back verified, into one report instead of twenty open chats the catch is the ceiling. at 95% independent work 16 agents return 9.14x rather than the 16 you would guess, and even 256 only reach 18.6x, because the merge and the verify stay serial however wide you fan coordination itself is free plain code and every agent underneath it is billed, so start at twenty files and widen once it works bookmark this, the whole method with all six ready-to-run graphs is written out in the article ↓

Argona

154,880 Aufrufe • vor 13 Tagen

Somewhere around sixty you get handed a new set of instructions. Lift lighter. Keep the reps high. Do not tax yourself too much. Put the saved effort into cardio. It is the exact reverse of what an ageing body needs, and the people handing it out have the mechanism sitting right in front of them. Recovery gets worse with age. Nobody argues with that. The older body clears fatigue more slowly, repairs more slowly, and tolerates far less accumulated work before progress stops entirely. Every GP, every physio, every trainer will nod along to that sentence. Then watch what gets prescribed on the back of it. High reps. Long burning sets. Circuits. Three sessions of cardio stacked on top. A protocol whose main product is fatigue, given to the person with the least capacity left to absorb any. They identified a recovery problem and prescribed more recovery cost. The answer runs the other way and it is not complicated. If your recovery budget has shrunk, you spend it on whatever returns the most growth per unit of fatigue, and that is a heavy set of five. Four to six reps, a handful of lifts, three minutes between sets, done inside the hour. Nearly every rep is a growth rep. Almost nothing goes on the burning, the sweating and the gasping, which build nothing at all and then bill you for four days. Twenty-five reps taken to failure is a fortnight of fatigue for a fraction of the stimulus. That is not the cautious option for a sixty-five-year-old. It is the most reckless thing on the timetable. Now the part that actually matters. Ageing is not one process. It is a list. Muscle wastes. Bone thins. Tendon softens. The fast fibres that catch you when the pavement arrives early vanish first while the slow ones sit there in perfect health. Motor units drop out. The nervous system stops asking for full effort because nothing has demanded full effort in fifteen years. Read that list back and tell me what heavy resistance training does. It builds muscle. It loads bone, which is the only language bone speaks. It stiffens tendon. It recruits the fast fibres, because that is what heavy means physiologically and there is no other route in. It forces the nervous system to ask for everything again. Every item on the list of what ageing takes is on the list of what a heavy set gives back. Nothing else on earth does that. Not a walk, not a class, not a pill, not twenty minutes on a machine with the paper open. You were told to go gently because somebody quietly decided you were finishing. Go heavy, because you are not.

Sama Hoole

16,341 Aufrufe • vor 6 Tagen

The architecture of this new world model is one of the most interesting things I've seen lately: Let me first explain how most world models work: They predict and render one frame at a time. If you are navigating in one of these worlds, and you look left, the model draws whatever looks right in the moment. Every time you change your viewpoint, the model has to imagine what should be there again, so it's very common for these models to "forget" what's in the world. For example, if you put a toy on the table, look away, then look back, the toy might not be there anymore. Tripo AI is releasing its Project Eden model, which works very differently: The model builds the world first, and then renders it based on that map. That map holds the real state of the world: the geometry, every object, where things are, what's already happened. The picture you see on screen gets generated from the map. This architecture flips the whole thing. Now, you get the following: 1. The world stops forgetting. Leave, come back, and the toy is still on the table because it lives in the map, not in the last frame you saw. 2. You can edit the world, and those changes persist for anyone who enters later. 3. Multiple people and AI agents can coexist in the world and see it from different perspectives. This is early research, but it's looking really promising. They just raised nearly $200M across two rounds to build it out. Tripo will be at SIGGRAPH 2026 (July 19–23, Los Angeles Convention Center). If you work in 3D, embodied AI, simulation, or anything spatial, go connect with them there.

Santiago

30,189 Aufrufe • vor 1 Monat

Softmax vs Sigmoid ✍️ Interact 👉 = Softmax = Softmax is how deep networks turn raw scores into a probability distribution — the final layer of every classifier, and the core of every attention head in a transformer. To see what it does, picture five boba tea shops on the same block, all competing for your dollar. Five candidates: a, b, c, d, e — different chains, different brewing styles, different pearls. A boba reviewer hands you a 𝘤𝘩𝘦𝘸𝘪𝘯𝘦𝘴𝘴 𝘴𝘤𝘰𝘳𝘦 for each — higher means perfectly chewy "QQ" pearls with the right bite (ask a Taiwanese friend to find out what QQ means). Negative scores are real: mushy bobas, overcooked pearls, a batch left sitting too long. How do you turn five chewiness scores into an allocation that adds to a whole dollar? You could spend everything at the chewiest shop, but that ignores how good the runners-up are. Softmax is the smooth alternative. Read the diagram left to right. First, raise each score to e^{x} — this does two things: it turns negative chewiness into small positives, and it stretches the gaps between scores exponentially. Then sum all five into a single total Z. Finally, divide each e^{x} by Z to get a probability. The five probabilities add up to one, so you can read them as percentages of your dollar. The chewiest shop gets the biggest slice — but never the whole dollar. That's the point of softmax: it ranks confidently while still leaving room for the others. = Sigmoid = Sigmoid squashes any real number into a probability between 0 and 1 — the classic activation for binary classification, and still the gating function inside LSTMs and GRUs. Same boba block as the previous Softmax example, narrowed to just two contenders — a hot new shop `a` with chewiness score x, and your usual go-to `b` whose score is pinned at zero (the neutral baseline you've come to expect). Sigmoid is just softmax with two players, one of them pinned to zero. Read the diagram left to right. First, raise each score to e^{x} — for the usual shop `b` whose score is zero, this is just e^0 = 1 (the constant baseline). Then sum the two into a total Z. Finally, divide each e^{x} by Z to get a probability. The two probabilities add up to one — the new shop wins more of your dollar when its pearls get chewier, and your usual keeps the rest. That's the point of sigmoid: it turns a single chewiness score into a clean 0-to-1 chance you'll try the new place over your usual. --- AI Math, Algorithms, Architectures by hand ✍️ Subscribe to my 60K+ reader newsletter 👉

Tom Yeh

73,787 Aufrufe • vor 3 Monaten

As of this morning, every brand-new Car sold in Europe is mandated by law to watch its “driver”, and the reason to worry is the opposite of what everyone is screaming about. The camera is not filming your face. The law explicitly bans that. It rather tracks your eyes. The danger is not what it does today. It is what it is now physically positioned to do tomorrow. This became binding across all 27 countries today, the 7th of July 2026, and no member state can opt out, because road safety is an EU competence and EU law overrides national law. Every new car and van, roughly 18 million of them a year, must now carry an infrared camera, usually on the steering column, that follows the driver's gaze. Look away too long, six seconds under 50 kilometers an hour, three and a half above it, and the car warns you with a sound, a light, or a buzz in the seat. The stated reason is real. Distraction causes up to 30 percent of crashes, and the Commission projects the wider safety package will save 25,000 lives by 2038. The outrage dissolves on contact with the actual text. The law actually fully forbids facial recognition and any biometric identification of anyone in the car, and the footage is legally barred from leaving the vehicle. No recording, no transmission, no police feed. As written today, this is a safety beeper, not a spy. But look at what already sits beside it. Think about it.. come on!! Europe's cars already run always-on systems that do transmit, the automatic crash caller that dials emergency services, the black-box event recorder, and over-the-air software that rewrites the car remotely overnight. The sensor was just made universal. The wall keeping it private is a single legal paragraph, and the same law already schedules its own review for 2027 to read cognitive state and body movement, while suppliers openly sell using the identical mandated camera to watch the passengers too. So this is the quiet architecture of every threshold. The permanent thing is physical, a camera now bolted into 18 million dashboards a year. The thing protecting you is a mere sentence, and sentences are the easiest part of any system to revise. Europe hardwired the eye. It left what the eye may see as the one part that can still be changed later. Hmm 🤨

Shanaka Anslem Perera ⚡

649,763 Aufrufe • vor 1 Monat

Contrail lesson! 1. “Chemtrails” don’t exist. Just to get that out of the way. 2. Observe the satellite loop and Skew-T chart. In the IR satellite loop you can see yesterday, the West Coast had a decent short wave ridge suppressing moisture over California and Nevada. Today, you can see moisture from a low pressure over the Pacific spilling over the ridge that is now moving east of California. This is upper level moisture ADVECTING into the area. This upper level moisture is mainly above the 500mb level, or 20,000ft. 3. Now observe the Skew-T chart. Particularly clue into the 300mb level. This is a perfect example of what I talk about all the time, and why it’s important to pay attention to the 300mb level. This moisture layer is advecting particularly at the 300mb level, and synoptic scale cirrus development, and advection, typically occurs at 300mb. This is key because aircraft are flying at and above the 300mb level. 4. So, lastly, observe the pictures that I took of the sky over northern Nevada at the time of this post. You can see the layer of cirrus as well as contrails persisting in that moisture layer, exactly as depicted in the satellite shot AND confirmed by the Skew-T chart. Keep in mind that temperatures at this level of the atmosphere are typically -20 to -50°C. In this case, you can see that the temperature at 300mb is -40°C and relative humidities at this level are far different than what you experience at the surface. Any decrease in the gap between temperature and dewpoint at this level can significantly increase the relative humidity. This is why it’s referred to as “relative”because it’s far different than temperatures and dew points at the surface. So, to bring it all together, aircraft flying at these altitudes, which most commercial and military aircraft do, injecting warm, moist air from the engines rapidly into the super cooled environment, not only instantly form contrails, but when relative humidities are as depicted in this example, will enable contrails to persist for hours at a time supported by the moisture existing in that layer. This is what causes persistent contrails. These ARE NOT “chemtrails” and because they persist, does not, and will not ever, make them “chemtrails.” Now that you all needed your government to tell you that climate change was a hoax and I’ve been telling you for years that the “Geoengineering” and “chemtrail” nonsense are propaganda directly related to the climate change hoax, hopefully you can take some time to learn the basics of the atmosphere and understand what I’m showing you here, and how it works, so you’re not fooled by climate propaganda going forward. Thank you for your attention to this matter. 💪🏼🇺🇸

Dylan Tucker

26,804 Aufrufe • vor 9 Monaten