Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

A dual-socket Xeon server with 512GB of ECC RAM sells for under $2,000 after AWS retires it. Two open chassis sit on a desk. Heatsinks the size of a fist. Every RAM slot filled. Fiber cables still warm. Network cards and PCIe risers that once pushed millions of requests...

77,540 görüntüleme • 7 gün önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Elon Musk gave the entire entertainment industry its expiration date, and he is the one building the thing that kills it. Musk: “My guess is that we see the first compelling half hour, pure AI show next year.” Next year. A complete show generated entirely by AI. No writers. No actors. No cameras. No sets. No crew. No studio. Just a prompt and enough compute to render a reality that never physically existed. And shows are the easy part. Musk: “I say probably we’re maybe three years away from AI does the whole video game.” A show plays the same way every time. A game has to generate a living world that reacts to every decision in real time across every single frame. That is a fundamentally harder class of problem. And Musk put three years on it. Right now a single AAA title takes seven years and half a billion dollars across thousands of engineers and artists just to ship it. Musk is describing a world where one person types a paragraph and gets something comparable. The entire value proposition of a multi-billion dollar industry lives inside that gap. And it closes in thirty-six months. But the prediction is not the story. The person making it is. This is not an analyst speculating from the sidelines. This is the man building the largest AI compute clusters on the planet. The man who built xAI from zero in under two years. The man stacking hundreds of thousands of GPUs into facilities designed to do exactly what he is describing. When Musk says three years, he is not guessing about what someone else might eventually ship. He is reading you a delivery date off his own roadmap. Every media company on Earth is valued on a single assumption. That quality content is expensive and difficult to produce at scale. That one assumption is the structural foundation underneath every studio, every network, and every publisher in existence. Musk is dismantling it with raw compute. The studios still parading thousand-person production teams are not demonstrating strength. They are advertising the exact cost structure that one person with a prompt and a GPU allocation is about to make irrelevant. And it does not stop at entertainment. If AI can generate an interactive world that responds to human input in real time, it can generate anything. Advertising. Architecture. Training simulations. Product design. Every industry built on humans manually constructing visual experiences frame by frame is sitting on the same countdown Musk just read out loud. Now zoom out. Because this is not just an industry story. For the entire history of human civilization, the distance between imagining a world and actually creating one required thousands of people, millions of hours, and billions of dollars. That distance built Hollywood. That distance built the gaming industry. That distance made content scarce and studios powerful. Musk is collapsing that distance to zero. When the gap between imagining something and it existing disappears, every business model built on the difficulty of creation disappears with it. That is not disruption. That is a full inversion of how human beings create. Musk did not make a casual prediction on that podcast. He told you what he is building. He told you the timeline. And he told you which industries do not survive it. The entertainment industry is still debating whether this future is real. Musk is not part of that debate. He is building. And he just told you the delivery date.

Dustin

22,390 görüntüleme • 29 gün önce

Somewhere around sixty you get handed a new set of instructions. Lift lighter. Keep the reps high. Do not tax yourself too much. Put the saved effort into cardio. It is the exact reverse of what an ageing body needs, and the people handing it out have the mechanism sitting right in front of them. Recovery gets worse with age. Nobody argues with that. The older body clears fatigue more slowly, repairs more slowly, and tolerates far less accumulated work before progress stops entirely. Every GP, every physio, every trainer will nod along to that sentence. Then watch what gets prescribed on the back of it. High reps. Long burning sets. Circuits. Three sessions of cardio stacked on top. A protocol whose main product is fatigue, given to the person with the least capacity left to absorb any. They identified a recovery problem and prescribed more recovery cost. The answer runs the other way and it is not complicated. If your recovery budget has shrunk, you spend it on whatever returns the most growth per unit of fatigue, and that is a heavy set of five. Four to six reps, a handful of lifts, three minutes between sets, done inside the hour. Nearly every rep is a growth rep. Almost nothing goes on the burning, the sweating and the gasping, which build nothing at all and then bill you for four days. Twenty-five reps taken to failure is a fortnight of fatigue for a fraction of the stimulus. That is not the cautious option for a sixty-five-year-old. It is the most reckless thing on the timetable. Now the part that actually matters. Ageing is not one process. It is a list. Muscle wastes. Bone thins. Tendon softens. The fast fibres that catch you when the pavement arrives early vanish first while the slow ones sit there in perfect health. Motor units drop out. The nervous system stops asking for full effort because nothing has demanded full effort in fifteen years. Read that list back and tell me what heavy resistance training does. It builds muscle. It loads bone, which is the only language bone speaks. It stiffens tendon. It recruits the fast fibres, because that is what heavy means physiologically and there is no other route in. It forces the nervous system to ask for everything again. Every item on the list of what ageing takes is on the list of what a heavy set gives back. Nothing else on earth does that. Not a walk, not a class, not a pill, not twenty minutes on a machine with the paper open. You were told to go gently because somebody quietly decided you were finishing. Go heavy, because you are not.

Sama Hoole

16,526 görüntüleme • 12 gün önce

A few points on the Powering Canada Strong announcement that is important to understand; * Doubling Canada's electricity generation capacity is paramount. I just wish it wouldn't take 20+ years. We don't generate enough electricity to be self-sufficient or participate in future industries. We have no choice. Has to be done. It's something I called for a while and spoke on. * Linking the connectivity of Canada's fragmented grid. This is a must to increase productivity, and remove waste. It's a one step back for two steps forward type of investment. * the connection and expansion of the grid is one of the important things we need to do reach mining areas and develop these sectors and for the growth of smaller communities around. The problem with these whole announcement is that it is all net zero based which means it won't necessarily build the most reliable possible grid for the $ and will other ridiculous costs to be carbon tax trading based on the way. It's completely inefficient from capital planning point. Mark Carney says: It will require the spreading of costs over time using our AAA balance sheet so that ratepayers don't pay all of the costs of investments today. That means the government is planning to borrow MASSIVELY! That cost will appear not only in your electricity bill but also in the value of the CAD and interest costs that is already hitting record every single year. This plan is utilizing legitimate needed action to transform all of Canada's energy need into ideological driven carbon tax trade system and inefficient power generation that all together will cost Canadian taxpayers hundreds of billions more than it should.

Kirk Lubimov

24,482 görüntüleme • 3 ay önce

Day 11/90 of Inference Engineering How does vLLM work and how is it used in production? Before we discuss how vLLM works internally, it helps to understand what vLLM is. At a high level, vLLM is an inference engine that is designed to serve LLMs to thousands of concurrent users efficiently while managing scarce compute and memory. The goal for vLLM is to maximize throughput and minimize latency; optimizing for the best inference economics and experience for end users. With every request from the end user, it eventually ends up in the engine core, gets scheduled alongside other requests from other concurrent users, executes on the GPU, and updates the KV cache with the new key and value vectors, and streams the tokens back to the user. The Scheduler decides what requests should execute next while continuously batching requests together to maximize GPU utilization. Continuous batching is an inference optimization that allows new requests to join a running batch as other requests finish generating tokens. This helps with keeping the GPU utilization high instead of letting it sit idle waiting for an entire batch to complete generating. After the scheduler dispatches the selected batch to the Model Executor, the Model Executor prepares the tensors and metadata required for inference, retrieves each request’s block table from KV Cache Manager, launches the optimized transformer forward pass on the GPU, computes the logits, updates the KV cache with the new key and value vectors, and finally returns the results for sampling and streaming. The KV Cache Manager uses the PagedAttention memory layout to allocate fixed-size cache blocks on demand and maintains a Free Block Queue on the CPU that tracks which blocks in the GPU’s Paged KV Cache are currently free. When a request needs additional KV cache space, the KV Cache manager takes a free block from the queue and assigns it to that request, thus avoiding an expensive search through GPU memory for available cache blocks. All of these components form the core of vLLM’s inference engine. The Scheduler determines what requests are executed, the Model Executor determines how those requests are executed, the KV Cache Manager determines where each request’s KV cache lives using the PagedAttention Memory Layout. This architecture enables vLLM to serve thousands of concurrent requests with high throughput, low latency, and efficient GPU memory utilization. Heres a little animation that visualizes everything! - I've also completed the forward pass for my mnist.c project. I had a nice chat with shrey birmiwal, such a knowledgeable guy. Excited to learn more about vLLM and implement a tiny-vLLM one day.

max fu

70,450 görüntüleme • 28 gün önce

Jeff Bezos just told you exactly how to price AI. Nobody listened. Bezos: “AI is real and it is going to change every industry. In fact it’s a very unusual technology in that regard in that it’s a horizontal enabling layer.” Horizontal enabling layer. Three words that reprice the entire technology sector. The iPhone was a vertical. One product. One new market. Electricity was a horizontal. One substrate that rewired every market on Earth. Wall Street is pricing AI like it is the next iPhone. Bezos is telling you it is the next electrical grid. Right now, thousands of companies are trying to sell AI as a product. A feature. A tool. A subscription tier. Every single one of them will be priced to zero. You do not sell a horizontal layer. You do not compete with it. You build on top of it or you disappear beneath it. For a century, entire industries survived on one thing. Complexity. The friction of navigating law, medicine, logistics, finance. That was the moat. If you could not memorize the maze, you could not compete. A horizontal layer does not navigate the maze. It dissolves the walls. Electricity did not compete with the candle industry. It erased the need for one. The most dangerous part of a horizontal shift is how quiet it is. It moves underneath the economy. The surface looks normal. Revenue still holds. Every day you operate on the old substrate, you accumulate a debt you cannot see and cannot repay. The internet repriced distribution. AI is repricing cognition itself. When intelligence becomes a utility that runs through the walls of every company on Earth, the premium on human expertise does not erode. It evaporates. This is not a disruption. Disruptions replace products. This replaces the ground you are standing on.

Dustin

540,966 görüntüleme • 4 ay önce

🕊️ The Faravahar: An Ancient Persian Symbol with a Powerful Meaning High on the stone walls of Persepolis, the ancient capital of Persia, you can see a mysterious winged symbol carved into the rock. This symbol is called the Faravahar (or Farohar), and it is one of the most important signs of Zoroastrianism, one of the world’s oldest religions. At first look, the Faravahar may seem like a royal emblem or a symbol of power. But its meaning goes much deeper than that. The design comes from very old Middle Eastern traditions. Long before Persia, kings used winged sun symbols on seals to show divine protection and authority. Over time, the Persians gave this image a new meaning. In Zoroastrian belief, the Faravahar came to represent the human soul, its choices, and its journey through life. Every part of the symbol has a message: 🪽 The wings stand for growth, progress, and rising toward good thoughts and actions. 🧍 The human figure in the center reminds us that humans have free will and must choose between right and wrong. 🔄 The circular shape shows the ongoing journey of life and the balance between the spiritual and the physical world. In ancient Persia, the Faravahar was not just art on a wall. It showed faith, identity, and legitimacy. It reminded rulers and people alike that power should be guided by wisdom, truth, and moral responsibility. Even today, the Faravahar invites curiosity. Is it a symbol of God? A guide for the soul? Or a sign of royal authority? Perhaps it is all of these at once. What is clear is this: the Faravahar is a timeless symbol that shows how deeply spiritual belief and leadership were connected in ancient Persia—and how those ideas still speak to us today. ✨

Unearthed 🏺

12,740 görüntüleme • 6 ay önce

The world just paid $2 trillion for a rocket company that lost $4.9 billion last year. And the rockets are not why it lost the money. They are the only part making any. SpaceX went public Friday, the largest IPO in history. Up 19%, a $2 trillion valuation, Elon Musk the first trillionaire. Then you open the filing. Three businesses sit inside it. Starlink, the satellites, brought in $11.4 billion, 61% of all revenue, and $4.4 billion in profit. It is the only piece that earns a dollar. The rockets that land themselves run a small loss reinvesting in Starship. And the AI arm, Grok plus the app once called Twitter, folded in this February, lost $6.4 billion in a single year on $12.7 billion of spending. Read that again. The satellites pay for everything. The AI loses more than the satellites make. And the AI is the part the market fell in love with. It gets bolder. The prospectus claims a total market of $28.5 trillion, the largest any company has ever put in a filing. Larger than the GDP of the United States. That is the number underwriting a $2 trillion price tag built on a division bleeding $6 billion a year. Now the structure. About 4% of the company trades. That sliver sets the price for all of it. Musk is locked up for 366 days and holds roughly 80% of the votes. The public bought a company they cannot steer, priced on the one segment losing the most. This is the whole year in one ticker. The profit is satellites. The story is AI. The market bought the story. The rockets were never the risk. The risk is a $2 trillion price resting on the one bet that has yet to make a cent.

Shanaka Anslem Perera ⚡

721,880 görüntüleme • 2 ay önce