正在加载视频...

视频加载失败

➡️ Machine Learning from Scratch, part 15: a recommender, the kind of algorithm that picks what your feed shows you. Our app is simulated: 300 people and 60 videos. Every person has a hidden taste, every video has a hidden style, and each person has watched only about 12...

88,400 次观看 • 1 个月前 •via TikTok

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

➡️ Machine Learning from Scratch, part 31: the transformer. A transformer turns every token into a list of numbers, adds its position, and then lets every token look at the others. That step is called attention: each token has a query (what am I looking for), a key (what do I contain) and a value (what I pass on). The better a query matches a key, the more of that value flows in. Real transformers repeat this in many layers with several attention heads each. The design comes from the 2017 Google paper "Attention Is All You Need" by Ashish Vaswani and colleagues, first used for translation. A large language model is a transformer trained to predict the next token, again and again, on a huge amount of text. Our own run, nothing downloaded. attention.py is one self-attention layer in 16 lines of numpy. Every word gets a query, a key and a value of 8 numbers, starting random, trained from scratch with hand-written backpropagation on 192 made-up sentences like "the dog ate the carrot because it was hungry". The task: find out which pet "it" means. On 64 new test sentences "it" puts 99.95 percent of its attention on the right word on average (the lowest single sentence gets 99.9 percent; the program prints this as 100%). Before training it was 10 percent, spread evenly. The cat sentence from the video is one of the test sentences. Honest notes: our task is easy on purpose. Every sentence has exactly one pet, so "it" only has to learn to look for pets, and it learns that within the first pass. Real sentences with two candidates need more context, which is what many layers are for. Our small version has no positions, no scaling, no mask, one head, and only "it" asks a question. Every word of the test sentences also appears in training; the combinations are new. The 3D space in the video shows the real keys of our model, projected to three axes (two of them stretched so you can see them). The stacked layers are a sketch. #machinelearning #ai #transformer #python #llm

MachineLearningToGo

80,100 次观看 • 1 个月前

➡️ Part 9 of learning ML code from scratch Six weights, one wrong answer, and not one of them knows it was at fault. Backpropagation is how they find out. Two questions guide the video: what even is backpropagation, and why do models need it? Step 1, the forward pass. Two numbers go into a tiny network, run through a hidden layer, and one number comes out. Ours says 0.700. We wanted 1.0, so square the difference and the loss is 0.09. That single number is how wrong the model is. Step 2, the question. Six weights produced that answer together. Which of them is to blame, and by how much? Step 3, the one idea. Change a single weight by a tiny amount and watch the error move. How much the error changes per unit of weight is the gradient of that weight. In the video you can see it happen: the weight wobbles and the error bar answers. Step 4, the shortcut. Every weight running into the same neuron starts from one shared number, the blame of that neuron. Multiply that blame by the value each weight carried and you have its gradient. One blame, computed once, and every weight into that neuron gets its own gradient from it. That is why backpropagation is fast enough to train anything at all. Step 5, backwards. The blame starts at the output and every layer hands its share to the layer in front of it, back through the same network the data came forward through. It goes layer by layer, and inside one layer every neuron is done together. Step 6, the update. The optimizer moves every weight against its own gradient, the whole weight matrix in one go, so no weight waits for its turn. All six gradients here are negative, so all six weights go up. After one step the answer reads 0.769. After sixty it reads 0.968 and the error is down to 0.001. The honest part: every gradient in the video was checked against the measured change of the error. Move that one weight, see what the error does, divide. Backprop and the measurement agree to nine decimal places, otherwise nothing would have rendered. #machinelearning #backpropagation #neuralnetworks #python #coding

MachineLearningToGo

210,600 次观看 • 1 个月前

People are making stupid money with AI — and they're no geniuses. Here is how All respect to them, I mean that. But most of them are regular people who learned ONE skill in a short amount of time and ran one recipe with it. You've probably seen it — somebody around you quietly earning with AI while you wonder what the secret is. Luck. Genius. Timing. It's a recipe with two parts, and almost everybody only ever does part one. PART ONE — BUILD something people actually want. With AI this has never been easier: an automation that saves a business owner ten hours a week, a tool for one specific job, a service delivered faster than anyone charging double. A few focused months for the skills, a couple of weeks for the build. Part one is necessary. And part one, alone, pays you nothing. Because that's the beautiful store you open in the desert. Perfect design, real work, months of grind — nobody walks past. That's where almost everyone quits, convinced it was luck after all. PART TWO — DISTRIBUTION. The actual secret. Put the valuable thing in front of the RIGHT people, AT SCALE. Two equations: MATCHING — speak your buyer's language. Built a tool for fitness trainers? Talk to trainers about their clients, their programs, their day, in trainer words. The algorithm reads your language and hands your videos to the people who speak it. SCALE — one video is a hope. Hundreds are a system. The content engine: make three videos, it turns them into fifteen posts across every platform, every week. One person shows up like a media company. Look at anyone actually winning with AI: they built something worth wanting, then made sure thousands of the right people saw it. Both halves, every time. It was never luck. It's build, times distribution. #aiagent #aiautomation #makemoneywithai

Professor Glitch

10,200 次观看 • 2 个月前

➡️ Machine Learning from Scratch, part 47: the Hopfield network. In 1982 the physicist John Hopfield described a network that works as a memory, and 42 years later this work was part of the Nobel Prize in Physics. Each neuron is one pixel that is either on or off, and every neuron is connected to every other neuron, so 100 pixels need 4,950 connections. There are no layers: signals go back and forth until the network settles. Each neuron takes a weighted sum of its inputs and switches on if the sum is positive, off if it is negative. Storing a picture is simple: for every pair of pixels with the same colour the connection gets stronger, otherwise weaker. Every stored picture becomes a valley in the energy landscape, and no switch can ever raise the energy, so a noisy picture rolls downhill into the nearest stored memory. The code (hopfield.py, 16 lines of numpy, pictures in pics.txt) stores three 10 x 10 pictures, a heart, a house and a smiley, and flips 30 of the 100 pixels in each. After a single pass over all neurons all three come back exactly; the energy of the heart falls from -6.90 to -48.90, the energy of the stored heart. With 100 neurons and random patterns (10 flipped pixels, 20 runs) it recalls 5 patterns every time, 10 patterns in 94.5 % of the cases, 14 in 68 %, 20 in about one in four (24 %) and 30 in 1 %. Honest notes: the weights are kept as whole numbers (100 times the Hebb weight), so a sum of exactly zero switches the neuron on, as the rule says. The landscape in the video is a picture of the idea; the valley floors and the height of the rolling ball are the real energies from the run. #machinelearning #ai #coding #neuralnetworks #nobelprize

MachineLearningToGo

12,000 次观看 • 14 天前

Mark Zuckerberg just described the obsolescence of every institution on Earth and delivered it like a product update. Zuckerberg: “I just think in the future almost everyone is gonna have the power of a 10,000-person organization.” He did not say better tools. He did not say smarter apps. He said the full cognitive output of ten thousand human beings. Packaged into a product. Handed to one person. That is not an upgrade. That is the end of the reason human beings organize at all. Companies exist because one brain is not enough. Governments exist because coordination requires hierarchy. Universities exist because knowledge demands infrastructure. Every institution ever built was a workaround for the same limitation. No single person could do it alone. Zuckerberg is telling you that limitation is about to disappear. The 500-person startup becomes one founder and an AI stack. The law firm becomes one attorney and a system that never sleeps. The hospital becomes one doctor carrying every specialist in their pocket. That is not speculation. That is a deployment schedule. And the man writing it runs a 70,000-person company. He employs 70,000 people and just told the world one person will soon need none of them. That is not a prediction. That is a confession from the man who will be first to act on it. But the part nobody is discussing matters more. This technology does not land on everyone equally. It lands first on the people who already command 10,000-person organizations. Zuckerberg does not get the power of 10,000 people. He already has that. He gets the power of 10,000 organizations. Every revolution in history was sold as liberation. The printing press was supposed to democratize knowledge. It built media empires. The internet was supposed to democratize commerce. It built trillion-dollar platforms. The tool always arrives as liberation. It always settles as leverage. And leverage always consolidates upward. Zuckerberg is not wrong about the capability. One person will do what ten thousand once did. But the question nobody is asking is the only one that matters. If everyone wields the output of 10,000 people, what is a single person actually worth? And then Zuckerberg answered his own question without realizing it. Zuckerberg: “If the intelligence of a 10,000-person company is not greater than the intelligence of a single person, then what are we doing here?” He meant it as a case for AI. That is the most brutal thing a CEO has ever said about the people who work for him.

Dustin

54,061 次观看 • 6 个月前

How a $50K AI project actually starts (process mapping, step by step) Before anyone builds anything, a real AI project starts with a stopwatch and a wall of sticky notes. Here's the whole method on one company: a 60-person parts distributor where 400 orders a day arrive as PDF attachments and six people retype them into the ERP. Interview the people who do the work, not the owner. The owner says taking an order is 5 steps. The person who's done it for nine years walks you through 41, including the sticky note on her monitor. Sit next to them with a stopwatch. Measure touch time (6 minutes of actual work) against lead time (3 hours from email to confirmation). The minutes cost wages. The hours cost customers. Break every box into atomic steps. One person, one system, one action. "Enter the order" is 11 steps. AI can't do "enter the order", but it's great at "match their part number to ours", and it tells you how sure it is. Hunt the exceptions. Old part numbers, price mismatches, backorders, credit holds, duplicate POs. Log them for two weeks. That's where the time goes. Give every step one of three colors. Blue is a rule, so automate it. Purple is judgment on messy input, so AI does it and a person approves when it's unsure. Orange is money or a relationship, so it stays human. Fix broken steps before you automate them. Score and sequence. Frequency × minutes × cost of a mistake gives you the roadmap. Track one number from day one: the share of orders nobody had to touch. Then the $50K has a shape: paid discovery, then phases that each pay for the next. Nobody loses their job. They stop retyping and handle the exceptions and the customers. #aiautomation #aiagent

Professor Glitch

20,900 次观看 • 1 个月前