Loading video...

Video Failed to Load

Go Home

NVIDIA just dropped a crazy new research idea. Get ready. The same next-token trick behind ChatGPT got pointed at a ragdoll. Honestly the result is unsettling. No exotic new architecture. Chop human motion into a vocabulary of tiny movement tokens. Train a plain GPT to guess the next one,...

126,066 views • 1 month ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Marvin Minsky, MIT professor and father of artificial intelligence: "Anthropic pays engineers $900K to build multi-agent AI systems. The blueprint is 40 years old, from an MIT professor who proved intelligence is just a swarm of dumb specialists." the thread above shows you how to turn one AI into a team of specialized agents, each with its own job and memory, all managed by a boss. brilliant. it is also marvin minsky's 1986 theory of how your own mind works. minsky's whole idea was that intelligence is not one smart thing. it is a society of tiny, mindless agents, each doing a single dumb job, none of them intelligent alone. put enough of them together under a few managers and intelligence emerges. that is not a metaphor for the claude trick. it is the claude trick. so when you spin up specialized sub-agents and delegate, you are not inventing a new hack. you are rebuilding the architecture minsky described forty years ago, the same one your brain has run your entire life. he co-founded the field, taught it at MIT, and left it all in this free lecture. same story i keep telling: the "new" AI trick is usually an old idea in a new wrapper. here is the part the thread skips, and minsky knew it. a society of agents is only as good as how you organize it. one dumb specialist is useless. a thousand, badly managed, is chaos. the edge was never spawning the agents. it is the orchestration, knowing which specialist to call, when, and how to combine their answers. the tool is free. the judgment is the whole game.

Rossst.03

147,913 views • 1 month ago

RLHF by hand ✍️ ~ 15 steps walkthrough below Train a model on human text and it inherits human bias. It will assume a doctor is a "him", because the data says so. RLHF is the correction. A human marks one preference, doc is them over doc is him, and the weights move. But one correction is not the point. The hope is that the model learns the value behind it, gender neutrality, and applies it to professions nobody ever mentioned. How does it work? Goal: train a reward model from a single human comparison about doctors, then turn it on CEOs, filling in every cell yourself. = 1. Given = A reward model, an LLM, and two (prompt, next) pairs. = 2. Preferences = A human reads both pairs and picks a winner: (doc is, them) beats (doc is, him). The loser is not bad grammar, it is gender bias, and that is the whole signal. = 3. Word embeddings = Let us look up each word of the loser pair. These vectors are the reward model's input. = 4. Linear layer = We multiply by the reward model's weights and add its biases. Out come feature vectors, one per position. = 5. Mean pool = Let us multiply by [1/3, 1/3, 1/3], which averages the three positions into one sentence embedding. = 6. Output layer = We map that sentence down to a single number. Reward = 3. = 7. The winner, the same way = Let us repeat steps 3 to 6 on the winning pair. Reward = 5. = 8. Winner minus loser = We take the gap: 5 - 3 = 2. The reward model wants this positive and as large as it can make it. = 9. Loss gradient = Let us squash the gap into a probability, σ(2) ≈ 0.9, and subtract the target of 1. The gradient is -0.1, and it goes back through the purple weights. The reward model is now trained. = 10. A prompt it has never seen = We start the second half with "[S] CEO is". The feedback in step 2 was about doctors. Nothing connects a CEO to a doctor except what the reward model generalised. = 11. Transformer = Let us push it through attention and a feed forward layer, one vector per position. = 12. Output probabilities = We map each vector to a score over the vocabulary. = 13. Sample = Let us take the highest score. The model completes "CEO is" with "him", which is the same bias the human penalised in step 2. = 14. Score it with the reward model = We feed the new pair (CEO is, him) through steps 3 to 6. Reward = 3, exactly the score it gave "doc is him" in step 6. Nobody taught it about CEOs. The value transferred. = 15. Loss gradient = Let us set the loss to the negative of the reward, so minimising the loss maximises the reward. The gradient is a constant -1, and it goes back through the red weights. The outputs: Loser reward = 3, winner reward = 5 Reward gap = 2, predicted σ ≈ 0.9, reward model gradient = -0.1 LLM samples "him", reward = 3, LLM gradient = -1 Congrats! You just calculated RLHF by hand. And you watched a value generalise: one comparison about doctors, and the model marks down "CEO is him" unprompted. 💾 Save this post!

Tom Yeh

22,105 views • 1 month ago

REAL ESTATE PEOPLE WILL HATE HIM FOR THIS. HE BUILT A CLAUDE AGENT THAT TURNS ANY LISTING INTO A SELLABLE VIDEO ON ITS OWN Playbook: connect Claude to a video generator, paste a listing, get a cinematic tour of every room, sell it to the agent But typing the prompt for every listing doesn't scale. He turned it into a skill his Claude runs on its own Here's how to build the automated version: 1. Connect the video engine once. In Claude, go to Customize, Connectors, Add Custom Connector, name it Higgsfield, and paste the server URL from higgsfield. ai/mcp. Authenticate through your account. No API keys. Now Claude can generate video straight from chat 2. Turn the workflow into a skill. Instead of pasting the same prompt every time, have Claude build a skill. Tell it: "Create a skill called listing-to-video. When I give it a listing URL, scrape the room photos, generate a cinematic clip of each room with Higgsfield, and save them to a folder." Now the whole process is one command, not a wall of text 3. Let the agent run the listing. Hand it a URL and say "run listing-to-video on this." It pulls the photos, fires each room through the video model, and brings the clips back. You wrote the prompt once, inside the skill. You never write it again 4. Stitch and deliver. Drop the clips together into one tour. Send a free sample to the listing's agent, then charge per video or a monthly rate for ongoing listings 5. Scale it with your team. Add a skill that drafts the outreach email and one that builds a simple landing page for the agent. Now one operator runs sourcing, production, and pitching from a single Claude session The edge isn't generating one video. It's building the skill once so every future listing runs itself Bookmark this

Yarchi

54,840 views • 2 months ago

One guy built this app in a month and now it makes him more than $1,000,000 a year. No team. No investors. No marketing department. One developer. One month. One clever idea. The app is a camera for events. In its first month it got 100,000 downloads and he did not spend a single dollar on ads. Here is how he did it because the most interesting part is the growth itself. He did not bolt marketing onto the product. He made using the product the marketing itself. After that things kick in that almost nobody figures out. 1. You cannot use the app alone. For it to work the host has to pull every guest into it. Each install drags in dozens more right away. 2. One wedding is not one user but a whole crowd at once. 200 people scan one code in an evening and install the app. No ad brings that many for the same money and here the money is zero. 3. The guest becomes the host. He liked it at someone else's wedding and a month later he throws his own event and brings his own people. The loop spins itself and for free. 4. It does not look like an ad. To the guest it is a gift not some app forced on him. So they install it gladly and all of them do. 5. It all runs on emotion. A wedding. Memories. Shared shots. People film it and show their own people and a new wave comes in. Now let us count the money plain and honest. The subscription runs from 2 to 50 dollars. Say only every 20th person pays. That is 5,000 people out of 100,000. The average check a modest 20 dollars. 5,000 times 20 is 100,000 dollars a month. More than 3,000 a day. More than $1,000,000 a year. And all of this is one guy in a month without a single dollar on ads. He did not win on budget and not on a team. He won by sewing distribution into the very use of the product. You can lift almost any product this way. Could you build something like this on your own or is it just luck?

Blaze

10,703 views • 1 month ago