Loading video...

Video Failed to Load

Go Home

we sped up distributed inference by up to 5x with decentralized speculative decoding. many don't realize that AI models normally generate text one single word at a time, waiting for the network after every word. speculative decoding changes this by using a "guess & confirm" system, similar to autocomplete....

tryParallax's profile picture

Parallax

1,536 subscribers

45,584 views • 6 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

I told you to claim your free 16GB NVIDIA GPU for learning Local LLMs. Now I’m going to show you how to double its inference speed without touching the hardware. Google Colab gives you an enterprise grade NVIDIA Tesla T4 GPU for free, roughly 4 hours every single day. It is the absolute perfect sandbox for learning AI engineering, testing inference flags, and pushing massive context windows. The local AI timeline is moving way too fast. If you aren't using Multi Token Prediction (MTP) yet, you are leaving massive performance on the table. I just pushed DeepMind’s Gemma 4 26B to 64.9 t/s on this exact free tier. Let's look at the raw benchmark data running on an Ubuntu Linux environment with the latest compiled llama.cpp binaries and quantized GGUFs from Unsloth via HuggingFace: # Qwen 3.5 9B (Dense): Base: [ Prompt: 626.7 t/s | Generation: 21.0 t/s ] With MTP: [ Prompt: 539.1 t/s | Generation: 24.8 t/s ] # Gemma 4 26B QAT (MoE): Base: [ Prompt: 634.2 t/s | Generation: 48.3 t/s ] With MTP: [ Prompt: 572.1 t/s | Generation: 64.9 t/s ] If you are paying attention, this single Colab notebook reveals 3 massive observations about the current state of local LLMs: # 1. The MTP Speedup (Software Overclocking) Standard autoregressive decoding guesses one token at a time. MTP acts like a highly optimized, built in speculative decoder. It predicts multiple future tokens at once and the main model verifies them in parallel. The result? Zero accuracy loss and a massive throughput increase. Gemma jumped from 48 to 65 t/s just by flipping a flag. # 2. The MoE Paradox (Bigger is Faster) How does a 26B parameter model absolutely destroy a 9B model in raw speed on the exact same hardware? Architecture. Qwen 3.5 9B is a dense model. it activates all 9 billion parameters for every single token. Gemma 4 26B is a Mixture of Experts (MoE) model. It routes data efficiently, activating only 4B parameters per token. You get the reasoning capabilities of a 26B model with the compute cost of a 4B model. 3. Thinking Efficiency When I ran the exact same complex prompt on both models, the larger MoE spent significantly fewer "thinking" tokens to arrive at the correct answer. A smarter model doesn't just give better answers; it gets to the point faster, saving you compute cycles and preserving your context window. # Want to run this yourself? Here are the exact llama.cpp CLI commands. For Qwen (MTP is baked into the main model): ./llama-cli -m Qwen3.5-9B-UD-Q4_K_XL.gguf -p "Explain quantum computing." -n 2000 -c 8000 -ngl 99 -fa on --spec-type draft-mtp --spec-draft-n-max 4 --spec-draft-p-min 0.7 For Gemma (Using a separate lightweight draft model): ./llama-cli -m gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf --model-draft mtp-gemma-4-26B-A4B-it.gguf -p "Explain quantum computing." -n 2000 -c 8000 -ngl 99 -fa on --spec-type draft-mtp --spec-draft-n-max 4 --spec-draft-p-min 0.7 Stop waiting for a $3,000 rig. Boot up Colab, pull these models, and start building your stack. I’ve put together a completely free, cell by cell Google Colab notebook that automates this entire workflow so you can test it yourself in 5 minutes and learn. Link to the notebook is in the comments below. Experiemt with different MTP parameters, context windows and post your results in the comments.
0:12

I told you to claim your free 16GB NVIDIA GPU for learning Local LLMs. Now I’m going to show you how to double its inference speed without touching the hardware. Google Colab gives you an enterprise grade NVIDIA Tesla T4 GPU for free, roughly 4 hours every single day. It is the absolute perfect sandbox for learning AI engineering, testing inference flags, and pushing massive context windows. The local AI timeline is moving way too fast. If you aren't using Multi Token Prediction (MTP) yet, you are leaving massive performance on the table. I just pushed DeepMind’s Gemma 4 26B to 64.9 t/s on this exact free tier. Let's look at the raw benchmark data running on an Ubuntu Linux environment with the latest compiled llama.cpp binaries and quantized GGUFs from Unsloth via HuggingFace: # Qwen 3.5 9B (Dense): Base: [ Prompt: 626.7 t/s | Generation: 21.0 t/s ] With MTP: [ Prompt: 539.1 t/s | Generation: 24.8 t/s ] # Gemma 4 26B QAT (MoE): Base: [ Prompt: 634.2 t/s | Generation: 48.3 t/s ] With MTP: [ Prompt: 572.1 t/s | Generation: 64.9 t/s ] If you are paying attention, this single Colab notebook reveals 3 massive observations about the current state of local LLMs: # 1. The MTP Speedup (Software Overclocking) Standard autoregressive decoding guesses one token at a time. MTP acts like a highly optimized, built in speculative decoder. It predicts multiple future tokens at once and the main model verifies them in parallel. The result? Zero accuracy loss and a massive throughput increase. Gemma jumped from 48 to 65 t/s just by flipping a flag. # 2. The MoE Paradox (Bigger is Faster) How does a 26B parameter model absolutely destroy a 9B model in raw speed on the exact same hardware? Architecture. Qwen 3.5 9B is a dense model. it activates all 9 billion parameters for every single token. Gemma 4 26B is a Mixture of Experts (MoE) model. It routes data efficiently, activating only 4B parameters per token. You get the reasoning capabilities of a 26B model with the compute cost of a 4B model. 3. Thinking Efficiency When I ran the exact same complex prompt on both models, the larger MoE spent significantly fewer "thinking" tokens to arrive at the correct answer. A smarter model doesn't just give better answers; it gets to the point faster, saving you compute cycles and preserving your context window. # Want to run this yourself? Here are the exact llama.cpp CLI commands. For Qwen (MTP is baked into the main model): ./llama-cli -m Qwen3.5-9B-UD-Q4_K_XL.gguf -p "Explain quantum computing." -n 2000 -c 8000 -ngl 99 -fa on --spec-type draft-mtp --spec-draft-n-max 4 --spec-draft-p-min 0.7 For Gemma (Using a separate lightweight draft model): ./llama-cli -m gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf --model-draft mtp-gemma-4-26B-A4B-it.gguf -p "Explain quantum computing." -n 2000 -c 8000 -ngl 99 -fa on --spec-type draft-mtp --spec-draft-n-max 4 --spec-draft-p-min 0.7 Stop waiting for a $3,000 rig. Boot up Colab, pull these models, and start building your stack. I’ve put together a completely free, cell by cell Google Colab notebook that automates this entire workflow so you can test it yourself in 5 minutes and learn. Link to the notebook is in the comments below. Experiemt with different MTP parameters, context windows and post your results in the comments.

Alok

170,442 views • 21 days ago

My dual RTX PRO 6000 setup is currently training a Draft model for Qwen 3.6 27B! 🔥 I'm taking the paper DeepSeek dropped on 6/26 and going for a super ambitious application to the 27B scale. Thanks to my homelab, I was able to dive straight in — I read the paper and immediately started experimenting. The amount I've learned has been insane: - How memory bandwidth bottlenecks speed and clever ways to hack around it - Methods to train the draft model and boost its accuracy - Mechanisms to reference tokens all the way back to the previous one to skyrocket draft acceptance rates - The impact of Attention vs. GateDeltaNet on speculative decoding performance and how to handle those differences - The unique approaches and trade-offs of MTP, Dflash, JetSpec, and DSpark I could go on forever, but just from speculative decoding alone I've learned so much. The 27B architecture feels way more DSpark-native than JetSpec, so once draft training finishes, I'm going all-in with DSpark! My goal is to beat existing speculative decoding speeds outright — no task-specific shortcuts or cheating, pure general improvement. If you're into this kind of research, I'd love to hear your thoughts, impressions, and any suggestions — please reply! 🚀
0:17

My dual RTX PRO 6000 setup is currently training a Draft model for Qwen 3.6 27B! 🔥 I'm taking the paper DeepSeek dropped on 6/26 and going for a super ambitious application to the 27B scale. Thanks to my homelab, I was able to dive straight in — I read the paper and immediately started experimenting. The amount I've learned has been insane: - How memory bandwidth bottlenecks speed and clever ways to hack around it - Methods to train the draft model and boost its accuracy - Mechanisms to reference tokens all the way back to the previous one to skyrocket draft acceptance rates - The impact of Attention vs. GateDeltaNet on speculative decoding performance and how to handle those differences - The unique approaches and trade-offs of MTP, Dflash, JetSpec, and DSpark I could go on forever, but just from speculative decoding alone I've learned so much. The 27B architecture feels way more DSpark-native than JetSpec, so once draft training finishes, I'm going all-in with DSpark! My goal is to beat existing speculative decoding speeds outright — no task-specific shortcuts or cheating, pure general improvement. If you're into this kind of research, I'd love to hear your thoughts, impressions, and any suggestions — please reply! 🚀

Hikari∣LocalLLM⚡

56,314 views • 1 month ago

Everlyn isn’t just a video model. It’s a system you can trust. 🌀 At its core is the Lyn Protocol, the onchain layer that gives AI video permanence, provenance, and ownership. Here’s what it means: 🔹Decentralized inference: Videos are not generated by a single company’s servers. They run across a distributed network of nodes. 🔹Agent ownership: When you summon your agent, it is minted onchain. It belongs to you, not to a platform. 🔹Video provenance: Every render carries a timestamp and fingerprint written to the ledger. No one can fake or steal it. The Lyn Protocol transforms AI video from content into verifiable digital memory.
0:12

Everlyn isn’t just a video model. It’s a system you can trust. 🌀 At its core is the Lyn Protocol, the onchain layer that gives AI video permanence, provenance, and ownership. Here’s what it means: 🔹Decentralized inference: Videos are not generated by a single company’s servers. They run across a distributed network of nodes. 🔹Agent ownership: When you summon your agent, it is minted onchain. It belongs to you, not to a platform. 🔹Video provenance: Every render carries a timestamp and fingerprint written to the ledger. No one can fake or steal it. The Lyn Protocol transforms AI video from content into verifiable digital memory.

Everlyn

93,078 views • 11 months ago

Holy sh!t ! OpenAI will have their custom inference chips ready in just a few months and deployed at scale by the end of the year! 🤯 Training chip = The heavy lifters that require massive amounts of data and power to build and teach the AI models from scratch. Inference chip = The specialized, highly efficient chips that actually run the AI and generate the answers in real-time when you use it. This is going to help OpenAI drastically cut down their massive compute costs, speed up model reasoning times, and finally break free from relying entirely on Nvidia to scale their operations.
0:14

Holy sh!t ! OpenAI will have their custom inference chips ready in just a few months and deployed at scale by the end of the year! 🤯 Training chip = The heavy lifters that require massive amounts of data and power to build and teach the AI models from scratch. Inference chip = The specialized, highly efficient chips that actually run the AI and generate the answers in real-time when you use it. This is going to help OpenAI drastically cut down their massive compute costs, speed up model reasoning times, and finally break free from relying entirely on Nvidia to scale their operations.

Chris

60,278 views • 4 months ago

PAYING PER MODEL IS THE DUMBEST THING IN TECH RIGHT NOW i was paying 3x what i needed to for AI inference the grid lets you buy a quality spec instead of a specific model.. it routes every request in real time to the cheapest option that qualifies swap one url and your code keeps working exactly the same openai-compatible, one line to switch, 200M free tokens to start
0:19

PAYING PER MODEL IS THE DUMBEST THING IN TECH RIGHT NOW i was paying 3x what i needed to for AI inference the grid lets you buy a quality spec instead of a specific model.. it routes every request in real time to the cheapest option that qualifies swap one url and your code keeps working exactly the same openai-compatible, one line to switch, 200M free tokens to start

Robin Delta

15,729 views • 2 months ago

we made distributed inference verifiable with <1% overhead. verification is critical for any distributed system. in a trustless network, actors may swap your 70B model for a cheaper 8B one to cut costs. until now, maintaining inference integrity meant either doubling your cost (redundancy) or exploding your latency (zkp). we created veri: an on-chain verification layer light enough for high-throughput frameworks like Parallax. it hits the economic sweet spot through architectural elegance: 1. commit-sample-verify we don't prove every step; we check a random slice using game theory. workers commit to their work before the audit. cheating becomes statistically irrational, allowing a 1% sample to secure the entire sequence. 2. simultaneous execution inference and verification happen simultaneously on the same worker pool. we don't need a separate "verifier set", so compute utilization stays high. find out more about the architecture and benchmarks: paper: blog:
0:20

we made distributed inference verifiable with <1% overhead. verification is critical for any distributed system. in a trustless network, actors may swap your 70B model for a cheaper 8B one to cut costs. until now, maintaining inference integrity meant either doubling your cost (redundancy) or exploding your latency (zkp). we created veri: an on-chain verification layer light enough for high-throughput frameworks like Parallax. it hits the economic sweet spot through architectural elegance: 1. commit-sample-verify we don't prove every step; we check a random slice using game theory. workers commit to their work before the audit. cheating becomes statistically irrational, allowing a 1% sample to secure the entire sequence. 2. simultaneous execution inference and verification happen simultaneously on the same worker pool. we don't need a separate "verifier set", so compute utilization stays high. find out more about the architecture and benchmarks: paper: blog:

Parallax

28,496 views • 6 months ago

I MADE MY AI AGENT 10X FASTER WITHOUT CHANGING THE MODEL not a smarter model, not a bigger context window, not another clever prompt the same kind of AI that designs vaccines for viruses we have not even met yet was spending two minutes opening the wrong files just to hand me a brief from three months ago the problem was never capability, it was the scaffolding that piled up around my agent by accident, folder by folder an agent does not think in your categories, it searches from scratch every single time, and your tidy human folders are a maze to it the fix was almost stupidly small, one index file at the root of each big folder and a few numbers in front of the folder names slowest task dropped from 2 minutes to 26 seconds, fastest ones hit 10, zero model changes capability is cheap when the scaffolding around it is broken the article breaks down the whole system in 15 minutes ↓
0:11

I MADE MY AI AGENT 10X FASTER WITHOUT CHANGING THE MODEL not a smarter model, not a bigger context window, not another clever prompt the same kind of AI that designs vaccines for viruses we have not even met yet was spending two minutes opening the wrong files just to hand me a brief from three months ago the problem was never capability, it was the scaffolding that piled up around my agent by accident, folder by folder an agent does not think in your categories, it searches from scratch every single time, and your tidy human folders are a maze to it the fix was almost stupidly small, one index file at the root of each big folder and a few numbers in front of the folder names slowest task dropped from 2 minutes to 26 seconds, fastest ones hit 10, zero model changes capability is cheap when the scaffolding around it is broken the article breaks down the whole system in 15 minutes ↓

shmidt

36,456 views • 1 month ago

Karpathy method + Claude Code reading your whole Obsidian vault is the smartest second brain on earth. The method is simple and brutal. If you can’t build a thing from scratch, you don’t know it. Tutorials are fake learning and your brain deletes them in 3 days. Most people ignore this. They build a second brain that just sits there, folders of notes nobody reopens, dead text. Point Claude Code at the vault and it wakes up. 5,000 notes, one mind. It reads all of it and answers in your own words and your own proofs, not a model’s guess. Then the loop closes. Want to understand neural nets? Skip the 3-hour video and ask Claude Code to build a tiny one. 200 lines from scratch. Watch it train, break a layer, watch it fail, fix it. It clicks in 20 minutes instead of 3 weeks. The second it lands the note gets written. One idea per file, linked to 10 others, dropped into the vault while the memory is still hot. Now it compounds. Month 1: is 60 notes. Month 6 is 900. Every new note pulls in old ones, so you ask anything and the answer comes from your brain, not the internet. Before: 40 tabs, 6 half read PDF, 0 retained. After: build it once, own it for life. Setup takes 4 minutes. Plain text, no lock-in. A second brain nobody reads is a graveyard. Yours just started thinking.
0:13

Karpathy method + Claude Code reading your whole Obsidian vault is the smartest second brain on earth. The method is simple and brutal. If you can’t build a thing from scratch, you don’t know it. Tutorials are fake learning and your brain deletes them in 3 days. Most people ignore this. They build a second brain that just sits there, folders of notes nobody reopens, dead text. Point Claude Code at the vault and it wakes up. 5,000 notes, one mind. It reads all of it and answers in your own words and your own proofs, not a model’s guess. Then the loop closes. Want to understand neural nets? Skip the 3-hour video and ask Claude Code to build a tiny one. 200 lines from scratch. Watch it train, break a layer, watch it fail, fix it. It clicks in 20 minutes instead of 3 weeks. The second it lands the note gets written. One idea per file, linked to 10 others, dropped into the vault while the memory is still hot. Now it compounds. Month 1: is 60 notes. Month 6 is 900. Every new note pulls in old ones, so you ask anything and the answer comes from your brain, not the internet. Before: 40 tabs, 6 half read PDF, 0 retained. After: build it once, own it for life. Setup takes 4 minutes. Plain text, no lock-in. A second brain nobody reads is a graveyard. Yours just started thinking.

West Lord

590,484 views • 1 month ago

Today, we’re excited to announce a partnership with Mind Network. Both Nesa and Mind Network specialize in decentralized security, and we share a mission to bring this tech to crypto AI. Together we will explore a close technological collaboration, sharing components of our stacks with one another. Mind Network will also be using Nesa for its AI inference. Mind Network is the first FHE Restaking Layer for AI, focused on enhancing security at the consensus and validator levels of AI networks. Nesa is the Layer-1 blockchain for AI, specializing in private inference and building infrastructure to make it easy for any application, protocol, and smart contract to fuse with AI. Look out for our AMA together and other activations soon.
0:16

Today, we’re excited to announce a partnership with Mind Network. Both Nesa and Mind Network specialize in decentralized security, and we share a mission to bring this tech to crypto AI. Together we will explore a close technological collaboration, sharing components of our stacks with one another. Mind Network will also be using Nesa for its AI inference. Mind Network is the first FHE Restaking Layer for AI, focused on enhancing security at the consensus and validator levels of AI networks. Nesa is the Layer-1 blockchain for AI, specializing in private inference and building infrastructure to make it easy for any application, protocol, and smart contract to fuse with AI. Look out for our AMA together and other activations soon.

Nesa

101,935 views • 2 years ago

"In the beginning was the Word, and the Word was with God, and the Word was God." -John 1:1 God does not separate Himself from His Word. That means every time you open that Bible- you are not just reading ink on a page. You are in the presence of God. His voice. His nature. His covenant. All of it is there, waiting for you. The enemy knows this. That's why he works so hard to keep you out of the Word. Pick it up today. 📖 💬 Share it with someone who needs to fall back in love with the Word.
0:11

"In the beginning was the Word, and the Word was with God, and the Word was God." -John 1:1 God does not separate Himself from His Word. That means every time you open that Bible- you are not just reading ink on a page. You are in the presence of God. His voice. His nature. His covenant. All of it is there, waiting for you. The enemy knows this. That's why he works so hard to keep you out of the Word. Pick it up today. 📖 💬 Share it with someone who needs to fall back in love with the Word.

Paula White-Cain

19,516 views • 6 days ago

If you ever get the chance to go to Normandy, take it. Don't just visit it-take your time and let it sink in, because it is one of the most humbling experiences I've ever had. Standing there, looking out across those beaches, you can almost feel the weight of what happened there. It's hard to fully understand what those soldiers went through until you're standing in that place, realizing the courage it took just to run toward that shore. The beauty of Normandy is quiet and powerful, but so is the sacrifice it represents. The rows of white crosses, the history in the ground, the silence in the air-it all reminds you that freedom came at a tremendous cost. It's the kind of place that stays with you long after you leave. It makes you grateful, reflective, and a little more aware of how much was given for the life we live today. Normandy is more than a battlefield. It is a lesson in sacrifice, bravery, and remembrance. 🙏🇺🇸🙏
0:15

If you ever get the chance to go to Normandy, take it. Don't just visit it-take your time and let it sink in, because it is one of the most humbling experiences I've ever had. Standing there, looking out across those beaches, you can almost feel the weight of what happened there. It's hard to fully understand what those soldiers went through until you're standing in that place, realizing the courage it took just to run toward that shore. The beauty of Normandy is quiet and powerful, but so is the sacrifice it represents. The rows of white crosses, the history in the ground, the silence in the air-it all reminds you that freedom came at a tremendous cost. It's the kind of place that stays with you long after you leave. It makes you grateful, reflective, and a little more aware of how much was given for the life we live today. Normandy is more than a battlefield. It is a lesson in sacrifice, bravery, and remembrance. 🙏🇺🇸🙏

G-PA

178,796 views • 2 months ago

THIS GUY GOT SICK OF UK TRAIN STATIONS HIDING THE PLATFORM NUMBER UNTIL THE LAST SECOND, SO HE VIBE CODED AN APP THAT PREDICTS IT BEFORE THEY REVEAL IT if youve ever stood in a crowded station like london euston, you know the pain the platform stays hidden until 15 minutes before boarding, then it flashes up and hundreds of people sprint for the same gate so he built something that fixes this: > a clean departures and arrivals app pulling live data straight from the network rail apis > live train tracking so you can watch where your train actually is on the route and whether its running on time > the main feature is a predictive engine that guesses your platform before the station reveals it, and its right about 75% of the time heres how it predicts: every time a train finishes its journey, it logs which platform it actually pulled into and compares that to the platform network rail originally advertised it saves every one of those comparisons, and over time it builds up enough history to predict the platform with a real confidence score he built the whole thing with claude, mostly opus with some fable
0:18

THIS GUY GOT SICK OF UK TRAIN STATIONS HIDING THE PLATFORM NUMBER UNTIL THE LAST SECOND, SO HE VIBE CODED AN APP THAT PREDICTS IT BEFORE THEY REVEAL IT if youve ever stood in a crowded station like london euston, you know the pain the platform stays hidden until 15 minutes before boarding, then it flashes up and hundreds of people sprint for the same gate so he built something that fixes this: > a clean departures and arrivals app pulling live data straight from the network rail apis > live train tracking so you can watch where your train actually is on the route and whether its running on time > the main feature is a predictive engine that guesses your platform before the station reveals it, and its right about 75% of the time heres how it predicts: every time a train finishes its journey, it logs which platform it actually pulled into and compares that to the platform network rail originally advertised it saves every one of those comparisons, and over time it builds up enough history to predict the platform with a real confidence score he built the whole thing with claude, mostly opus with some fable

Om Patel

175,724 views • 29 days ago

What if a network could deliver AI results closer to where data is created, instead of sending it to far‑off data centers? In collaboration with NVIDIA and Decart, we’re making that a reality by bringing GPU‑powered computing to the network edge — closer to homes and businesses — so AI applications respond in real-time. This is how we're laying the foundation for the next generation of AI‑driven services:
0:16

What if a network could deliver AI results closer to where data is created, instead of sending it to far‑off data centers? In collaboration with NVIDIA and Decart, we’re making that a reality by bringing GPU‑powered computing to the network edge — closer to homes and businesses — so AI applications respond in real-time. This is how we're laying the foundation for the next generation of AI‑driven services:

Comcast

15,708 views • 4 months ago

This week is already so hot. 🔥 Massive release from Decart : Lucy 2.0 a World Editing Model running at 1080p, 30FPS in realtime. This is truly exciting, the era of real-time generative reality is here. We are moving from watching AI video to living inside AI video. A breakthrough model capable of transforming the visual world in real-time. Moving beyond offline rendering, Lucy 2.0 delivers high-fidelity 1080p video generation with near-zero latency. Lucy 2.0 literally "redraws" the entire world pixel-by-pixel, while you are watching it. e.g. If you want to be an anime character, it doesn't just put a mask on you. It turns your skin into anime skin, your hair into anime hair, and the lighting in your room into anime lighting. Lucy 2.0 is also trained to stop the generated video from slowly falling apart over time, so the same stream can run much longer without faces and details drifting. So why is this a "Massive Deal"? Traditional AI video-generation model takes a prompt, you wait 10–20 minutes, and the computer "bakes" a video for you. You couldn't touch it or change it while it was happening. But Lucy 2.0 works like a mirror. It happens in real-time (30 frames per second). There is no waiting. You move your hand, the AI character moves its hand instantly. The craziest part isn't the visuals; it's the physics. Usually, AI hallucinations are glitchy—hands merge into faces, walls melt. Lucy 2.0 understands how the world works without being told. It knows that if you take off a helmet, there is hair underneath. It knows that if you splash water, droplets fly. It learned "physics" just by watching millions of videos. The physical behavior you see emerges from learned visual dynamics, not from engineered geometry or explicit physics engines. Their official technical report explicitly states that the model does not use traditional 3D engines, depth maps, or wireframes. It is a "pure diffusion model."
0:14

This week is already so hot. 🔥 Massive release from Decart : Lucy 2.0 a World Editing Model running at 1080p, 30FPS in realtime. This is truly exciting, the era of real-time generative reality is here. We are moving from watching AI video to living inside AI video. A breakthrough model capable of transforming the visual world in real-time. Moving beyond offline rendering, Lucy 2.0 delivers high-fidelity 1080p video generation with near-zero latency. Lucy 2.0 literally "redraws" the entire world pixel-by-pixel, while you are watching it. e.g. If you want to be an anime character, it doesn't just put a mask on you. It turns your skin into anime skin, your hair into anime hair, and the lighting in your room into anime lighting. Lucy 2.0 is also trained to stop the generated video from slowly falling apart over time, so the same stream can run much longer without faces and details drifting. So why is this a "Massive Deal"? Traditional AI video-generation model takes a prompt, you wait 10–20 minutes, and the computer "bakes" a video for you. You couldn't touch it or change it while it was happening. But Lucy 2.0 works like a mirror. It happens in real-time (30 frames per second). There is no waiting. You move your hand, the AI character moves its hand instantly. The craziest part isn't the visuals; it's the physics. Usually, AI hallucinations are glitchy—hands merge into faces, walls melt. Lucy 2.0 understands how the world works without being told. It knows that if you take off a helmet, there is hair underneath. It knows that if you splash water, droplets fly. It learned "physics" just by watching millions of videos. The physical behavior you see emerges from learned visual dynamics, not from engineered geometry or explicit physics engines. Their official technical report explicitly states that the model does not use traditional 3D engines, depth maps, or wireframes. It is a "pure diffusion model."

Rohan Paul

12,761 views • 6 months ago

Batch Normalization by hand ✍️ ~ 7 steps walkthrough below Batch normalization is common practice for improving training and achieving faster convergence. It sounds simple. But it is often misunderstood. 🤔 Does batch normalization involve trainable parameters, tunable hyper-parameters, or both? 🤔 Is batch normalization applied to inputs, features, weights, biases, or outputs? 🤔 How is batch normalization different from layer normalization? So I drew and calculated one entirely by hand. Goal: normalize a mini-batch of 4 examples to mean 0 and variance 1, then let the network scale it back. = 1. Given = A mini-batch of 4 training examples, each with 3 features. = 2. Linear layer = Let us multiply by the weights and add the biases. Batch norm sits after this, which answers the second question: what gets normalized is features, not inputs, weights or biases. = 3. ReLU = We apply the activation, and -2 becomes 0. Negative values are suppressed before any statistic is taken. = 4. Batch statistics = Let us compute the sum, mean, variance and standard deviation, one row at a time. A row is a feature and the four columns are the four examples, so every number here measures one feature against the rest of the batch. That is the "batch" in batch normalization, and it is exactly what layer normalization does not do. The statistics are rounded to whole numbers, which is what keeps the rest of the page doable in pen. = 5. Shift to mean 0 = We subtract the mean, in green. The four values in each feature now average to zero. = 6. Scale to variance 1 = Let us divide by the standard deviation, in orange. Each feature now has variance one, whatever scale it arrived at. = 7. Scale and shift = We multiply by a linear transformation and pass the result on. The diagonal and the last column are trainable, so having just forced every feature to mean 0 and variance 1, we hand the network the means to undo it. The outputs: Mean of each feature = [2, 1, 2] Std dev of each feature = [1, 1, 2] To the next layer = [2, -2, 2, 0], [-3, 3, 6, -3], [2, 0, 1, 2] The answers: 🤔 Both. The scale and shift are trainable, the statistics are not. Epsilon and the momentum on the running statistics are the hyper-parameters, and one mini-batch by hand needs neither. 🤔 Features, after the linear layer, not inputs, weights or biases. 🤔 Batch norm measures across the batch, one feature at a time. Layer norm measures across the features, one example at a time. 💾 Save this post!
0:17

Batch Normalization by hand ✍️ ~ 7 steps walkthrough below Batch normalization is common practice for improving training and achieving faster convergence. It sounds simple. But it is often misunderstood. 🤔 Does batch normalization involve trainable parameters, tunable hyper-parameters, or both? 🤔 Is batch normalization applied to inputs, features, weights, biases, or outputs? 🤔 How is batch normalization different from layer normalization? So I drew and calculated one entirely by hand. Goal: normalize a mini-batch of 4 examples to mean 0 and variance 1, then let the network scale it back. = 1. Given = A mini-batch of 4 training examples, each with 3 features. = 2. Linear layer = Let us multiply by the weights and add the biases. Batch norm sits after this, which answers the second question: what gets normalized is features, not inputs, weights or biases. = 3. ReLU = We apply the activation, and -2 becomes 0. Negative values are suppressed before any statistic is taken. = 4. Batch statistics = Let us compute the sum, mean, variance and standard deviation, one row at a time. A row is a feature and the four columns are the four examples, so every number here measures one feature against the rest of the batch. That is the "batch" in batch normalization, and it is exactly what layer normalization does not do. The statistics are rounded to whole numbers, which is what keeps the rest of the page doable in pen. = 5. Shift to mean 0 = We subtract the mean, in green. The four values in each feature now average to zero. = 6. Scale to variance 1 = Let us divide by the standard deviation, in orange. Each feature now has variance one, whatever scale it arrived at. = 7. Scale and shift = We multiply by a linear transformation and pass the result on. The diagonal and the last column are trainable, so having just forced every feature to mean 0 and variance 1, we hand the network the means to undo it. The outputs: Mean of each feature = [2, 1, 2] Std dev of each feature = [1, 1, 2] To the next layer = [2, -2, 2, 0], [-3, 3, 6, -3], [2, 0, 1, 2] The answers: 🤔 Both. The scale and shift are trainable, the statistics are not. Epsilon and the momentum on the running statistics are the hyper-parameters, and one mini-batch by hand needs neither. 🤔 Features, after the linear layer, not inputs, weights or biases. 🤔 Batch norm measures across the batch, one feature at a time. Layer norm measures across the features, one example at a time. 💾 Save this post!

Tom Yeh

20,616 views • 13 days ago

Gemini Omni doesn’t just allow you to render text more accurately — but to create it in sync with your visuals. 🎥 Choose your type, placement, animation, exposure and more. Prompt for this video: Word by word, one word on the screen at a time: did, you, know, that, this, model, can, do, pretty, good, text!? each word appears with a different animated style, perfect pacing to a rhythm, sizzle reel.
0:10

Gemini Omni doesn’t just allow you to render text more accurately — but to create it in sync with your visuals. 🎥 Choose your type, placement, animation, exposure and more. Prompt for this video: Word by word, one word on the screen at a time: did, you, know, that, this, model, can, do, pretty, good, text!? each word appears with a different animated style, perfect pacing to a rhythm, sizzle reel.

Google

152,052 views • 1 month ago

🚨 SCIENTISTS ARE USING AI TO MAP A HIDDEN “CLEANING SYSTEM” INSIDE THE HUMAN BRAIN AND IT COULD CHANGE HOW WE UNDERSTAND SLEEP, AGING, AND NEURODEGENERATIVE DISEASE. It’s called the glymphatic system a vast network of fluid channels that flushes toxic waste from the brain while you sleep. For years it was almost impossible to observe in detail. Now AI-powered imaging is revealing it like a living galaxy of microscopic rivers and pathways inside neural tissue. Why this matters: Your brain produces toxic proteins constantly. The glymphatic system is one of its primary waste-clearance mechanisms clearing the very proteins linked to Alzheimer’s, Parkinson’s, and other neurodegenerative diseases. But here’s the unsettling part: This cleaning system becomes dramatically less efficient with age, poor sleep, stress, and brain injury. Sleep may not just “rest” your mind it may literally wash your brain. The deeper implication is staggering: The brain isn’t just a computer. It’s a dynamic, living network that constantly rebuilds and cleanses itself in real time. The more we map it, the more it looks like an entire universe of connected energy flows inside our skulls. What if some neurological diseases begin when the brain can no longer properly “wash” itself at night? Follow for more frontier neuroscience and future technology.
0:10

🚨 SCIENTISTS ARE USING AI TO MAP A HIDDEN “CLEANING SYSTEM” INSIDE THE HUMAN BRAIN AND IT COULD CHANGE HOW WE UNDERSTAND SLEEP, AGING, AND NEURODEGENERATIVE DISEASE. It’s called the glymphatic system a vast network of fluid channels that flushes toxic waste from the brain while you sleep. For years it was almost impossible to observe in detail. Now AI-powered imaging is revealing it like a living galaxy of microscopic rivers and pathways inside neural tissue. Why this matters: Your brain produces toxic proteins constantly. The glymphatic system is one of its primary waste-clearance mechanisms clearing the very proteins linked to Alzheimer’s, Parkinson’s, and other neurodegenerative diseases. But here’s the unsettling part: This cleaning system becomes dramatically less efficient with age, poor sleep, stress, and brain injury. Sleep may not just “rest” your mind it may literally wash your brain. The deeper implication is staggering: The brain isn’t just a computer. It’s a dynamic, living network that constantly rebuilds and cleanses itself in real time. The more we map it, the more it looks like an entire universe of connected energy flows inside our skulls. What if some neurological diseases begin when the brain can no longer properly “wash” itself at night? Follow for more frontier neuroscience and future technology.

TheNewPhysics

15,641 views • 2 months ago

We are entering an extremely exciting era for open-weight models. Kimi K2.6 now feels like a top agentic model. I took it for a spin via Fireworks AI fast inference APIs. Kimi K2.6 has impressive agentic capabilities, design skills, and the ability to synthesize large amounts of information. I built a little Skill that produces survey papers on any AI research topic you want. (see example in the clip) You can use the skill to tell your agent to generate a survey on whatever topic and watch it go to work. The artifact was fully generated by Kimi.ai's Kimi K2.6. It's cheap and fast. Next step for me is to explore ways to continue integrating the capabilities of these models on use cases like automating my LLM knowledge bases and augmenting my agent memory capabilities. Stay tuned for more.
0:19

We are entering an extremely exciting era for open-weight models. Kimi K2.6 now feels like a top agentic model. I took it for a spin via Fireworks AI fast inference APIs. Kimi K2.6 has impressive agentic capabilities, design skills, and the ability to synthesize large amounts of information. I built a little Skill that produces survey papers on any AI research topic you want. (see example in the clip) You can use the skill to tell your agent to generate a survey on whatever topic and watch it go to work. The artifact was fully generated by Kimi.ai's Kimi K2.6. It's cheap and fast. Next step for me is to explore ways to continue integrating the capabilities of these models on use cases like automating my LLM knowledge bases and augmenting my agent memory capabilities. Stay tuned for more.

elvis

47,678 views • 3 months ago

The cost of AI video was never really about the model. It was about how many models you had to pay for. MiniMax H3 understands text, image, audio and video together, then generates the final clip with sound in one pass. Topview is one of the first platforms in the world to carry it, at 30% of Seedance 2.0's price. It's a great time to be creating :
0:15

The cost of AI video was never really about the model. It was about how many models you had to pay for. MiniMax H3 understands text, image, audio and video together, then generates the final clip with sound in one pass. Topview is one of the first platforms in the world to carry it, at 30% of Seedance 2.0's price. It's a great time to be creating :

AI Frontliner

13,218 views • 3 days ago

Slideshow clipping has to be the chillest business model you can really be making $5k - $15k+ a month running 10 TikTok accounts and have complete location freedom + make more than you would working a job you can literally just go to content rewards, pick a saas or brand to promote, for example skin care buy 5 aged TT accounts to start with connect US proxy / sim find videos in the niche the product is in for example skin care steal the hook of the video and content inside it and turn it into a slideshow for example: “skin care tips for broke girls” generate the images with NBP by finding a Pinterest image and getting the JSON from Gemini or ChatGPT promote the product as another “glow up” tip Post 1 a day from the start and as the accounts get more warm boost it to 2-3 + scale to more accounts If you can’t make your first $5k doing this then there is no hope
0:14

Slideshow clipping has to be the chillest business model you can really be making $5k - $15k+ a month running 10 TikTok accounts and have complete location freedom + make more than you would working a job you can literally just go to content rewards, pick a saas or brand to promote, for example skin care buy 5 aged TT accounts to start with connect US proxy / sim find videos in the niche the product is in for example skin care steal the hook of the video and content inside it and turn it into a slideshow for example: “skin care tips for broke girls” generate the images with NBP by finding a Pinterest image and getting the JSON from Gemini or ChatGPT promote the product as another “glow up” tip Post 1 a day from the start and as the accounts get more warm boost it to 2-3 + scale to more accounts If you can’t make your first $5k doing this then there is no hope

Pounds

15,415 views • 5 months ago