Loading video...

Video Failed to Load

Go Home

one model built ten webpages in 160 seconds. the next one took 623. same prompt to three models at once: ten standalone HTML pages, one per footballer, shared template and CSS, each self-contained. Ling-3.0-flash: 160s Step 3.7 Flash: 319s MiniMax M2.7: 623s first reasoning token came back in 84ms....

34,332 views • 8 days ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This Chinese developer linked two $2,999 NVIDIA DGX Sparks into one box and runs the full Qwen3-235B at home, after dropping his $1,999-a-month cloud bill to zero. He wired 2 small boxes into a single computer, split a giant 235-billion-parameter model in half between them, and serves it across his own network at about 10 tokens a second, with no internet, no cloud, right there on the desk. No data center, no thousand-dollar graphics cards, no monthly cloud bill. Just him, 2 gold boxes the size of a sandwich, one cable between them, and 1 power strip. And here is the whole payoff. He used to pay the cloud $1,999 a month for the same model, and the meter ticked on every request. Now he paid $5,998 once for 2 boxes, they covered their cost in 3 months, and after that he sends as many requests as he wants for free, only electricity. The two Sparks talk over one fast cable, each holds 128GB of memory, and together they carry the whole model, about 73GB loaded per box, with the chip inside pinned near the limit at 96%. Both boxes work as one and keep trading data over the cable, with no cloud in the loop and no single word leaking out. The ready model sits on one local address, and any app on his network calls it as easily as ChatGPT. And here is how he described, in plain words, what this pair of boxes does: "this is a pair of boxes that holds the huge Qwen3-235B model and serves it to one network. the model is split in half, and each box owns its half. parts: // Box 1 (holds the first half of the model and starts the answer fast, the first word appears in under a second) // Box 2 (holds the second half and writes out the rest, about 10 tokens a second) // Cable (connects the 2 boxes and moves data between them on every step, with no lag) // Address (one local address where any app sends its request, like to a cloud model) // Test (a script that runs big prompts through and measures speed and delays) // Monitor (checks temperature, power draw, and load on both boxes every 2 seconds). the model never goes to the cloud. he only steps in when a box runs hotter than 80 degrees or the cable between them starts dropping data." So the system knows exactly what it is, what it is for, and where its limits are. It knows it has to hold the whole huge model across 2 boxes on its own. It knows it has to answer every request locally, with no meter, no limits, and no internet. It knows the human is only needed when a box overheats or the link between them stalls. → The setup runs around the clock on 2 boxes, each pulling under 60 watts → However many requests he sends, the monthly bill is $0, only electricity → The first box starts the answer in under a second → The second writes text at about 10 tokens a second → One request at a time: 838 tokens in 85 seconds, first word in 0.8s → Two requests at once: 697 tokens in 108 seconds, first word in 0.7s → Both boxes sit at 96% load and warm up to 76-78 degrees And only when a chip in a box runs hotter than 80 degrees or the cable between the 2 Sparks drops data does the system call the owner. And when he himself is out on a run or in a coffee shop, he still reaches his own model at home from his phone: sends a big prompt to the local Qwen3-235B, gets the full answer back in under a minute and a half, with no token meter ticking and no limit to hit. Here is what the test shows on his screen during one of the night runs: "one request at a time: 838 tokens in 84.9 seconds, first word in 0.8s, then 0.1s per token." "two requests at once: 697 tokens in 107.6 seconds, first word in 0.7s, then 0.15s per token." "Box 1: chip at 96% load, 76 degrees, 56 watts, 73GB used in memory." "Box 2: chip at 96% load, 78 degrees, 56 watts, the Qwen3-235B model fully loaded." And while everyone around is paying for AI by the month and bumping into limits, his top-tier model just sits on the desk and works as much as he wants: his own little power plant instead of a forever meter. He has no server rack of his own and no cloud account behind it. Just 2 DGX Spark boxes on a desk, one model split in half between them, one local address, and a folder of prompts next to it. Out of everything I have seen this year, this is the cleanest way to stop paying for AI: $5,998 of hardware on the desk once, $0 a month to the cloud, unlimited forever, and between them 2 gold boxes, 1 cable, and the full Qwen3-235B answering at home with no internet.

Blaze

93,871 views • 2 months ago

Most AI research demos show you a polished answer. This one showed me the disagreement that happened before the answer. I gave Ling-3.0-flash Ant Ling a deliberately difficult question: Do four-day workweeks actually increase productivity, or do they simply compress the same workload into fewer days? Instead of asking for a quick summary, I asked it to coordinate five specialist roles: a scientist, a data analyst, a cross-validator, an archivist, and a research writer. Each role had a separate responsibility. The scientist defined the competing hypotheses. The analyst extracted comparable findings. The archivist tracked the sources. The writer could only use approved claims. And the cross-validator had one job: challenge anything that sounded more confident than the evidence allowed. That last role changed the result. The team reviewed 12 sources and challenged six major claims. Three claims were narrowed. One was rejected entirely. Even a widely repeated claim about a 40% productivity increase did not survive the evidence check. That is the part I wanted to see from an AI research workflow. Not just more information, but visible resistance to weak evidence. The final output included: - a direct executive answer - a structured research paper - a source and evidence table - a disagreement log - a six-slide executive deck - a quality-control summary The conclusion was also more useful than a simple yes or no: reduced working hours may maintain productivity and improve wellbeing under certain conditions, while compressing the same workload into fewer days can increase fatigue and intensity. The evidence did not support a universal productivity claim. What impressed me was not that Ling-3.0-flash generated a long response. Plenty of models can do that. It was the way the model maintained multiple roles, evidence standards, objections, citations, and deliverables across one extended workflow, while preserving uncertainty instead of smoothing it away. That makes Ling-3.0-flash especially interesting for work where execution matters as much as reasoning: research, search, coding, document processing, tool use, repeated checks, and other multi-step agent workflows. The strongest AI systems will not use the largest model for every task. They will combine deep planning with fast, cost-efficient execution. Ling-3.0-flash is built for that execution layer. Ling-3.0-flash is now available on OpenRouter and free to use through August 3, 2026. Try it in your coding, search, research, and tool-use workflows. Then show us what you build. Try Ling-3.0-flash: Documentation:

Rachel🥥

73,264 views • 13 days ago

Two data points dropped in the last few months that should terrify every software company that thinks its codebase is a moat. First, one engineer at Cloudflare, working with Claude via AI agents, rebuilt 94% of Next.js, one of the most widely used frontend frameworks on the internet, built over 10 years by a large engineering team in a single week. Total cost was $1,100 in API tokens. The result, called Vinext, is a drop-in replacement that builds production apps up to 4x faster and produces client bundles 57% smaller and customers are already running it in production. Second is Cursor CEO Michael Truell deployed a swarm of hundreds of GPT-5.2 agents that ran uninterrupted for an entire week and built a fully functional web browser from scratch called FastRender. 3 million lines of code, thousands of files and a custom Rust rendering engine with HTML parsing, CSS layout, text shaping, and a custom JavaScript VM. Total cost was roughly $30,000. For context, Google has spent billions of dollars and decades of engineering building Chrome. And the benchmarks say by next year, you will be able to one-shot prompt anything. The moat that software companies spent decades building, the complexity of their codebase, the years it would take a competitor to replicate it, the switching costs that moat assumed humans were the unit of production. AI does not care how long it took you to build it, it only cares how long it takes to rebuild it. And right now, the answer is one week.

Milk Road AI

16,781 views • 3 months ago

Mark Zuckerberg is explaining one of the most misunderstood dynamics in AI and it has direct investment implications (Save this). The concept he's describing is model distillation, and it's one of the most important techniques to emerge in AI over the past year. Here's how it works. You train a massive, enormously expensive model, in Meta's case, Llama 4 Behemoth, a 2 trillion parameter teacher model and then you use that model to teach a much smaller, cheaper model. The smaller model inherits roughly 90 to 95% of the intelligence of the giant while running at 10% of the cost and on a fraction of the compute. Meta already did this with the Llama 4 family and Behemoth serves as the teacher. Llama 4 Scout and Maverick, the publicly released open-source models were distilled from it. Scout runs on a single H100 GPU with a 10 million token context window and outperforms models that cost far more to operate. Maverick, at 17 billion active parameters, rivals DeepSeek V3 in coding at half the parameter count and beats GPT-4o on multimodal benchmarks. Both are completely free for commercial use. What Zuckerberg is pointing at is a structural shift in how AI gets deployed in the real world. Companies aren't taking a frontier model off the shelf and running it as-is but rather taking open-source models, fine-tuning them on their own proprietary data, distilling them into even smaller custom models tailored to their specific use case, and running them on infrastructure they control at a fraction of the cost of a closed frontier API. The investment implication of this is significant and runs in two directions. For Meta specifically, this is a strategic masterstroke. Every company that builds on Llama, fine-tunes it, distills it, or deploys it through their infrastructure is pulling into Meta's orbit while Meta builds the most powerful open teacher model. The ecosystem of companies using it grows and that ecosystem generates commercial activity across Meta's platforms and data services. Meta's AI research benefits from billions of real world deployment signals and it's a flywheel that closed model providers cannot replicate because their strategy requires charging per token, which is now a 65x cost disadvantage against the open-source alternative. For the broader market, distillation changes the economics of inference in a way that has barely been priced in. As intelligence becomes extractable into smaller and cheaper models, the absolute demand for compute doesn't decline but rather it explodes, because now the number of applications that are economically viable expands by orders of magnitude. Every task that was previously too expensive to automate at $3.25 per call becomes viable at $0.05 that means more total token usage, more total GPU utilization, and more demand for the infrastructure companies, the Nebiuses, the GE Vernovas, the Constellation Energies that supply the underlying compute and power.

Milk Road AI

27,908 views • 1 month ago