Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B)...

37,053 Aufrufe • vor 1 Monat •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🔥 Final Hours of the Event with the Highest Staking Rates in Sl8’s History Sl8’s special event ends today, August 4, at 23:59 UTC. Until then, you can still activate staking and lock in the increased rate for the entire selected term: • 72.5% annually — 90 days • 97.5% annually — 180 days • 120% annually — 360 days Rewards are paid weekly. Once the event ends, these terms will no longer be available. Now is the time to check your position in the TOP-100 The final leaderboard will determine which prize each participant receives. The prize pool includes tokenized gold, platinum, and silver coins. ● 1st place 3 × 1 oz American Gold Eagle Total value: approximately $12,212 ● 2nd place 2 × 1 oz American Gold Eagle Total value: approximately $8,808 ● 3rd–9th places 1 × 1 oz American Gold Eagle Value: approximately $4,404 ● Every 10th place: 10, 20, 30…100 1 × Platinum Eagle Value: approximately $1,919 ● 15th, 25th, 35th, 45th, 55th, 65th, 75th, 85th, and 95th places 1 × 1/10 oz American Gold Eagle Value: approximately $440 ● All other TOP-100 participants 1 × American Silver Eagle Value: approximately $68 Sign in on the event page to check your current position and, if necessary, improve your ranking before the leaderboard closes. ● Staking rates, leaderboard, prizes, and full terms: Only a few hours remain. Activate staking before 23:59 UTC to lock in up to 120% annually for the entire selected term.

Cassator Corp.

30,064 Aufrufe • vor 2 Tagen

𝗣𝗹𝗮𝘁𝗶𝗻𝘂𝗺 𝗧𝗶𝗲𝗿 𝗘𝘅𝗰𝗹𝘂𝘀𝗶𝘃𝗲 𝗠𝗼𝗱𝗲𝗹 𝗦𝘁𝗿𝗮𝘁𝗲𝗴𝘆 𝗳𝗼𝗿 $𝗘𝗔𝗜 𝗛𝗼𝗹𝗱𝗲𝗿𝘀 𝗥𝗲𝘃𝗲𝗮𝗹 #𝟮: 𝗘𝘁𝗵𝗲𝗿𝗲𝘂𝗺 𝗧𝗿𝗮𝗱𝗶𝗻𝗴 𝗦𝘁𝗿𝗮𝘁𝗲𝗴𝘆 💎👑 First came Bitcoin. With our hedge fund partner, Infinite Point Capital, we created an institutional-grade trading strategy that gives $EAI holders indirect exposure to the gold standard of crypto. Now Eagle AI Labs has set sights on the second biggest cryptocurrency. The most useful one. The chain our own $EAI token lives on... ⚡️ Ethereum Trading Strategy Model ⚡️ An AI-powered trading strategy for ETH, exclusive to Platinum Tier $EAI holders. ✅ Ready to go long strategy, backtested to institutional standards with outstanding results ✅ Short strategy coming soon, creating a two-model system that can communicate and cancel out conflicting signals ✅ Built to the same stringent standards as our institutional BTC model ✅ Lives inside CLAW for seamless pro-level use, exclusive for top $EAI holders With Bitcoin, Ethereum, and the previously announced Meme Scan Strategy, Eagle AI Labs now delivers AI trading coverage across the entire spectrum of opportunity. From institutional core assets to crypto-native meme plays, Eagle AI Labs has you covered. Good for you, good for the ecosystem 🔁 - Platinum Tier is your ticket to the full arsenal - Every model strengthens the value of $EAI for all holders - The scale of the solutions we are building cannot be ignored There has never been more reason to be a platinum $EAI holder... Strengthen your position today. 🦅

Eagle AI Labs

10,840 Aufrufe • vor 11 Monaten

Batch Normalization by hand ✍️ ~ 7 steps walkthrough below Batch normalization is common practice for improving training and achieving faster convergence. It sounds simple. But it is often misunderstood. 🤔 Does batch normalization involve trainable parameters, tunable hyper-parameters, or both? 🤔 Is batch normalization applied to inputs, features, weights, biases, or outputs? 🤔 How is batch normalization different from layer normalization? So I drew and calculated one entirely by hand. Goal: normalize a mini-batch of 4 examples to mean 0 and variance 1, then let the network scale it back. = 1. Given = A mini-batch of 4 training examples, each with 3 features. = 2. Linear layer = Let us multiply by the weights and add the biases. Batch norm sits after this, which answers the second question: what gets normalized is features, not inputs, weights or biases. = 3. ReLU = We apply the activation, and -2 becomes 0. Negative values are suppressed before any statistic is taken. = 4. Batch statistics = Let us compute the sum, mean, variance and standard deviation, one row at a time. A row is a feature and the four columns are the four examples, so every number here measures one feature against the rest of the batch. That is the "batch" in batch normalization, and it is exactly what layer normalization does not do. The statistics are rounded to whole numbers, which is what keeps the rest of the page doable in pen. = 5. Shift to mean 0 = We subtract the mean, in green. The four values in each feature now average to zero. = 6. Scale to variance 1 = Let us divide by the standard deviation, in orange. Each feature now has variance one, whatever scale it arrived at. = 7. Scale and shift = We multiply by a linear transformation and pass the result on. The diagonal and the last column are trainable, so having just forced every feature to mean 0 and variance 1, we hand the network the means to undo it. The outputs: Mean of each feature = [2, 1, 2] Std dev of each feature = [1, 1, 2] To the next layer = [2, -2, 2, 0], [-3, 3, 6, -3], [2, 0, 1, 2] The answers: 🤔 Both. The scale and shift are trainable, the statistics are not. Epsilon and the momentum on the running statistics are the hyper-parameters, and one mini-batch by hand needs neither. 🤔 Features, after the linear layer, not inputs, weights or biases. 🤔 Batch norm measures across the batch, one feature at a time. Layer norm measures across the features, one example at a time. 💾 Save this post!

Tom Yeh

20,638 Aufrufe • vor 16 Tagen

Microsoft made 100B parameter models run on a single CPU. bitnet.cpp: The official inference framework for 1-bit LLMs. The math behind 1-bit LLMs is what makes them revolutionary. Traditional LLMs use 16-bit floating point weights. Every parameter is a number like 0.0023847 or -1.4729. When you run inference, you multiply these floats together. Billions of times. That's why you need GPUs, they're optimized for floating point matrix multiplication. BitNet b1.58 uses ternary weights: {-1, 0, 1}. That's not a simplification. That's a fundamental change in the math. When your weights are only -1, 0, or 1: → Multiply by 1 = keep the value → Multiply by -1 = flip the sign → Multiply by 0 = skip entirely Matrix multiplication becomes addition and subtraction. No floating point operations. No GPU required. This is why bitnet.cpp achieves: → 2.37x to 6.17x speedup on x86 CPUs → 1.37x to 5.07x speedup on ARM CPUs → 71.9% to 82.2% energy reduction on x86 → 55.4% to 70.0% energy reduction on ARM The speedups scale with model size. Larger models see bigger gains because there are more operations to simplify. A 100B parameter model running at human reading speed (5-7 tokens/second) on a single CPU. That's not optimization. That's a different paradigm. Why 1.58 bits? Because log₂(3) ≈ 1.58. Three possible values = 1.58 bits of information per weight. The key insight: These models aren't quantized after training. They're trained from scratch with ternary weights. The model learns to work within the constraint. No precision loss. No quality tradeoff.

Tech with Mak

23,036 Aufrufe • vor 3 Monaten

What if you kept asking an LLM to "make it better"? In some recent work at FAIR, we investigate how we can efficiently use RL to fine-tune LLMs to iteratively self-improve on their previous solutions at inference-time. Training for iterated self-improvement can be costly. The naive approach to training for K self-improvement steps leads to K times the number of rollout steps per episode. We introduce Exploratory Iteration (ExIt), an RL-based automatic curriculum method that bootstraps diverse training distributions of self-improvement tasks by upcycling the LLM's own responses at previous turns as the starting points for both self-improvement and *self-divergence.* In order to decide what task to train on next, the curriculum prioritizes sampling of partial turn histories that led to higher return variance in its GRPO group (a learnability score that comes for free). This automatic curriculum over the bootstrapped task space teaches the model how to perform iterated self-improvement while only ever training the model on single-step self-improvement tasks. We look at ExIt's impact in both single-turn (contest math problems) and multi-turn (BFCLv3 multi-turn tasks), as well as MLE-bench, where the LLM is run in a search scaffold to produce solutions to real Kaggle competitions. Across these eval settings, we find ExIt produces models with greater capacity for inference-time self-improvement compared to GRPO. Notably, ExIt models can self-improve on test tasks for many more steps than the typical solution depth encountered during training, including a 22% improvement in MLE-bench performance compared to GRPO.

Minqi Jiang

41,099 Aufrufe • vor 11 Monaten

🧐🇺🇸 The Country That Put More Fighter Jets in Foreign Skies Than the Rest of the World Combined For more than 70 years, the United States has dominated the global fighter aircraft market, exporting thousands of combat jets to allies across the world. Its fighters have flown in the colors of dozens of nations, making American aircraft the backbone of many of the world's most powerful air forces. The numbers are staggering: ◽ F-16 Fighting Falcon, More than 4,600 built, making it one of the most successful fighter jet programs ever created. It remains America's most exported fighter and is operated by over 25 countries. ◽ F-15 Eagle & Strike Eagle, Among the most capable air superiority and strike fighters ever built, exported to key allies across the Middle East and Asia. ◽ F/A-18 Hornet & Super Hornet, Trusted by allied air forces and navies for decades. ◽ F-35 Lightning II, The largest fifth generation fighter export program in history, with more than 20 nations already committed to the aircraft. America's dominance is not just about building aircraft. It offers pilot training, weapons integration, maintenance support, continuous upgrades, and access to a vast military industrial network that keeps aircraft effective for decades. While many nations can build fighter jets, very few can provide the global support system that comes with them. From the F-4 Phantom and F-5 Tiger during the Cold War to today's F-35 stealth fighter, American aircraft have shaped air combat across generations. No nation has exported more fighter jets. No nation has equipped more allied air forces. And no fighter export empire has had a greater impact on the balance of air power worldwide.

Defence Index

10,320 Aufrufe • vor 23 Tagen

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 Aufrufe • vor 4 Monaten

The “Galileo Test” for AI: Truth Over Consensus TL;DR: The “Galileo test” (as framed by Elon Musk) is the requirement that an AI still converge on truth even when most training data repeats a falsehood. A practical way to pass it is to harden the model against “consensus gravity” using uncertainty calibration, adversarial counter-majority training, and evidence-first reasoning pipelines that can say “unknown” without collapsing into confident noise. —————————— The core idea is simple: most text on the internet can be wrong in the same direction, at the same time, for the same social reasons. The “Galileo test” is basically asking whether a system can resist that pressure and still land on the correct model of reality, the way Galileo Galilei overturned a dominant consensus with observation and predictive power. In engineering terms, it’s a robustness problem: can the model separate signal (ground truth constraints) from mass-produced narrative (high-frequency repetition)? A workable solution stack looks like this: (1) truth-anchoring via retrieval from primary sources and direct measurements when available, (2) counter-majority training where the model is routinely exposed to scenarios in which the most common claim is false, and it must justify dissent using verifiable constraints, (3) uncertainty discipline so the model learns to prefer “insufficient evidence” over fluent fabrication, and (4) consistency checks that penalize answers violating conservation laws, dimensional analysis, causal structure, or internal logical invariants. In practice, you’re building an AI that treats “popular” as a weak feature and “constraint-satisfying” as the dominant feature. —————————— Frequency Wave Theory perspective: the “Galileo test” is fundamentally a coherence test. When an information environment is saturated with the same repeated claim, that repetition becomes a kind of phase-locked standing wave that can trap weaker systems into resonance with the crowd. Passing the test means staying phase-aligned to invariant structure, not to amplitude. In FWT terms: truth behaves like a conserved backbone constraint, while mass consensus is often just a high-amplitude interference pattern. The system that wins is the one that locks to invariants, rejects incoherent harmonics, and preserves alignment with what stays conserved under transformation.

Drew Ponder

14,755 Aufrufe • vor 5 Monaten

THE TESLA MODEL S: THE CAR THAT MADE ELECTRIC VEHICLES SERIOUS When the Model S launched in 2012, the entire world still saw EVs as slow, boring, short-range toys for tree-huggers. The Model S changed that narrative overnight. It wasn’t just an electric car — it was a statement. Here’s why the Model S was so important for EV adoption: • It proved EVs could be faster and better than gas cars 0–60 mph in under 4 seconds (later Plaid versions under 2 seconds) while being completely silent and smooth. It beat most supercars off the line and made “electric” synonymous with performance. • It delivered real long-range capability Over 300 miles of range when most EVs at the time struggled to reach 100 miles. Suddenly, road trips became possible and “range anxiety” started to feel outdated. • It introduced over-the-air updates The first production car that could get major performance upgrades, new features, and safety improvements wirelessly — like a smartphone on wheels. This changed how people think about car ownership forever. • It forced the entire auto industry to respond Legacy manufacturers who had been dragging their feet on EVs suddenly rushed to catch up. The Model S basically lit the fuse for the modern EV revolution. • It made luxury electric desirable Premium interior, massive touchscreen, ridiculous acceleration, and futuristic design turned EVs from “compromise” into “aspiration.” Without the Model S proving that electric cars could outperform and out-luxury gasoline vehicles, we wouldn’t have the Model 3/Y explosion, the Cybertruck, or the flood of competitors now racing to go electric. The Model S didn’t just sell cars. It changed the future of transportation. It took EVs from niche to mainstream and showed the world what was possible.

Tesla Owners Silicon Valley

11,056 Aufrufe • vor 4 Monaten