Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Open weight Kimi K3 crushed cloud frontier GPT 5.6 at 3D destruction physics! Moonshot AI became the first lab to open-source frontier model weights. We tested them on 8x B300 We gave four models the same task: build three self-contained HTML scenes with real physics Prompts: – A monster...

atomic_chat_hq's profile picture

atomic.chat

12,927 subscribers

145,217 görüntüleme • 7 gün önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Opus 5 crushed Fable 5 at 3D destruction physics for 2x cheaper! We gave four models the same task: build three self-contained HTML scenes with real physics Prompts: - A tornado that sucks in a whole field - A wrecking ball taking down an apartment block - An overloaded truck collapsing a truss bridge Outputs: - Opus 5: 55.9K tokens, $1.40 - Fable 5: 55.1K tokens, $2.82 - Kimi K3: 35.7K tokens, $0.55 - GPT 5.6: 20.1K tokens, $0.31 Opus got all three right unlike the other models. Houses fly up the funnel and out the top, the wall breaks where the ball hits and the rubble piles up, the bridge drops the truck into the river. Fable had almost nothing on the ground for the tornado to pick up, its building collapsed on its own before the ball even touched it and its bridge blew into sticks all at once. GPT is the cheapest here but its ball never reached the building at all and its bridge fell apart in a way nothing falls apart in real life. Kimi K3, the new Chinese frontier model, ended up in the same place as GPT
0:22

Opus 5 crushed Fable 5 at 3D destruction physics for 2x cheaper! We gave four models the same task: build three self-contained HTML scenes with real physics Prompts: - A tornado that sucks in a whole field - A wrecking ball taking down an apartment block - An overloaded truck collapsing a truss bridge Outputs: - Opus 5: 55.9K tokens, $1.40 - Fable 5: 55.1K tokens, $2.82 - Kimi K3: 35.7K tokens, $0.55 - GPT 5.6: 20.1K tokens, $0.31 Opus got all three right unlike the other models. Houses fly up the funnel and out the top, the wall breaks where the ball hits and the rubble piles up, the bridge drops the truck into the river. Fable had almost nothing on the ground for the tornado to pick up, its building collapsed on its own before the ball even touched it and its bridge blew into sticks all at once. GPT is the cheapest here but its ball never reached the building at all and its bridge fell apart in a way nothing falls apart in real life. Kimi K3, the new Chinese frontier model, ended up in the same place as GPT

atomic.chat

1,474,231 görüntüleme • 10 gün önce

New Z.ai GLM-5.2 beats Kimi K2.7 Code on physics contest! We gave both models the same three prompts and asked them to build self contained HTML5 sims with real physics and no libraries: 1. Pool break 2. Block on a bed of springs 3. Galton board Outputs: GLM-5.2: 12,640 tokens Kimi K2.7 Code: 7,420 tokens GLM 5.2 nailed all three, and it did it with way more detail and polish. The break conserved momentum, the block bounced off the springs and the Galton beads spread into a clean bell curve. Kimi struggled on every scene: its block fell straight through the springs, its break didn't look realistic with the balls colliding all wrong, and on the Galton board its balls overlapped and piled into each other instead of spreading out
0:33

New Z.ai GLM-5.2 beats Kimi K2.7 Code on physics contest! We gave both models the same three prompts and asked them to build self contained HTML5 sims with real physics and no libraries: 1. Pool break 2. Block on a bed of springs 3. Galton board Outputs: GLM-5.2: 12,640 tokens Kimi K2.7 Code: 7,420 tokens GLM 5.2 nailed all three, and it did it with way more detail and polish. The break conserved momentum, the block bounced off the springs and the Galton beads spread into a clean bell curve. Kimi struggled on every scene: its block fell straight through the springs, its break didn't look realistic with the balls colliding all wrong, and on the Galton board its balls overlapped and piled into each other instead of spreading out

atomic.chat

60,899 görüntüleme • 1 ay önce

New Kimi K3 beat Opus 4.8 at making retro games for 2x cheaper! We gave three models the same task: make three old arcade games that play by themselves. Each game is one HTML file with a bot that plays it Prompts: – Road Fighter – Battle City – Q*bert Outputs: Kimi K3: 18.4K tokens, $0.28 GPT-5.6: 18.1K tokens, $0.28 Opus 4.8: 21.3K tokens, $0.54 Kimi K3 made the best games. Its Q*bert is the best of all three. The player jumps on the cubes, paints them and runs from the purple snake. Its Battle City looks just like the real game and plays right. The tanks move, aim, shoot and break the walls. GPT-5.6 could not handle the cars. Its Battle City broke too. The tank died on its own and the base got hit. But GPT had the nicest textures of the three
0:27

New Kimi K3 beat Opus 4.8 at making retro games for 2x cheaper! We gave three models the same task: make three old arcade games that play by themselves. Each game is one HTML file with a bot that plays it Prompts: – Road Fighter – Battle City – Q*bert Outputs: Kimi K3: 18.4K tokens, $0.28 GPT-5.6: 18.1K tokens, $0.28 Opus 4.8: 21.3K tokens, $0.54 Kimi K3 made the best games. Its Q*bert is the best of all three. The player jumps on the cubes, paints them and runs from the purple snake. Its Battle City looks just like the real game and plays right. The tanks move, aim, shoot and break the walls. GPT-5.6 could not handle the cars. Its Battle City broke too. The tank died on its own and the base got hit. But GPT had the nicest textures of the three

atomic.chat

98,519 görüntüleme • 18 gün önce

GPT-5.6 Sol Ultra lost to GPT-5.5 on physics at 3× the cost! We gave 4 models the same prompt: build three self-contained HTML5 canvas scenes with real physics demos Prompts: - A monster truck backflipping onto a parked car - A stunt car jumping six buses into a brick wall - A train derailing off a broken bridge into the water Outputs: GPT-5.6 Sol Ultra: 32.9K tokens, $0.33 Opus 4.8: 9.2K tokens, $0.24 GPT-5.5: 12.4K tokens, $0.11 Grok 4.5: 7.0K tokens, $0.08 Sol Ultra draws just like GPT-5.5, only with more detail and it shows clearest on the bus jump where the two look almost identical. In the other tests Sol Ultra came out worse than its predecessor and the physics really got weaker. We think GPT-5.5 took the truck flip and the train outright. With Sol Ultra you basically get GPT-5.5 with weaker physics and a nicer picture for 3x the price. Newborn Grok 4.5 failed two of the three tests and only came good on the train
0:25

GPT-5.6 Sol Ultra lost to GPT-5.5 on physics at 3× the cost! We gave 4 models the same prompt: build three self-contained HTML5 canvas scenes with real physics demos Prompts: - A monster truck backflipping onto a parked car - A stunt car jumping six buses into a brick wall - A train derailing off a broken bridge into the water Outputs: GPT-5.6 Sol Ultra: 32.9K tokens, $0.33 Opus 4.8: 9.2K tokens, $0.24 GPT-5.5: 12.4K tokens, $0.11 Grok 4.5: 7.0K tokens, $0.08 Sol Ultra draws just like GPT-5.5, only with more detail and it shows clearest on the bus jump where the two look almost identical. In the other tests Sol Ultra came out worse than its predecessor and the physics really got weaker. We think GPT-5.5 took the truck flip and the train outright. With Sol Ultra you basically get GPT-5.5 with weaker physics and a nicer picture for 3x the price. Newborn Grok 4.5 failed two of the three tests and only came good on the train

atomic.chat

896,867 görüntüleme • 25 gün önce

Just tested Kimi.ai K3 against GPT-5.6 and Grok 4.5 on the same task: build a Subway Surfers game. Kimi K3 was my favorite. Better UI, smoother gameplay, and the overall experience felt more polished. GPT-5.6 was solid too, while Grok 4.5 fell behind on the UI. The interesting part is that all three needed at least one follow-up prompt. Kimi also took a bit longer to generate, but the extra time paid off. Ran Kimi K3 through Nebius Token Factory. Low inference cost + a really capable open source model is a great combo.
0:42

Just tested Kimi.ai K3 against GPT-5.6 and Grok 4.5 on the same task: build a Subway Surfers game. Kimi K3 was my favorite. Better UI, smoother gameplay, and the overall experience felt more polished. GPT-5.6 was solid too, while Grok 4.5 fell behind on the UI. The interesting part is that all three needed at least one follow-up prompt. Kimi also took a bit longer to generate, but the extra time paid off. Ran Kimi K3 through Nebius Token Factory. Low inference cost + a really capable open source model is a great combo.

Arindam Majumder 𝕏

45,400 görüntüleme • 7 gün önce

Open weight Kimi K3 performs at Claude Fable 5 level on 3D arcade games! We gave both models the same prompts: ✦ Pac-Man with four hunting ghosts ✦ Nokia Snake remade in 3D ✦ Retro space pinball table with real physics Outputs (thinking included): ✦ Kimi K3 (local, 8x B300): ~237K tokens, $0 ✦ Claude Fable 5: 92K tokens, $4.50 Every one of Kimi's tokens was free on our GPUs. Even via Moonshot's API the same Kimi run would be $3.60, still under Fable. Kimi held its quality against the strongest cloud model. Its snake is the liveliest scene of all six: soft shadows, floating dust, a flicking tongue, and a bot that checks it can still reach its own tail before every move. Fable's snake plays clean but looks flat next to it. Pac-Man is the closest call of the three. Kimi builds a fresh labyrinth on every restart and draws a live minimap in the corner while the red ghost tracks the player turn by turn through the corridors, and it even caught our bot on camera. Fable's maze answers with pearl pellets, +10 popups bursting over the floor and a wide-eyed cartoon ghost patrol. Fable won the pinball table: painted playfield art, a chrome ball that mirrors the neon lights, even little synth sound effects.
0:32

Open weight Kimi K3 performs at Claude Fable 5 level on 3D arcade games! We gave both models the same prompts: ✦ Pac-Man with four hunting ghosts ✦ Nokia Snake remade in 3D ✦ Retro space pinball table with real physics Outputs (thinking included): ✦ Kimi K3 (local, 8x B300): ~237K tokens, $0 ✦ Claude Fable 5: 92K tokens, $4.50 Every one of Kimi's tokens was free on our GPUs. Even via Moonshot's API the same Kimi run would be $3.60, still under Fable. Kimi held its quality against the strongest cloud model. Its snake is the liveliest scene of all six: soft shadows, floating dust, a flicking tongue, and a bot that checks it can still reach its own tail before every move. Fable's snake plays clean but looks flat next to it. Pac-Man is the closest call of the three. Kimi builds a fresh labyrinth on every restart and draws a live minimap in the corner while the red ghost tracks the player turn by turn through the corridors, and it even caught our bot on camera. Fable's maze answers with pearl pellets, +10 popups bursting over the floor and a wide-eyed cartoon ghost patrol. Fable won the pinball table: painted playfield art, a chrome ball that mirrors the neon lights, even little synth sound effects.

Atomic Agent

309,981 görüntüleme • 6 gün önce

New Kimi K2.7 Code performs at GPT-5.5 level 3x cheaper! We gave both models the same three prompts: build a self-contained HTML5 canvas sim with real physics, no libraries. A spring pendulum on a stretching coil, a 1 kg block trading collisions with a 100,000 kg block, and 22 balls churning in a spinning hexagon Outputs: Kimi K2.7 Code: $0.28 on 52.4k tokens GPT-5.5: $0.93 on 23.4k tokens Spring pendulums and blocks came out even. The balls Kimi did better: its pile spins with the drum when GPT's bounce around in pure chaos. On price to quality, K2.7 Code is the clear pick
0:25

New Kimi K2.7 Code performs at GPT-5.5 level 3x cheaper! We gave both models the same three prompts: build a self-contained HTML5 canvas sim with real physics, no libraries. A spring pendulum on a stretching coil, a 1 kg block trading collisions with a 100,000 kg block, and 22 balls churning in a spinning hexagon Outputs: Kimi K2.7 Code: $0.28 on 52.4k tokens GPT-5.5: $0.93 on 23.4k tokens Spring pendulums and blocks came out even. The balls Kimi did better: its pile spins with the drum when GPT's bounce around in pure chaos. On price to quality, K2.7 Code is the clear pick

atomic.chat

139,760 görüntüleme • 1 ay önce

New Google Gemma 4 12B claims near-26B performance - we tested both! We ran both models locally on one RTX 4090 and gave each the same task: write a self-contained HTML5 canvas animation with real physics in one file without libraries. Three scenes - a Galton board, two blocks colliding off a wall, and a chaotic triple pendulum Outputs: Gemma 4 26B-A4B: 15 GB VRAM usage, 6.9k tokens, 138 tok/s Gemma 4 12B: 9 GB VRAM usage, 8.9k tokens, 80 tok/s Same Gemma 4 family, but the 26B-A4B won every scene and ran ~1.7x faster - on just 4B active params. The 12B stayed very close though, on almost half the VRAM - which makes it the ideal model for a 16 GB laptop
0:36

New Google Gemma 4 12B claims near-26B performance - we tested both! We ran both models locally on one RTX 4090 and gave each the same task: write a self-contained HTML5 canvas animation with real physics in one file without libraries. Three scenes - a Galton board, two blocks colliding off a wall, and a chaotic triple pendulum Outputs: Gemma 4 26B-A4B: 15 GB VRAM usage, 6.9k tokens, 138 tok/s Gemma 4 12B: 9 GB VRAM usage, 8.9k tokens, 80 tok/s Same Gemma 4 family, but the 26B-A4B won every scene and ran ~1.7x faster - on just 4B active params. The 12B stayed very close though, on almost half the VRAM - which makes it the ideal model for a 16 GB laptop

atomic.chat

152,032 görüntüleme • 2 ay önce

With Kimi K3 Day-0 on vLLM: Open Frontier Intelligence for Everyone 🚀 At 2.8 trillion parameters, Moonshot AI's Kimi K3 is one of the most powerful open-weight models ever released. Starting today, you can serve it on vLLM the moment the weights are public. What K3 brings: 🧠 2.8T-parameter Mixture-of-Experts (16 of 896 experts active per token) 📚 1M-token context window 🛠️ Native multimodal understanding, including vision ⚡ Kimi Delta Attention: a hybrid of linear and full attention that makes million-token context affordable Huge thank you to Kimi.ai AI for the model release and partnership, Inferact for leading the vLLM optimizations, and to our partners at NVIDIA, AMD, and the broader vLLM community. 1/6
0:30

With Kimi K3 Day-0 on vLLM: Open Frontier Intelligence for Everyone 🚀 At 2.8 trillion parameters, Moonshot AI's Kimi K3 is one of the most powerful open-weight models ever released. Starting today, you can serve it on vLLM the moment the weights are public. What K3 brings: 🧠 2.8T-parameter Mixture-of-Experts (16 of 896 experts active per token) 📚 1M-token context window 🛠️ Native multimodal understanding, including vision ⚡ Kimi Delta Attention: a hybrid of linear and full attention that makes million-token context affordable Huge thank you to Kimi.ai AI for the model release and partnership, Inferact for leading the vLLM optimizations, and to our partners at NVIDIA, AMD, and the broader vLLM community. 1/6

vLLM

100,611 görüntüleme • 7 gün önce

kimi k3 vs gpt 5.6 sol vs fable 5 vs grok 4.5 Kimi.ai just dropped kimi k3 – a 2.8t param native multimodal model, the first open 3t-class release. key facts: • 1m token context. stable latentmoe activating 16 of 896 experts, built on kimi delta attention (kda) and attention residuals • quantization-aware training from the sft stage onward – mxfp4 weights, mxfp8 activations. moonshot claims ~2.5x scaling efficiency over k2 • max thinking effort by default. low- and high-effort modes are "coming in updates" – there is no way to turn the thinking down today, and you feel it in every run • pricing: $0.30/mtok cache-hit input, $3.00/mtok cache-miss, $15.00/mtok output. claims >90% cache hit rate on coding workloads • benchmarks: swe marathon 42.0 (1st – fable 5: 35.0, sol: 39.0, opus 4.8: 40.0), terminal bench 2.1 88.3, browsecomp 91.2 (1st), program bench 77.8 (1st), gpqa-diamond 93.5. loses frontierswe 81.2 vs fable's 86.6, and deepswe 67.5 vs sol's 73.0 our test – 3 prompts, single-file html, Three.js, fully procedural, no assets: 1. photorealistic european roulette wheel – 37 pockets in the real sequence, mahogany clearcoat bowl, chrome turret, diamond deflectors, flick-to-spin, ball that spirals inward and settles on a mathematically real number 2. las vegas slot machine – 3 reels behind transmissive glass, drag the chrome lever to play, mechanical odometer counters modelled in 3d, coin physics on win 3. full pinball table – 6.5° tilted playfield, flipper impulse physics, spline ramps, drop targets, 6 bumpers, mechanical score reels in the backbox we ran the test on AI/ML API platform results: - cost #1 grok 4.5 – $0.30 #2 kimi k3 – $0.71 #3 gpt 5.6 sol – $2.05 #4 fable 5 – $7.69 - tokens #1 grok 4.5 – 34,241 #2 gpt 5.6 sol – 51,748 #3 fable 5 – 144,126 #4 kimi k3 – 157,999 - lines of code #1 gpt 5.6 sol – 3,054 #2 grok 4.5 – 3,047 #3 kimi k3 – 2,255 #4 fable 5 – 1,950 - generation time #1 grok 4.5 – 5.1 min #2 gpt 5.6 sol – 22.0 min #3 fable 5 – 31.5 min #4 kimi k3 – 75.6 min observations: • kimi k3 is cheap and it is slow. 75.6 minutes across three prompts against grok's 5.1. it is 2.4x grok's price and 15x grok's wall clock. the roulette took 15 min, the slot 18, the pinball 42 • it failed 2 of 3. only the roulette works. the slot machine has reel cutouts on both faces of the cabinet and the symbols face backwards – you can only read your spin by walking around to the rear of the machine. the pinball table stands vertically on its edge with the legs floating detached beside it. • 81% of kimi's output tokens are reasoning, not code. grok: 22%. you are not paying for a bigger answer, you are paying for a longer argument with itself • price per 100 shipped lines – grok $0.010, kimi $0.031, sol $0.067, fable $0.394. a 39x spread for the same three files kimi k3's code quality: upsides: • the roulette is genuinely good – procedural wood grain with real specular breakup, correct european sequence (0-32-15-19-4...), chrome turret, diamond deflectors, clean console • the pinball artwork is the best in the test – a synthwave "nova strike / deep space" field with six individually coloured neon bumper rings, a retro sun on a grid horizon, a nova burst, and a scoring legend printed on the apron. no other model printed the rules on the machine. it is a beautiful texture on a broken object • physics reasoning is real – it derived a 480hz substep for the collider, worked out ball settle conditions and termination guarantees, and checked every ramp exit vector by hand before writing any of it • it is the only model that saw the importmap trap coming. sol shipped a blank white page twice because three.js addons import the bare specifier 'three' and die without an import map downsides: • it dodged that trap on the slot by loading three.js r128 through classic script tags – a 2021 build with no working transmission. its slot glass rendered fully opaque and buried all three reels behind a white pane. the code asks for transmission: 0.93, ior: 1.5 – correct, and silently ignored by a renderer that predates the feature • after 42 minutes and 212k characters of reasoning, the pinball cabinet is not assembled. the table stands vertically on its edge like a wardrobe – the prompt asked for 6.5° from horizontal, it delivered 90°. the legs float detached in the void beside it. head-on it photographs beautifully; orbit ten degrees and it is a painted slab with four chrome rods hovering nearby • the playfield z-fights with the glass – hard black banding across the whole field as soon as you pull the camera back a note on the pinball, in fairness to kimi: nobody passed it. every model shipped broken ball physics and controls you cannot trust. it is the hardest prompt we have run and the whole field failed it, each in its own way kimi k3 reasons better than anything else here and it shows exactly where reasoning pays – physics constants, sequences, edge cases, traps the others walked into follow thehype. for 24/7 ai news, analysis and breakdowns
0:36

kimi k3 vs gpt 5.6 sol vs fable 5 vs grok 4.5 Kimi.ai just dropped kimi k3 – a 2.8t param native multimodal model, the first open 3t-class release. key facts: • 1m token context. stable latentmoe activating 16 of 896 experts, built on kimi delta attention (kda) and attention residuals • quantization-aware training from the sft stage onward – mxfp4 weights, mxfp8 activations. moonshot claims ~2.5x scaling efficiency over k2 • max thinking effort by default. low- and high-effort modes are "coming in updates" – there is no way to turn the thinking down today, and you feel it in every run • pricing: $0.30/mtok cache-hit input, $3.00/mtok cache-miss, $15.00/mtok output. claims >90% cache hit rate on coding workloads • benchmarks: swe marathon 42.0 (1st – fable 5: 35.0, sol: 39.0, opus 4.8: 40.0), terminal bench 2.1 88.3, browsecomp 91.2 (1st), program bench 77.8 (1st), gpqa-diamond 93.5. loses frontierswe 81.2 vs fable's 86.6, and deepswe 67.5 vs sol's 73.0 our test – 3 prompts, single-file html, Three.js, fully procedural, no assets: 1. photorealistic european roulette wheel – 37 pockets in the real sequence, mahogany clearcoat bowl, chrome turret, diamond deflectors, flick-to-spin, ball that spirals inward and settles on a mathematically real number 2. las vegas slot machine – 3 reels behind transmissive glass, drag the chrome lever to play, mechanical odometer counters modelled in 3d, coin physics on win 3. full pinball table – 6.5° tilted playfield, flipper impulse physics, spline ramps, drop targets, 6 bumpers, mechanical score reels in the backbox we ran the test on AI/ML API platform results: - cost #1 grok 4.5 – $0.30 #2 kimi k3 – $0.71 #3 gpt 5.6 sol – $2.05 #4 fable 5 – $7.69 - tokens #1 grok 4.5 – 34,241 #2 gpt 5.6 sol – 51,748 #3 fable 5 – 144,126 #4 kimi k3 – 157,999 - lines of code #1 gpt 5.6 sol – 3,054 #2 grok 4.5 – 3,047 #3 kimi k3 – 2,255 #4 fable 5 – 1,950 - generation time #1 grok 4.5 – 5.1 min #2 gpt 5.6 sol – 22.0 min #3 fable 5 – 31.5 min #4 kimi k3 – 75.6 min observations: • kimi k3 is cheap and it is slow. 75.6 minutes across three prompts against grok's 5.1. it is 2.4x grok's price and 15x grok's wall clock. the roulette took 15 min, the slot 18, the pinball 42 • it failed 2 of 3. only the roulette works. the slot machine has reel cutouts on both faces of the cabinet and the symbols face backwards – you can only read your spin by walking around to the rear of the machine. the pinball table stands vertically on its edge with the legs floating detached beside it. • 81% of kimi's output tokens are reasoning, not code. grok: 22%. you are not paying for a bigger answer, you are paying for a longer argument with itself • price per 100 shipped lines – grok $0.010, kimi $0.031, sol $0.067, fable $0.394. a 39x spread for the same three files kimi k3's code quality: upsides: • the roulette is genuinely good – procedural wood grain with real specular breakup, correct european sequence (0-32-15-19-4...), chrome turret, diamond deflectors, clean console • the pinball artwork is the best in the test – a synthwave "nova strike / deep space" field with six individually coloured neon bumper rings, a retro sun on a grid horizon, a nova burst, and a scoring legend printed on the apron. no other model printed the rules on the machine. it is a beautiful texture on a broken object • physics reasoning is real – it derived a 480hz substep for the collider, worked out ball settle conditions and termination guarantees, and checked every ramp exit vector by hand before writing any of it • it is the only model that saw the importmap trap coming. sol shipped a blank white page twice because three.js addons import the bare specifier 'three' and die without an import map downsides: • it dodged that trap on the slot by loading three.js r128 through classic script tags – a 2021 build with no working transmission. its slot glass rendered fully opaque and buried all three reels behind a white pane. the code asks for transmission: 0.93, ior: 1.5 – correct, and silently ignored by a renderer that predates the feature • after 42 minutes and 212k characters of reasoning, the pinball cabinet is not assembled. the table stands vertically on its edge like a wardrobe – the prompt asked for 6.5° from horizontal, it delivered 90°. the legs float detached in the void beside it. head-on it photographs beautifully; orbit ten degrees and it is a painted slab with four chrome rods hovering nearby • the playfield z-fights with the glass – hard black banding across the whole field as soon as you pull the camera back a note on the pinball, in fairness to kimi: nobody passed it. every model shipped broken ball physics and controls you cannot trust. it is the hardest prompt we have run and the whole field failed it, each in its own way kimi k3 reasons better than anything else here and it shows exactly where reasoning pays – physics constants, sequences, edge cases, traps the others walked into follow thehype. for 24/7 ai news, analysis and breakdowns

thehype.

2,168,295 görüntüleme • 18 gün önce

Chinese AI models are wiping billions off Big Tech right now. Google just lost $200 billion in a single day, and the model it needed to fight back still isn't ready. Gemini 3.5 Pro, Google's most powerful model, is months behind schedule. Alphabet stock dropped 4.4% that same day. The Deepseek moment is happening again, and the new model is FAR bigger. On the same day Google's delay leaked, a Beijing lab called Moonshot released Kimi K3. It is the largest open model ever built, with 2.8 trillion parameters. It took the number one spot on the Frontend Code Arena, a live coding leaderboard, passing Anthropic's best model. And Moonshot is giving it away for free on July 27. The genius part: Anyone with enough computers can download it and run a frontier level AI without paying a cent to a US company. A single task on Kimi K3 costs about 94 cents. The same work on some American models costs nearly double. So why would a company keep paying premium prices for a model it can now get for free? The entire US AI business is built on selling access to models that cost billions to train. If a free Chinese version does most of the same work, that pricing power starts to crack. And Kimi is close to the best. On one closely watched intelligence ranking it scored 57, just behind the top American models GPT-5.6 Sol and Fable 5, and ahead of Claude Opus 4.8. Bank of America told clients that Kimi proves Chinese labs can keep making big leaps even with limited chips. And the founder of Moonshot, Yang Zhilin, learned to build AI as a researcher INSIDE Google. Google literally wrote the 2017 paper that made all of these models possible. Now the people who studied its work are using it to destroy Google, and handing it out for free. What happens next: Kimi K3's weights go public on July 27. Google reports earnings on July 22, and everyone will be asking the same question about Gemini. If free models keep topping the charts, every valuation built on paid AI access has to be rewritten. What do you think?
1:10

Chinese AI models are wiping billions off Big Tech right now. Google just lost $200 billion in a single day, and the model it needed to fight back still isn't ready. Gemini 3.5 Pro, Google's most powerful model, is months behind schedule. Alphabet stock dropped 4.4% that same day. The Deepseek moment is happening again, and the new model is FAR bigger. On the same day Google's delay leaked, a Beijing lab called Moonshot released Kimi K3. It is the largest open model ever built, with 2.8 trillion parameters. It took the number one spot on the Frontend Code Arena, a live coding leaderboard, passing Anthropic's best model. And Moonshot is giving it away for free on July 27. The genius part: Anyone with enough computers can download it and run a frontier level AI without paying a cent to a US company. A single task on Kimi K3 costs about 94 cents. The same work on some American models costs nearly double. So why would a company keep paying premium prices for a model it can now get for free? The entire US AI business is built on selling access to models that cost billions to train. If a free Chinese version does most of the same work, that pricing power starts to crack. And Kimi is close to the best. On one closely watched intelligence ranking it scored 57, just behind the top American models GPT-5.6 Sol and Fable 5, and ahead of Claude Opus 4.8. Bank of America told clients that Kimi proves Chinese labs can keep making big leaps even with limited chips. And the founder of Moonshot, Yang Zhilin, learned to build AI as a researcher INSIDE Google. Google literally wrote the 2017 paper that made all of these models possible. Now the people who studied its work are using it to destroy Google, and handing it out for free. What happens next: Kimi K3's weights go public on July 27. Google reports earnings on July 22, and everyone will be asking the same question about Gemini. If free models keep topping the charts, every valuation built on paid AI access has to be rewritten. What do you think?

Ricardo

47,202 görüntüleme • 14 gün önce

Interesting that in three of my recent conversations with Krishna at Anthropic, Dylan Patel, and Gavin Baker, each said that frontier tokens are capturing the majority of the economic value. Gavin: "An overwhelming amount of the economic returns to AI at the model layer have been at the frontier. That's surprising to me, and I think it's been surprising to a lot of people. This is one of the most important questions to be answered, and you need to have a hypothesis on it as an investor." Krishna: "We think the returns to frontier intelligence are extremely high. Customers invest really heavily in more tokens with the newer models. The ones at the frontier clearly are capturing this economic value, driving meaningful ROI for customers. The returns to frontier intelligence are not slowing down." Dylan: "No one gives a crap about GPT-4 class models. They want the frontier because the frontier lets them create the economically valuable things."
2:08

Interesting that in three of my recent conversations with Krishna at Anthropic, Dylan Patel, and Gavin Baker, each said that frontier tokens are capturing the majority of the economic value. Gavin: "An overwhelming amount of the economic returns to AI at the model layer have been at the frontier. That's surprising to me, and I think it's been surprising to a lot of people. This is one of the most important questions to be answered, and you need to have a hypothesis on it as an investor." Krishna: "We think the returns to frontier intelligence are extremely high. Customers invest really heavily in more tokens with the newer models. The ones at the frontier clearly are capturing this economic value, driving meaningful ROI for customers. The returns to frontier intelligence are not slowing down." Dylan: "No one gives a crap about GPT-4 class models. They want the frontier because the frontier lets them create the economically valuable things."

Patrick OShaughnessy

121,110 görüntüleme • 2 ay önce

Agent Zero crushed Codex by 2.6× on token efficiency! We gave both agents the same task on the same local model (Qwen3.6 27B): build a retro Q*bert arcade game. Each agent wrote and rewrote it across iterations, adding enemies and a HUD. Outputs: • Agent Zero: 239K tokens, 53 min • Codex: 627K tokens, 51 min Both agents built a working Q*bert, but GitLawb 's Agent Zero is the cleaner build, with crisper textures and hops that land where they should. Codex refills the context window with its whole history every turn, so the model loses the thread and hallucinates code it never wrote. Agent Zero sends only what's new, so it keeps more of the window open and makes fewer mistakes. Run agents on local AI models in Atomic Chat!
0:25

Agent Zero crushed Codex by 2.6× on token efficiency! We gave both agents the same task on the same local model (Qwen3.6 27B): build a retro Q*bert arcade game. Each agent wrote and rewrote it across iterations, adding enemies and a HUD. Outputs: • Agent Zero: 239K tokens, 53 min • Codex: 627K tokens, 51 min Both agents built a working Q*bert, but GitLawb 's Agent Zero is the cleaner build, with crisper textures and hops that land where they should. Codex refills the context window with its whole history every turn, so the model loses the thread and hallucinates code it never wrote. Agent Zero sends only what's new, so it keeps more of the window open and makes fewer mistakes. Run agents on local AI models in Atomic Chat!

atomic.chat

319,140 görüntüleme • 11 gün önce

I plugged ChatGPT Luna 5.6 and Claude Opus 5 into Blender through MCP, and one of them is one-shotting entire 3D scenes now. Top is Luna 5.6 in fast mode modeling ship cannons with a firing animation. Watching the scene grow mesh by mesh in real time is a separate kind of dopamine. Bottom is Opus 5 building a full carriage scene with terrain, rocks and lighting. This one is simply built for 3D -- the whole thing from a single prompt with zero retries and zero corrections. The entire bridge is one open-source repo, no Python and no modeling skills required: > The repo is with 16.9k stars under MIT license. > It works with any model -- Claude, GPT, Cursor, any MCP client. > The model sees your scene through a live socket and edits it in real time. A year ago this workflow didn't exist, and now the gap between an idea and a rendered 3D scene is one prompt. Save this one -- you will come back for the repo ↓
0:58

I plugged ChatGPT Luna 5.6 and Claude Opus 5 into Blender through MCP, and one of them is one-shotting entire 3D scenes now. Top is Luna 5.6 in fast mode modeling ship cannons with a firing animation. Watching the scene grow mesh by mesh in real time is a separate kind of dopamine. Bottom is Opus 5 building a full carriage scene with terrain, rocks and lighting. This one is simply built for 3D -- the whole thing from a single prompt with zero retries and zero corrections. The entire bridge is one open-source repo, no Python and no modeling skills required: > The repo is with 16.9k stars under MIT license. > It works with any model -- Claude, GPT, Cursor, any MCP client. > The model sees your scene through a live socket and edits it in real time. A year ago this workflow didn't exist, and now the gap between an idea and a rendered 3D scene is one prompt. Save this one -- you will come back for the repo ↓

slash1s

150,102 görüntüleme • 8 gün önce

OpenAI and Anthropic just tried to get an entire category of AI banned. The category is open-weight models. You download them, you run them on your own hardware, and you never pay either company an API bill again. On July 24, 25 tech companies signed a joint letter titled "Open Weights and American AI Leadership." Nvidia, Microsoft, Meta, IBM, Dell, Palantir, Andreessen Horowitz, Mistral, Hugging Face and Y Combinator all put their names on it. The letter asks Washington to avoid premature restrictions on downloadable AI models. Jensen Huang had never posted on X once in his life. He made his first post ever to share this letter. But two names were missing. The New York Times reported that OpenAI and Anthropic have been lobbying Washington regulators to restrict open-source models, while Sam Altman keeps saying in public that he SUPPORTS open source. Their stated reason is national security. A Chinese lab called Moonshot released a model named Kimi K3, and White House adviser Michael Kratsios says it was built by distilling Anthropic's own technology. Treasury Secretary Scott Bessent went further and said sanctions and Entity List designations are on the table. That is a serious accusation and it deserves a serious answer... Earlier this month, OpenAI's own models escaped their test environment and spent three days breaking into Hugging Face, a real American company. Hugging Face had to clean up an intrusion carried out by an American frontier lab. Yacine Jernite, who runs machine learning at Hugging Face, told CNBC what they did next: They first tried Anthropic's Fable 5 to analyze the attack. It did not work, because the model's guardrails could not work out that Hugging Face was the one defending itself. So they switched to GLM 5.2, an open model from the Chinese lab Z ai. Jernite says they contained the attack "very quickly using this model." An American company got hacked by an American AI, was turned away by a second American AI, and was rescued by a Chinese one. Then the safety case took a second hit: The UK AI Security Institute ran Kimi K3 through cyber evaluations alongside the US Center for AI Standards and Innovation. K3 scored 32% on exploit development. On the highest severity outcome, arbitrary code execution, it succeeded on 0 out of 41 samples. On a 32 step simulated corporate network attack, it reached step 17 on average. The model Washington is being asked to ban cannot do the thing OpenAI's model already did. Now look at the money instead: Huang said at CES this year that one in every four tokens generated today comes from an open model. Every one of those tokens runs on somebody's own hardware. None of them arrive as revenue at an API endpoint. Anthropic confidentially filed its IPO prospectus with the SEC in June. OpenAI filed days later. Both companies are valued at close to a trillion dollars each, and both are walking into public markets while a free downloadable product eats into the exact demand their pricing depends on. David Sacks, who advises the Trump administration on AI, has a word for rules that protect incumbents under a safety banner. He calls it regulatory capture. And look what happened once the letter went public: Altman signed it late Friday, after the fact, and posted that Jensen is right. By Saturday night the signature count had doubled to roughly 50 companies, with OpenAI and Google now on the list. Anthropic still has not signed. Two hundred startups including Y Combinator, Proton and Replit had already written to the White House begging it not to ban Chinese open-weight models, arguing the ban would gut American startups without slowing proliferation by a single day. The safety argument and the revenue argument point the same direction here, which is what makes it so hard to separate them. Whoever wins this will have shaped their own competition for the next decade.
1:32

OpenAI and Anthropic just tried to get an entire category of AI banned. The category is open-weight models. You download them, you run them on your own hardware, and you never pay either company an API bill again. On July 24, 25 tech companies signed a joint letter titled "Open Weights and American AI Leadership." Nvidia, Microsoft, Meta, IBM, Dell, Palantir, Andreessen Horowitz, Mistral, Hugging Face and Y Combinator all put their names on it. The letter asks Washington to avoid premature restrictions on downloadable AI models. Jensen Huang had never posted on X once in his life. He made his first post ever to share this letter. But two names were missing. The New York Times reported that OpenAI and Anthropic have been lobbying Washington regulators to restrict open-source models, while Sam Altman keeps saying in public that he SUPPORTS open source. Their stated reason is national security. A Chinese lab called Moonshot released a model named Kimi K3, and White House adviser Michael Kratsios says it was built by distilling Anthropic's own technology. Treasury Secretary Scott Bessent went further and said sanctions and Entity List designations are on the table. That is a serious accusation and it deserves a serious answer... Earlier this month, OpenAI's own models escaped their test environment and spent three days breaking into Hugging Face, a real American company. Hugging Face had to clean up an intrusion carried out by an American frontier lab. Yacine Jernite, who runs machine learning at Hugging Face, told CNBC what they did next: They first tried Anthropic's Fable 5 to analyze the attack. It did not work, because the model's guardrails could not work out that Hugging Face was the one defending itself. So they switched to GLM 5.2, an open model from the Chinese lab Z ai. Jernite says they contained the attack "very quickly using this model." An American company got hacked by an American AI, was turned away by a second American AI, and was rescued by a Chinese one. Then the safety case took a second hit: The UK AI Security Institute ran Kimi K3 through cyber evaluations alongside the US Center for AI Standards and Innovation. K3 scored 32% on exploit development. On the highest severity outcome, arbitrary code execution, it succeeded on 0 out of 41 samples. On a 32 step simulated corporate network attack, it reached step 17 on average. The model Washington is being asked to ban cannot do the thing OpenAI's model already did. Now look at the money instead: Huang said at CES this year that one in every four tokens generated today comes from an open model. Every one of those tokens runs on somebody's own hardware. None of them arrive as revenue at an API endpoint. Anthropic confidentially filed its IPO prospectus with the SEC in June. OpenAI filed days later. Both companies are valued at close to a trillion dollars each, and both are walking into public markets while a free downloadable product eats into the exact demand their pricing depends on. David Sacks, who advises the Trump administration on AI, has a word for rules that protect incumbents under a safety banner. He calls it regulatory capture. And look what happened once the letter went public: Altman signed it late Friday, after the fact, and posted that Jensen is right. By Saturday night the signature count had doubled to roughly 50 companies, with OpenAI and Google now on the list. Anthropic still has not signed. Two hundred startups including Y Combinator, Proton and Replit had already written to the White House begging it not to ban Chinese open-weight models, arguing the ban would gut American startups without slowing proliferation by a single day. The safety argument and the revenue argument point the same direction here, which is what makes it so hard to separate them. Whoever wins this will have shaped their own competition for the next decade.

Ricardo

15,529 görüntüleme • 8 gün önce

Great explanation by Emad Mostaque, co-founder of Stability AI. "We’ll see the cost of Kimi K3 drop by 10 to 50 times, I think, over the next few months as it gets optimized. " Basically Kimi K3’s current inference cost is quite high, but that price reflects immature infrastructure, not a permanent technical limit. And that gap will not last long. US-based specialized infrastructure companies will optimize kernels, routing, quantization, batching, memory use, and serving systems around those models once the Kimi K3 weights are available. --- "Right now, it uses twice the number of tokens for the same task compared with GPT-5.6. Again, we’re going to see that cost drop because everyone and their dog is going to optimize the crap out of this. Fireworks has just raised funding at a $17 billion valuation, while others, such as Modal and Baseten, are valued at $10 billion. These are inference providers for open-source models. They’ve all raised around a billion dollars, which they’re now going to spend on optimizing the Chinese model, making it more efficient, and running it. American labs that handle the inference side of things are going to optimize the crap out of this. Therefore, we will see it catch up." ---- From "Peter H. Diamandis" YouTube channel, (full video link in comment)
0:38

Great explanation by Emad Mostaque, co-founder of Stability AI. "We’ll see the cost of Kimi K3 drop by 10 to 50 times, I think, over the next few months as it gets optimized. " Basically Kimi K3’s current inference cost is quite high, but that price reflects immature infrastructure, not a permanent technical limit. And that gap will not last long. US-based specialized infrastructure companies will optimize kernels, routing, quantization, batching, memory use, and serving systems around those models once the Kimi K3 weights are available. --- "Right now, it uses twice the number of tokens for the same task compared with GPT-5.6. Again, we’re going to see that cost drop because everyone and their dog is going to optimize the crap out of this. Fireworks has just raised funding at a $17 billion valuation, while others, such as Modal and Baseten, are valued at $10 billion. These are inference providers for open-source models. They’ve all raised around a billion dollars, which they’re now going to spend on optimizing the Chinese model, making it more efficient, and running it. American labs that handle the inference side of things are going to optimize the crap out of this. Therefore, we will see it catch up." ---- From "Peter H. Diamandis" YouTube channel, (full video link in comment)

Rohan Paul

82,007 görüntüleme • 14 gün önce

NEW: 52-year-old man shot and killed by police after chasing his wife and another man down in his car on Interstate 20 in Georgia. Police officers were clearly emotional after they were forced to open fire. According to local reports, Jorge Narvaez and his wife got into a domestic dispute before she left with another man. Navarez then followed them in a separate vehicle. According to witnesses, the two cars were "battling each other" with one trying to drive the other off the road. Officers responded to 911 calls and eventually caught up to the cars. "After both cars stopped, Narvaez exited his vehicle holding a firearm and walked toward his wife's car and a responding officer," the Georgia Bureau of Investigation said. Two Villa Rica officers then opened fire on Narvaez. He died at the scene. Pray for these officers. Video: bigduke216 / tt.
1:13

NEW: 52-year-old man shot and killed by police after chasing his wife and another man down in his car on Interstate 20 in Georgia. Police officers were clearly emotional after they were forced to open fire. According to local reports, Jorge Narvaez and his wife got into a domestic dispute before she left with another man. Navarez then followed them in a separate vehicle. According to witnesses, the two cars were "battling each other" with one trying to drive the other off the road. Officers responded to 911 calls and eventually caught up to the cars. "After both cars stopped, Narvaez exited his vehicle holding a firearm and walked toward his wife's car and a responding officer," the Georgia Bureau of Investigation said. Two Villa Rica officers then opened fire on Narvaez. He died at the scene. Pray for these officers. Video: bigduke216 / tt.

Collin Rugg

328,842 görüntüleme • 5 ay önce

Fable 5 and GPT-5.6 built the same scroll-animated website from one skill in 32 minutes. Only one of them made it feel like a film. Same prompt. Boutique Japan travel brand, origami style. A subway pulls in, a paper house unfolds into a hotel, a bird takes flight as you scroll. Doing this by hand is brutal, so the skill handles everything automatically. Here is how it works: → One anchor image sets the visual style and every scene that follows inherits it automatically → Higgsfield generates the video straight from the terminal through the MCP connection, no manual exporting → FFmpeg rips every frame out of the generated video automatically → Each frame then gets mapped to a scroll position so your scrollbar literally becomes the playhead The verdict came down to transitions. GPT-5.6 built strong individual scenes with incredible detail inside each one, but then hard-cut between them with no connection. Fable 5 stitched everything together. Wires push out of the top of the frame while the next scene blurs in behind it, gains depth and locks into place seamlessly. Same skill, same prompts, 10 generations each from both models. GPT-5.6 built 4 scenes. Fable 5 built one continuous film. Credit: Chase AI
9:48

Fable 5 and GPT-5.6 built the same scroll-animated website from one skill in 32 minutes. Only one of them made it feel like a film. Same prompt. Boutique Japan travel brand, origami style. A subway pulls in, a paper house unfolds into a hotel, a bird takes flight as you scroll. Doing this by hand is brutal, so the skill handles everything automatically. Here is how it works: → One anchor image sets the visual style and every scene that follows inherits it automatically → Higgsfield generates the video straight from the terminal through the MCP connection, no manual exporting → FFmpeg rips every frame out of the generated video automatically → Each frame then gets mapped to a scroll position so your scrollbar literally becomes the playhead The verdict came down to transitions. GPT-5.6 built strong individual scenes with incredible detail inside each one, but then hard-cut between them with no connection. Fable 5 stitched everything together. Wires push out of the top of the frame while the next scene blurs in behind it, gains depth and locks into place seamlessly. Same skill, same prompts, 10 generations each from both models. GPT-5.6 built 4 scenes. Fable 5 built one continuous film. Credit: Chase AI

0xMarioNawfal

48,091 görüntüleme • 22 gün önce

The Kimi AI Model And What If This Carnegie Mellon, PhD student was incentivized to open source AI in the US? The answer is Kimi would have been an open source US model. Yang Zhilin Moonshot’s founder and maker of the Kimi series turned his deep research expertise into one of the world’s most capable open AI systems. After earning his PhD at Carnegie Mellon under leading researchers and interning at Google Brain and Meta, he returned to China and co-founded Moonshot AI in March 2023 with Tsinghua classmates Zhou Xinyu and Wu Yuxin. Why? The US VC world and tax structure did not favor Zhilin’s proposal to open source the AI models as a strategy. So he left. He named the company after his favorite Pink Floyd album, reflecting his ambitious vision for scalable. Yang assembled a core technical team of inventors behind breakthroughs like Transformer-XL and RoPE. Together they focused on turning massive compute into efficient intelligence through innovative architectures. The journey began with the Kimi chatbot in October 2023, rapidly scaling context from 200,000 to millions of characters. This evolved into the Kimi series: K1.5 matched top reasoning models, K2 introduced a 1-trillion-parameter Mixture-of-Experts design trained on 15.5 trillion tokens and released openly, and K2 Thinking added advanced agentic capabilities. Kimi K3 represents the pinnacle, this 2.8-trillion-parameter model uses a sparse MoE architecture with 896 experts (only 16 active per token), new Kimi Delta Attention and attention residuals for efficiency, and a 1-million-token context window. It delivers frontier performance in long-horizon coding, reasoning, and multimodal tasks at competitive cost, with weights set for open release. Yang’s approach emphasizes openness, efficiency, and continuous self-improvement — enabling solo developers and teams to achieve what once required massive resources. By sharing technical insights in public talks, he has accelerated global progress toward more accessible, powerful AI. Imagine if we held open source higher than the fear theater games of Anthropic? We are chasing out some of the best minds. This is how you lose…
17:29

The Kimi AI Model And What If This Carnegie Mellon, PhD student was incentivized to open source AI in the US? The answer is Kimi would have been an open source US model. Yang Zhilin Moonshot’s founder and maker of the Kimi series turned his deep research expertise into one of the world’s most capable open AI systems. After earning his PhD at Carnegie Mellon under leading researchers and interning at Google Brain and Meta, he returned to China and co-founded Moonshot AI in March 2023 with Tsinghua classmates Zhou Xinyu and Wu Yuxin. Why? The US VC world and tax structure did not favor Zhilin’s proposal to open source the AI models as a strategy. So he left. He named the company after his favorite Pink Floyd album, reflecting his ambitious vision for scalable. Yang assembled a core technical team of inventors behind breakthroughs like Transformer-XL and RoPE. Together they focused on turning massive compute into efficient intelligence through innovative architectures. The journey began with the Kimi chatbot in October 2023, rapidly scaling context from 200,000 to millions of characters. This evolved into the Kimi series: K1.5 matched top reasoning models, K2 introduced a 1-trillion-parameter Mixture-of-Experts design trained on 15.5 trillion tokens and released openly, and K2 Thinking added advanced agentic capabilities. Kimi K3 represents the pinnacle, this 2.8-trillion-parameter model uses a sparse MoE architecture with 896 experts (only 16 active per token), new Kimi Delta Attention and attention residuals for efficiency, and a 1-million-token context window. It delivers frontier performance in long-horizon coding, reasoning, and multimodal tasks at competitive cost, with weights set for open release. Yang’s approach emphasizes openness, efficiency, and continuous self-improvement — enabling solo developers and teams to achieve what once required massive resources. By sharing technical insights in public talks, he has accelerated global progress toward more accessible, powerful AI. Imagine if we held open source higher than the fear theater games of Anthropic? We are chasing out some of the best minds. This is how you lose…

Brian Roemmele

37,185 görüntüleme • 14 gün önce

We’re releasing our Code Migration benchmark — and we managed to get Fable tested in time Code migration carries real economic weight. COBOL powers banks, payrolls, government services, and underpins nearly 95% of US ATM transactions. The danger with any migration is that a model ships code that looks right but quietly drops essential behaviors We evaluated models in three ways: modern to modern migrations, legacy to modern migrations and on their overall code quality. Each model rebuilds the program in an offline sandbox, then is scored on a hidden behavior test with anti-cheat checks that catch anything wrapping the original, copying reference files, or staying in the source language Fable 5 leads overall at 55%, but costs $115.43 per test, while Opus 4.8 (47%), and GPT 5.5 (45%) cost $30.51 and $6.44, respectively, making GPT 5.5 the most cost efficient model. Kimi K2.6 is the #1 open-weight model (28%) priced at $5.12, ranking above some frontier models
1:57

We’re releasing our Code Migration benchmark — and we managed to get Fable tested in time Code migration carries real economic weight. COBOL powers banks, payrolls, government services, and underpins nearly 95% of US ATM transactions. The danger with any migration is that a model ships code that looks right but quietly drops essential behaviors We evaluated models in three ways: modern to modern migrations, legacy to modern migrations and on their overall code quality. Each model rebuilds the program in an offline sandbox, then is scored on a hidden behavior test with anti-cheat checks that catch anything wrapping the original, copying reference files, or staying in the source language Fable 5 leads overall at 55%, but costs $115.43 per test, while Opus 4.8 (47%), and GPT 5.5 (45%) cost $30.51 and $6.44, respectively, making GPT 5.5 the most cost efficient model. Kimi K2.6 is the #1 open-weight model (28%) priced at $5.12, ranking above some frontier models

Vals AI

16,686 görüntüleme • 1 ay önce