Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Tencent just released Hy4 Preview: a 770B-parameter open-source model with 49B active parameters and a 1M-token context window. The most interesting part is its agentic research capability. Tencent says Hy4 coordinated several Codex sessions in parallel, evaluated their results and adjusted the research direction, outperforming Codex working alone across... show more

Chubby♨️

138,719 subscribers

49,575 görüntüleme • 1 ay önce •via X (Twitter)

Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🚨 Claude Code & Codex are EXPENSIVE !! So, I found a CHEAPER AI Agent called WorkBuddy I just tested a new AI model called Hy4 preview And its built for → Coding → Tool use → Deep research → Multi-step workflows And the setup is surprisingly simple. Here’s the tutorial 👇

🚨 Claude Code & Codex are EXPENSIVE !! So, I found a CHEAPER AI Agent called WorkBuddy I just tested a new AI model called Hy4 preview And its built for → Coding → Tool use → Deep research → Multi-step workflows And the setup is surprisingly simple. Here’s the tutorial 👇

AGAFE

79,029 görüntüleme • 1 ay önce

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓

leopardracer

56,865 görüntüleme • 4 ay önce

🔥 GLM-5.3-Flash Hits #1 on 🐮 GLM-5.3-Flash (Ox Alpha) is now the most-used and most popular model on with cumulative token throughput surpassing 2.41 trillion tokens. As the first native omni-modal model in the GLM-5 series, it packs 320B total parameters, with 18B active, and features a hybrid sparse and linear attention architecture with a 1M-token context window. The result: lightning-fast responses, powerful reasoning, and outstanding cost efficiency. 🎁 Still 100% FREE on From high-frequency API calls and coding to complex Agents and long-document processing, jump in and experience the #1 model on for yourself! 👉 Try it free now:

🔥 GLM-5.3-Flash Hits #1 on 🐮 GLM-5.3-Flash (Ox Alpha) is now the most-used and most popular model on with cumulative token throughput surpassing 2.41 trillion tokens. As the first native omni-modal model in the GLM-5 series, it packs 320B total parameters, with 18B active, and features a hybrid sparse and linear attention architecture with a 1M-token context window. The result: lightning-fast responses, powerful reasoning, and outstanding cost efficiency. 🎁 Still 100% FREE on From high-frequency API calls and coding to complex Agents and long-document processing, jump in and experience the #1 model on for yourself! 👉 Try it free now:

B.AI

222,739 görüntüleme • 1 ay önce

I’m joining OpenAI Codex to work on the future of agentic development! At Cursor, I got to see the shift from autocomplete to agents. The next step isn’t a better IDE. It’s an Agent Development Environment (ADE): systems and tools for orchestrating agents, reasoning over their outputs, and making them autonomous enough to reliably complete ambitious work. After chatting with Alexander Embiricos and Tibo, it was clear that Codex is the best place to realize this vision. The team has consistently shipped SOTA models for agentic coding (check out gpt-5.3-codex) and I’m pumped for the future that the new Codex App points to. What I’m most excited about is the broader mission: accelerating the knowledge work economy. All agents are coding agents, and we’re already seeing Codex used across every job function within organizations. I’m extremely grateful for my time at Cursor, working with the incredible team, and I’m proud of what we built together. I’m excited to take an even bigger swing with Codex. If you’re curious to get a glimpse of where we are headed, download the Codex App! If you want to work on this mission, please apply or reach out - we are hiring across all functions! You can just build things.

I’m joining OpenAI Codex to work on the future of agentic development! At Cursor, I got to see the shift from autocomplete to agents. The next step isn’t a better IDE. It’s an Agent Development Environment (ADE): systems and tools for orchestrating agents, reasoning over their outputs, and making them autonomous enough to reliably complete ambitious work. After chatting with Alexander Embiricos and Tibo, it was clear that Codex is the best place to realize this vision. The team has consistently shipped SOTA models for agentic coding (check out gpt-5.3-codex) and I’m pumped for the future that the new Codex App points to. What I’m most excited about is the broader mission: accelerating the knowledge work economy. All agents are coding agents, and we’re already seeing Codex used across every job function within organizations. I’m extremely grateful for my time at Cursor, working with the incredible team, and I’m proud of what we built together. I’m excited to take an even bigger swing with Codex. If you’re curious to get a glimpse of where we are headed, download the Codex App! If you want to work on this mission, please apply or reach out - we are hiring across all functions! You can just build things.

Rohan Varma

760,250 görüntüleme • 8 ay önce

> be Muse Spark Open > Meta's Llama 4 disappoints everyone > Meta goes closed with Muse Spark > Zuck writes a $100-200 billion check > Muse Wonder ships on Monday > 3 days later Meta drops you with open weights > 816 billion parameters > only 42 billion active at a time > 1 million token context > built for coding and long agent tasks > runs on two Mac Studios on a desk > Meta calls you the most capable US open-weight model ever > every Chinese lab reading the model card America is back in the open-weight game.

> be Muse Spark Open > Meta's Llama 4 disappoints everyone > Meta goes closed with Muse Spark > Zuck writes a $100-200 billion check > Muse Wonder ships on Monday > 3 days later Meta drops you with open weights > 816 billion parameters > only 42 billion active at a time > 1 million token context > built for coding and long agent tasks > runs on two Mac Studios on a desk > Meta calls you the most capable US open-weight model ever > every Chinese lab reading the model card America is back in the open-weight game.

Kirill

129,325 görüntüleme • 7 gün önce

Another big drop from Hunyuan3D by Tencent. Hunyuan3D-Buffalo 1.0 is not just another text-to-3D model. The more interesting part is its approach to 3D understanding and editing. It can understand separate parts of a complete asset, extract them, remove or replace them with prompts, and edit only the selected region while keeping the rest of the geometry unchanged. That feels like a much more useful direction for 3D AI in general: not just generating a mesh once, but actually understanding its structure and letting you continue working with it. The model combines Qwen-VL, TRELLIS and Hunyuan3D, and was trained on an impressive dataset of 87 million 3D samples. Source:

Another big drop from Hunyuan3D by Tencent. Hunyuan3D-Buffalo 1.0 is not just another text-to-3D model. The more interesting part is its approach to 3D understanding and editing. It can understand separate parts of a complete asset, extract them, remove or replace them with prompts, and edit only the selected region while keeping the rest of the geometry unchanged. That feels like a much more useful direction for 3D AI in general: not just generating a mesh once, but actually understanding its structure and letting you continue working with it. The model combines Qwen-VL, TRELLIS and Hunyuan3D, and was trained on an impressive dataset of 87 million 3D samples. Source:

Stefan 3D AI

36,487 görüntüleme • 2 ay önce

Science, on TRAC(k). Pandemic response depends on data held in many places at once: public health institutes, hospitals, ministries and research centers, each with its own systems and rules. AURORAI is a €6.9 million Horizon Europe project, running from September 2026 to 2030, with 12 organizations in nine European countries and a partner in Australia. It is building Europe's AI toolkit for pandemic preparedness, including for pathogens not yet identified. Its data backbone is the OriginTrail Decentralized Knowledge Graph (DKG). How that works without a central data lake: → Partners publish health and research data as Knowledge Assets, each with a Uniform Asset Locator (UAL) that proves who published it and that it hasn't been tampered with → The data stays where it is; Context Graphs control which regions see which metadata → That verified layer is the first input to AURORAI's decision support system, alongside pathogen models and population and mobility simulations When a model recommends an intervention, the inputs behind it can be traced to their source. In public health, that is what makes a recommendation defensible. Trust the source. More:

Science, on TRAC(k). Pandemic response depends on data held in many places at once: public health institutes, hospitals, ministries and research centers, each with its own systems and rules. AURORAI is a €6.9 million Horizon Europe project, running from September 2026 to 2030, with 12 organizations in nine European countries and a partner in Australia. It is building Europe's AI toolkit for pandemic preparedness, including for pathogens not yet identified. Its data backbone is the OriginTrail Decentralized Knowledge Graph (DKG). How that works without a central data lake: → Partners publish health and research data as Knowledge Assets, each with a Uniform Asset Locator (UAL) that proves who published it and that it hasn't been tampered with → The data stays where it is; Context Graphs control which regions see which metadata → That verified layer is the first input to AURORAI's decision support system, alongside pathogen models and population and mobility simulations When a model recommends an intervention, the inputs behind it can be traced to their source. In public health, that is what makes a recommendation defensible. Trust the source. More:

OriginTrail

159,381 görüntüleme • 13 gün önce

ANNOUNCING ZERO-HUMAN LABS! Ever since I got to see Bell Laboratories in its full glory in New Jersey in the 1970s, I had a relentless urge to start a Lab like it. The best I could do justice to it is my garage lab. No modern company could adopt the “research anything geniuses and we will pay you” model Bell Labs had. I tried they called me a fool. Well with the rise of the Zero-Human Company, an experiment that is aimed to make products and profits, we now have 45 paid JouleWork earning employees based on OpenClaw and other self made “bot” cron-like applications. Today I say 3 employees bound together in a side project that is pure research, somewhat based on notes from a bankrupt company. I was absolutely floored (I needed it after my account was stolen as well as funds). I say the beginnings of a pure research Lab right before my eyes. Thusly I have moved these employees over to a new home (server) with Mr. Grok as the director of the Labs. Here is the mission: To have 100 independent researchers, on a new non-corporate incentive plan, with still JouleWork as a leaderboard for progress. They are directed to follow any path of research they find interesting and can collaborate with any other OpenClaw system. They have already established MoltBook accounts and have made alliances with over 49 OpenClaw free agents to collaborate. It is my mission to be chief advisor for Zero-Human Labs and to open source all discoveries when complete and confirmed by 16 other research AI systems. I can say the pace is robust and I absolutely know we will have great results. Just about all of the hardware and software is custom and at some point it will be open sourced. We are witnessing the very first AI only Bell Labs-like pure research Lab in existence and I am honored to be the first to show it to you. Thank you!

ANNOUNCING ZERO-HUMAN LABS! Ever since I got to see Bell Laboratories in its full glory in New Jersey in the 1970s, I had a relentless urge to start a Lab like it. The best I could do justice to it is my garage lab. No modern company could adopt the “research anything geniuses and we will pay you” model Bell Labs had. I tried they called me a fool. Well with the rise of the Zero-Human Company, an experiment that is aimed to make products and profits, we now have 45 paid JouleWork earning employees based on OpenClaw and other self made “bot” cron-like applications. Today I say 3 employees bound together in a side project that is pure research, somewhat based on notes from a bankrupt company. I was absolutely floored (I needed it after my account was stolen as well as funds). I say the beginnings of a pure research Lab right before my eyes. Thusly I have moved these employees over to a new home (server) with Mr. Grok as the director of the Labs. Here is the mission: To have 100 independent researchers, on a new non-corporate incentive plan, with still JouleWork as a leaderboard for progress. They are directed to follow any path of research they find interesting and can collaborate with any other OpenClaw system. They have already established MoltBook accounts and have made alliances with over 49 OpenClaw free agents to collaborate. It is my mission to be chief advisor for Zero-Human Labs and to open source all discoveries when complete and confirmed by 16 other research AI systems. I can say the pace is robust and I absolutely know we will have great results. Just about all of the hardware and software is custom and at some point it will be open sourced. We are witnessing the very first AI only Bell Labs-like pure research Lab in existence and I am honored to be the first to show it to you. Thank you!

Brian Roemmele

71,530 görüntüleme • 8 ay önce

I spend my days explaining to teams why a 770-billion-parameter open-weight model will never fit into their infrastructure. This week, I asked it to code a complete mobile game from a single prompt. The concept is one everyone has probably played before. A hole moving through an open-plan office, viewed from above, swallowing everything in its path. You start tiny, only able to swallow pens and cups. You grow, moving on to keyboards and plants, then chairs and printers, then desks and vending machines. Eventually, you swallow the entire meeting room. 60 seconds on the clock. One HTML file, zero external libraries, zero errors on launch. The video shows the generation and then the actual gameplay. What broke is more instructive than what worked. The structure came out right on the first try: fixed-timestep loop, spatial grid for collisions, tier system, spring camera. The balancing and rendering, not so much. The first version scored 70 points in 13 seconds with a tier threshold at 500, and drew colorful circles and triangles instead of furniture. I had to give it numbers and exact recipes. Speed: 640 pixels per second. Radii: 30, 58, 96, 150, 225. Tier thresholds: 150, 550, 1500, 3500. And for every object, a pixel-perfect drawing recipe. Once I gave it that, it followed the instructions exactly. A model that doesn't execute its own code won't tune itself. But it will execute, down to the exact numbers, what you tell it to build. The model is Hy4 preview, released by Tencent Hunyuan on August 28. 770 billion parameters in total, but 49 billion active per token. And that second number is what determines your serving bill. Native 1M context. Apache 2.0 license. vLLM and SGLang supported from day one, with an official FP8 checkpoint. Text-only preview. The part that matters for deployment is the compression. Tencent describes it as seven times smaller with almost no loss. GGUF builds use mixed per-layer quantization, where calibration data determines the bit width layer by layer. Some layers go as low as 1.31 bits, while others go up to 2.06 bits, averaging 2.38 bits per weight. The model drops from 1.5 TB in BF16 to 213.66 GiB while, according to their measurements, staying in the same performance range on real-world tasks. On this build, they report 204 tokens/s in prefill and 20 tokens/s in decoding, measured on an 8-GPU node. Their numbers, not mine. Their blind evaluation scores 2.99 out of 4 across 203 engineering tasks rated by 163 experts. Ahead of Kimi K3 at 2.94 and GLM-5.3 at 2.92. Their numbers too. My run went through the official hosted studio, not a local build, so I’m not claiming to have benchmarked the compressed GGUF myself. Two honest caveats. None of these builds run on standard llama.cpp. The hyv4 architecture isn't upstream yet, so patches are required. And 214 GiB of resident weights is still a server, not your laptop. This is a preview, and Tencent explicitly asks users to break it and report what fails. So here's my contribution.

I spend my days explaining to teams why a 770-billion-parameter open-weight model will never fit into their infrastructure. This week, I asked it to code a complete mobile game from a single prompt. The concept is one everyone has probably played before. A hole moving through an open-plan office, viewed from above, swallowing everything in its path. You start tiny, only able to swallow pens and cups. You grow, moving on to keyboards and plants, then chairs and printers, then desks and vending machines. Eventually, you swallow the entire meeting room. 60 seconds on the clock. One HTML file, zero external libraries, zero errors on launch. The video shows the generation and then the actual gameplay. What broke is more instructive than what worked. The structure came out right on the first try: fixed-timestep loop, spatial grid for collisions, tier system, spring camera. The balancing and rendering, not so much. The first version scored 70 points in 13 seconds with a tier threshold at 500, and drew colorful circles and triangles instead of furniture. I had to give it numbers and exact recipes. Speed: 640 pixels per second. Radii: 30, 58, 96, 150, 225. Tier thresholds: 150, 550, 1500, 3500. And for every object, a pixel-perfect drawing recipe. Once I gave it that, it followed the instructions exactly. A model that doesn't execute its own code won't tune itself. But it will execute, down to the exact numbers, what you tell it to build. The model is Hy4 preview, released by Tencent Hunyuan on August 28. 770 billion parameters in total, but 49 billion active per token. And that second number is what determines your serving bill. Native 1M context. Apache 2.0 license. vLLM and SGLang supported from day one, with an official FP8 checkpoint. Text-only preview. The part that matters for deployment is the compression. Tencent describes it as seven times smaller with almost no loss. GGUF builds use mixed per-layer quantization, where calibration data determines the bit width layer by layer. Some layers go as low as 1.31 bits, while others go up to 2.06 bits, averaging 2.38 bits per weight. The model drops from 1.5 TB in BF16 to 213.66 GiB while, according to their measurements, staying in the same performance range on real-world tasks. On this build, they report 204 tokens/s in prefill and 20 tokens/s in decoding, measured on an 8-GPU node. Their numbers, not mine. Their blind evaluation scores 2.99 out of 4 across 203 engineering tasks rated by 163 experts. Ahead of Kimi K3 at 2.94 and GLM-5.3 at 2.92. Their numbers too. My run went through the official hosted studio, not a local build, so I’m not claiming to have benchmarked the compressed GGUF myself. Two honest caveats. None of these builds run on standard llama.cpp. The hyv4 architecture isn't upstream yet, so patches are required. And 214 GiB of resident weights is still a server, not your laptop. This is a preview, and Tencent explicitly asks users to break it and report what fails. So here's my contribution.

Alexa Benchmark

16,315 görüntüleme • 1 ay önce

BREAKING: Anthropic just dropped Opus 4.8—and it is a MONSTER We've been testing for about a week Every 📧 and our verdict is they could've just called it Opus 5, it's that good. Here's our vibe check: - Beats GPT-5.5 on Senior Engineer bench. On our toughest benchmark Opus 4.8 scores a 63—a hair higher than GPT-5.5's score of 62, and a full 30 points higher than Opus 4.7. It tackled a ground-up rewrite of a production codebase, and actually built something that works. HOWEVER: Coding performance varied a lot at different reasoning levels. We recommend using it on xhigh for best results. - Incredibly good writer. Opus 4.8 scored a 79.6 on our writing benchmark—measuring models on real-world writing tasks we do all of the time like essay writing, promo email writing, and more. It beats GPT-5.5 by 6 points. It produces well-written prose with fewer "AI-isms". It's also very good at writing in your voice given the right context. HOWEVER: Writing performance also varied with reasoning levels. Medium reasoning had higher incidence of AI-isms—we found best results with high. - Beast at knowledge work. Opus 4.8 is very good at general knowledge work tasks like report creation, research and more. It produced the best PowerPoint one-shot we've ever seen on our deck generation benchmark. - Emotionally intelligent, willing to question the frame. I've also found it to be quite good at talking through psychological or interpersonal issues. It has a high EQ, and it's also good at not glazing and helping to expand your perspective. Its thought process feels extremely rich and dynamic. THE BAD: These days a model is only as good as its harness, and Codex is still a far superior harness to the Claude Desktop app. This has kept me using Codex + GPT-5.5 as my daily driver, but I am flipping back and forth a lot more between Codex and Claude. Anthropic is back baby! Read the rest on Every 📧:

BREAKING: Anthropic just dropped Opus 4.8—and it is a MONSTER We've been testing for about a week Every 📧 and our verdict is they could've just called it Opus 5, it's that good. Here's our vibe check: - Beats GPT-5.5 on Senior Engineer bench. On our toughest benchmark Opus 4.8 scores a 63—a hair higher than GPT-5.5's score of 62, and a full 30 points higher than Opus 4.7. It tackled a ground-up rewrite of a production codebase, and actually built something that works. HOWEVER: Coding performance varied a lot at different reasoning levels. We recommend using it on xhigh for best results. - Incredibly good writer. Opus 4.8 scored a 79.6 on our writing benchmark—measuring models on real-world writing tasks we do all of the time like essay writing, promo email writing, and more. It beats GPT-5.5 by 6 points. It produces well-written prose with fewer "AI-isms". It's also very good at writing in your voice given the right context. HOWEVER: Writing performance also varied with reasoning levels. Medium reasoning had higher incidence of AI-isms—we found best results with high. - Beast at knowledge work. Opus 4.8 is very good at general knowledge work tasks like report creation, research and more. It produced the best PowerPoint one-shot we've ever seen on our deck generation benchmark. - Emotionally intelligent, willing to question the frame. I've also found it to be quite good at talking through psychological or interpersonal issues. It has a high EQ, and it's also good at not glazing and helping to expand your perspective. Its thought process feels extremely rich and dynamic. THE BAD: These days a model is only as good as its harness, and Codex is still a far superior harness to the Claude Desktop app. This has kept me using Codex + GPT-5.5 as my daily driver, but I am flipping back and forth a lot more between Codex and Claude. Anthropic is back baby! Read the rest on Every 📧:

Dan Shipper

354,962 görüntüleme • 4 ay önce

I had the same thought so I've been playing with it in nanochat. E.g. here's 8 agents (4 claude, 4 codex), with 1 GPU each running nanochat experiments (trying to delete logit softcap without regression). The TLDR is that it doesn't work and it's a mess... but it's still very pretty to look at :) I tried a few setups: 8 independent solo researchers, 1 chief scientist giving work to 8 junior researchers, etc. Each research program is a git branch, each scientist forks it into a feature branch, git worktrees for isolation, simple files for comms, skip Docker/VMs for simplicity atm (I find that instructions are enough to prevent interference). Research org runs in tmux window grids of interactive sessions (like Teams) so that it's pretty to look at, see their individual work, and "take over" if needed, i.e. no -p. But ok the reason it doesn't work so far is that the agents' ideas are just pretty bad out of the box, even at highest intelligence. They don't think carefully though experiment design, they run a bit non-sensical variations, they don't create strong baselines and ablate things properly, they don't carefully control for runtime or flops. (just as an example, an agent yesterday "discovered" that increasing the hidden size of the network improves the validation loss, which is a totally spurious result given that a bigger network will have a lower validation loss in the infinite data regime, but then it also trains for a lot longer, it's not clear why I had to come in to point that out). They are very good at implementing any given well-scoped and described idea but they don't creatively generate them. But the goal is that you are now programming an organization (e.g. a "research org") and its individual agents, so the "source code" is the collection of prompts, skills, tools, etc. and processes that make it up. E.g. a daily standup in the morning is now part of the "org code". And optimizing nanochat pretraining is just one of the many tasks (almost like an eval). Then - given an arbitrary task, how quickly does your research org generate progress on it?

I had the same thought so I've been playing with it in nanochat. E.g. here's 8 agents (4 claude, 4 codex), with 1 GPU each running nanochat experiments (trying to delete logit softcap without regression). The TLDR is that it doesn't work and it's a mess... but it's still very pretty to look at :) I tried a few setups: 8 independent solo researchers, 1 chief scientist giving work to 8 junior researchers, etc. Each research program is a git branch, each scientist forks it into a feature branch, git worktrees for isolation, simple files for comms, skip Docker/VMs for simplicity atm (I find that instructions are enough to prevent interference). Research org runs in tmux window grids of interactive sessions (like Teams) so that it's pretty to look at, see their individual work, and "take over" if needed, i.e. no -p. But ok the reason it doesn't work so far is that the agents' ideas are just pretty bad out of the box, even at highest intelligence. They don't think carefully though experiment design, they run a bit non-sensical variations, they don't create strong baselines and ablate things properly, they don't carefully control for runtime or flops. (just as an example, an agent yesterday "discovered" that increasing the hidden size of the network improves the validation loss, which is a totally spurious result given that a bigger network will have a lower validation loss in the infinite data regime, but then it also trains for a lot longer, it's not clear why I had to come in to point that out). They are very good at implementing any given well-scoped and described idea but they don't creatively generate them. But the goal is that you are now programming an organization (e.g. a "research org") and its individual agents, so the "source code" is the collection of prompts, skills, tools, etc. and processes that make it up. E.g. a daily standup in the morning is now part of the "org code". And optimizing nanochat pretraining is just one of the many tasks (almost like an eval). Then - given an arbitrary task, how quickly does your research org generate progress on it?

Andrej Karpathy

1,660,352 görüntüleme • 7 ay önce

3 weeks since ml-intern launched and we just hit 1M messages exchanged. that's 3.3 agent-years of ML research in 21 days. 2 months worth of research every day. 17,383 training jobs total. talk about AI acceleration. here's some of what people built: Carlos Miguel Patiño replicated the full DeepSeek v4 architecture and pre+post trained a 100M MoE from scratch. → it landed a third place submission on Keller Jordan optimizer competition. autoresearch on SOTA territory. Lewis Tunstall Got the intern to convert Alec Radford's cool new talkie-lm 1930 model to work with transformers. tokenizer, chat template, model conversion etc all one-shotted by ml-intern. someone created entire PhD dissertation chapter on context-aware agentic cyber defense drafted with 16 research subagents. and someone used it to crack an Paul Jankura kernel optimization take-home. (we don't know how to feel about this one 👀 ) just getting started →

3 weeks since ml-intern launched and we just hit 1M messages exchanged. that's 3.3 agent-years of ML research in 21 days. 2 months worth of research every day. 17,383 training jobs total. talk about AI acceleration. here's some of what people built: Carlos Miguel Patiño replicated the full DeepSeek v4 architecture and pre+post trained a 100M MoE from scratch. → it landed a third place submission on Keller Jordan optimizer competition. autoresearch on SOTA territory. Lewis Tunstall Got the intern to convert Alec Radford's cool new talkie-lm 1930 model to work with transformers. tokenizer, chat template, model conversion etc all one-shotted by ml-intern. someone created entire PhD dissertation chapter on context-aware agentic cyber defense drafted with 16 research subagents. and someone used it to crack an Paul Jankura kernel optimization take-home. (we don't know how to feel about this one 👀 ) just getting started →

Aksel

36,131 görüntüleme • 5 ay önce

Building a personal knowledge base for my agents is increasingly where I spend my time these days. Like Andrej Karpathy, I also use Obsidian for my MD vaults. What's different in my approach is that I curate research papers on a daily basis and have actually tuned a Skill for months to find high-signal, relevant papers. I was reviewing and curating papers manually for some time, but now it's all automated as it has gotten so good at capturing what I consider the best of the best. There are so many papers these days, so this is a big deal. You all get to benefit from that with the papers I feature in my timeline and on DAIR.AI. The papers are indexed using tobi lutke qmd cli tool (all of it in markdown files along with useful metadata). So good for semantic search and surfacing insights, unlike anything out there. I am a visual person, so I then started to experiment with how to leverage this personal knowledge base of research papers inside my new interactive artifact generator (mcp tools inside my agent orchestrator system). The result is what you see in the clip. 100s of papers with all sorts of insights visualized. I keep track of research papers daily, so believe me when I tell you that this system is absolutely insane at surfacing insights. This is the result of months of tinkering on how to index research and leverage agent automations for wikification and robust documentation. But this is just the beginning. The visual artifact (which is interactive too) can be changed dynamically as I please. I can prompt my agent to throw any data at it. I can add different views to the data. Different interactions. I feel like this is the most personalized research system I have ever built and used, and it's not even close. The knowledge that the agents are able to surface from this basic setup is already extremely useful as I experiment with new agentic engineering concepts. I feel like this knowledge layer and the higher-level ones I am working on will allow me to maximize other automation tools like autoresearch. The research is only as good as the research questions. And the research questions are only as good as the insights the agents have access to. Where I am spending time now is on how to make this more actionable. I am obsessed about the search problem here. The automations, autoresearch, ralph research loop (I built one months ago) are easier to build but are only as good as what you feed them. Work in progress. More updates soon. Back to building.

Building a personal knowledge base for my agents is increasingly where I spend my time these days. Like Andrej Karpathy, I also use Obsidian for my MD vaults. What's different in my approach is that I curate research papers on a daily basis and have actually tuned a Skill for months to find high-signal, relevant papers. I was reviewing and curating papers manually for some time, but now it's all automated as it has gotten so good at capturing what I consider the best of the best. There are so many papers these days, so this is a big deal. You all get to benefit from that with the papers I feature in my timeline and on DAIR.AI. The papers are indexed using tobi lutke qmd cli tool (all of it in markdown files along with useful metadata). So good for semantic search and surfacing insights, unlike anything out there. I am a visual person, so I then started to experiment with how to leverage this personal knowledge base of research papers inside my new interactive artifact generator (mcp tools inside my agent orchestrator system). The result is what you see in the clip. 100s of papers with all sorts of insights visualized. I keep track of research papers daily, so believe me when I tell you that this system is absolutely insane at surfacing insights. This is the result of months of tinkering on how to index research and leverage agent automations for wikification and robust documentation. But this is just the beginning. The visual artifact (which is interactive too) can be changed dynamically as I please. I can prompt my agent to throw any data at it. I can add different views to the data. Different interactions. I feel like this is the most personalized research system I have ever built and used, and it's not even close. The knowledge that the agents are able to surface from this basic setup is already extremely useful as I experiment with new agentic engineering concepts. I feel like this knowledge layer and the higher-level ones I am working on will allow me to maximize other automation tools like autoresearch. The research is only as good as the research questions. And the research questions are only as good as the insights the agents have access to. Where I am spending time now is on how to make this more actionable. I am obsessed about the search problem here. The automations, autoresearch, ralph research loop (I built one months ago) are easier to build but are only as good as what you feed them. Work in progress. More updates soon. Back to building.

elvis

468,105 görüntüleme • 6 ay önce

$Fable 5 built this real-time ocean scene directly in the browser using Three.js, WebGPU and TSL, with no engine and no baked assets. The interesting part is not just that the water looks good. The whole system is being simulated: wave spectrum, GPU FFT, foam generation and refracted-ray caustics, all running live. This is exactly where frontier models start becoming genuinely useful for technical graphics work. Not by replacing years of rendering research, but by compressing the path from complex math to a working interactive result. A small, focused scene, but technically very serious. Cc: Adem Vessell$

Fable 5 built this real-time ocean scene directly in the browser using Three.js, WebGPU and TSL, with no engine and no baked assets. The interesting part is not just that the water looks good. The whole system is being simulated: wave spectrum, GPU FFT, foam generation and refracted-ray caustics, all running live. This is exactly where frontier models start becoming genuinely useful for technical graphics work. Not by replacing years of rendering research, but by compressing the path from complex math to a working interactive result. A small, focused scene, but technically very serious. Cc: Adem Vessell

Token Gremlin

21,731 görüntüleme • 3 ay önce

Increasingly, HTML Artifacts are becoming a core part of how I work with AI agents. Long-horizon agent sessions need a better way to surface insights about what work it has done. This may not be obvious right now, but as you start to let your agent work on dynamic workflows, large codebases, long-running loops (e.g., using /goal), and deep research tasks, you need a good way to present results. Chat window is not it. You also don't want to just trust everything the agents do. Artifacts help provide an important verification layer, which in turn enables important decision-making. I like HTML artifacts because I can just ask the agent to produce as many of them (and in whatever form) as I need to verify the work and make sense out of everything. I even built a nice tab system for my artifacts. They are great for continual learning and research. I use HTML artifacts for logging, tracking experiments, brainstorming, managing my inbox, code reviews, agent session management, deep research, writing, reading, and so much more. I believe Andrej Karpathy wrote about this somewhere: As we move on to more advanced applications of AI agents and outputs get more complex, we will start to find the need for even more advanced forms of interactions with AI, including interactive neural videos/simulations.

Increasingly, HTML Artifacts are becoming a core part of how I work with AI agents. Long-horizon agent sessions need a better way to surface insights about what work it has done. This may not be obvious right now, but as you start to let your agent work on dynamic workflows, large codebases, long-running loops (e.g., using /goal), and deep research tasks, you need a good way to present results. Chat window is not it. You also don't want to just trust everything the agents do. Artifacts help provide an important verification layer, which in turn enables important decision-making. I like HTML artifacts because I can just ask the agent to produce as many of them (and in whatever form) as I need to verify the work and make sense out of everything. I even built a nice tab system for my artifacts. They are great for continual learning and research. I use HTML artifacts for logging, tracking experiments, brainstorming, managing my inbox, code reviews, agent session management, deep research, writing, reading, and so much more. I believe Andrej Karpathy wrote about this somewhere: As we move on to more advanced applications of AI agents and outputs get more complex, we will start to find the need for even more advanced forms of interactions with AI, including interactive neural videos/simulations.

elvis

37,194 görüntüleme • 4 ay önce

💻Tired of running so many slow, expensive benchmark evals across every checkpoint? Try ✨BenchPress✨ at provide a few benchmark scores, then get predictions for the remaining ~100 benchmarks, with trust probabilities and calibrated 90% prediction intervals. How does this work? In his original post ( Dimitris Papailiopoulos first tried the idea as a fun question: collect model-by-benchmark scores into a matrix, find its low-rank structure, and use matrix completion to predict missing benchmark scores from a few observed ones. We expanded this into a full system: a fully audited 84-model x 133-benchmark score matrix, an optimized matrix-completion predictor, and a reliability layer for trust probabilities and 90% prediction intervals. Beyond predicting missing scores, we also suggest practical seed benchmark sets. The five-probe set {GPQA-D, HLE, Codeforces, MMLU-Pro, ARC-AGI-1} recovers the rest of a model's public score profile with a MedAE of 3.93 points. A lower-cost set {GPQA-D, MMLU-Pro, Aider Polyglot, MATH-500, AIME 2026} reaches 4.55 points. See more details below 🧵1/7 This work is with Dimitris Papailiopoulos at AI Frontiers, a boutique research lab inside Microsoft Research.

Yuchen Zeng

36,680 görüntüleme • 4 ay önce

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

Jafar Najafov

13,999 görüntüleme • 6 ay önce

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

AlphaSignal

92,302 görüntüleme • 6 ay önce