Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Pi Agent vs OpenCode token usage A lot of people recommended Pi Agent so I decided to check Pi Agent took 1.1k tokens in first turn OpenCode took 11.5k Setup: 1) Trimmed OpenCode (from usual 30k first turn to 11.5k) - 0 MCPs - 2 lightweight plugins (opencode-env-protect and...

201,405 Aufrufe • vor 2 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

I have been testing DeepSeek-V4-Pro with the Pi coding agent. I am mindblown by how well it works out of the box. A few notes: I spent a few hours building an LLM wiki with an agent powered entirely by DeepSeek-V4-Pro on Fireworks AI inference. This is the first time I feel like there is an open-weight model that can reason at the level of Claude and Codex. And it does this in a cost-effective way with support for 1M context length. To be clear, I am using DeepSeek-V4-Pro inside of Pi without any special configuration. It works out of the box. It's exciting that there is a model that can just be plugged into a basic harness like Pi, and it just works. I've never seen that before. Most models require lots of configuration and setup. DeepSeek's DeepSeek-V4-Pro is clearly good at agentic coding (probably the best from the open-weight models), but the model is also great on knowledge-intensive tasks where reasoning matters. The agent pulled agentic engineering best practices from different company docs (Anthropic, OpenAI, Google, Stripe, Meta, Modal, DeepSeek, Mistral, Cohere), searched and digested Reddit and HN threads, summarized arxiv papers, and surfaced trending GitHub repos. Then it distilled everything into actionable tips across categories. I love the Wiki it built. The quality is really good. Here is a snapshot of what the wiki looks like: DeepSeek-V4-Pro handled the task without breaking stride. Multi-step research queries, code generation for scaffolding, context-heavy reasoning across disparate sources. For coding specifically, this is the first open-weight model that genuinely feels like a Codex or Claude Code experience. It compares in capability and actual multi-turn agentic work. What made the loop feel so responsive was Fireworks' inference speed (the fastest in the market) and the fact that they actually validate models at the systems level before shipping. No corrupted reasoning traces. Just fast, reliable iteration. The hybrid CSA and HCA attention design cuts KV cache to just 10% and inference FLOPs by nearly 4x at 1M-token context. This is what makes the agent loop actually fast and cheap enough to run in practice. For devs who've been watching open-weight models close the gap but haven't found one that actually delivers in practice, this is the closest I've seen. Try it here:

elvis

59,750 Aufrufe • vor 2 Monaten

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

kwindla

40,319 Aufrufe • vor 1 Monat

I cut Fable 5 token usage 2.5x with just one change! - Before: 5.5 M tokens · 7 errors · $8.94 - After: 2.3 M tokens · 0 errors · $4.17 The final build was the same for both, but the path the agent took wildly differed. In both runs, the agent started with the same thing, i.e., it understood the backend before building anything, like: - Permission policies - Available storage buckets - Auth providers configured - How edge functions are deployed The first run used Firebase, which was built for a human dev using a dashboard. While the dev can read the above state by clicking through tabs, an agent has no dashboard. So it gathered the same info through API calls. And there's no single Firebase call that returned this info. The agent required to query multiple times, and each query over-returned. For instance, when the agent asked how sign-in is configured, Firebase also returned the entire auth surface and every method it supported. This was far more context than what it needed. And it repeated across every part of the backend it inspected. Some states (like which auth providers are active) weren't queryable at all. I provided it myself. Otherwise, the agent would have guessed. Errors further compounded the token usage. When a dev sees "permission denied," they can look at the console and figure out whether it's a rule, a path, or an unauthenticated request. Firebase returned the same string to the agent as well, and it had none of that surrounding context to debug. So it guessed again, picked the most likely cause, and rewrote code, utilizing more tokens. This Firebase setup cost me 5.5M tokens and 7 manual interventions during errors on a full-stack RAG app. But I brought that down to 2.3M tokens and 0 manual interventions by using InsForge as the backend context engineering layer (open-source and self-hostable via Docker). It provides the same primitives as Supabase/Firebase, but structures the entire information layer for agents, instead of dashboards. In one CLI call that consumed ~500 tokens, the agent saw the full backend topology before writing a single line of code. This included auth, database, storage, edge functions, model gateway, micro VMs, and deployment. Also, instead of loading the entire product surface into context on every task, four narrowly scoped skills activated only when relevant to keep cognitive load minimal. And to ensure efficient retries if needed, every CLI operation returned structured JSON with meaningful exit codes, so the agent never guessed what to do next. Here's the InsForge GitHub Repo: (don't forget to star it ⭐) The video below depicts the final build, comparing Firebase and InsForge. To dive deeper, I recently published a full walkthrough building the same RAG app on both backends and inspected them end-to-end. Read it below.

Avi Chawla

112,879 Aufrufe • vor 1 Monat

I designed a new test specifically for multimodal models: fill out a paper form. And it's much harder than it sounds. This isn't typing into an electronic field that captures your text. The form is just an image. The model has to place each form element: text, checkmarks — at the correct pixel position on the canvas itself. Results: 🟢 Kimi K2.6 → done in 3:45, 16.7k output tokens 🟡 Step 3.7 Flash → half the fields, 57k output tokens 🔴 Gemini 3.5 Flash → 489k output tokens, never finished. I had to kill it. Gemini burned ~29x more output tokens than Kimi on the exact same task, and Kimi's was the only form that actually looked filled out. The test, a mocked application form, contains some challenging parts, such as one-character-per-box fields. I provided every model the same set of tools: > get canvas size > drop probe markers to find coordinates > add text > add checkmarks > move elements > take a screenshot anytime to check their own work > ... etc So it's vision + spatial reasoning + tool use + long context, all at once. Small models (Qwen, Gemma) can't really complete this test, so I skipped them. What happened: > Kimi nailed name, DOB, ID, gender, marital status, nationality, email, phone, address, postal code — placement slightly loose, but content correct. 15 turns. Clean. > Step got maybe half right — fields dropped, "United States" landed in the email line, data floating outside boxes. Burned 1.24M input tokens doing it (81 turns of re-reading the canvas). > Gemini almost got there visually... then spiraled. By turn 40 it was issuing a delete_elements call wiping element IDs 365–425, basically erasing its own work. 31 minutes, 489k output tokens, still streaming. Terminated. The takeaway isn't "Gemini bad." This test is indeed difficult. But token efficiency is capability now. A model that needs 30x the tokens and still can't converge is going to be 30x the cost in production. Kimi K2.6 just quietly did the thing.

stevibe

25,304 Aufrufe • vor 1 Monat

Dr. Fan video translation: First of all, I would like to congratulate more than 16 million Pioneers around the world for transitioning to the open network. This is the result of our joint efforts over the past six years. We should celebrate this historic moment in the development of the network. Looking back at the development of Pi now, it has always been a unique project. Some people will feel that it is different, and yes, it is. Pi is a non-conformist. Many innovations come from non-conformists who challenge conventions, conventions, and established practices. In the case of Pi, in the early days of cryptocurrency development, many projects raised funds through initial coin offerings (ICOs), but Pi never did so. Pi never sold tokens through ICOs and ensured that everyone could get them for free. 80% of Pi tokens belong to the public and the community. When a cryptocurrency project can go online with just a white paper, a smart contract, or even just an emoji today, the Pi community spent six years building its infrastructure, ecosystem, and ensuring that it has usable practical functions. Before opening, most of its addresses were unverified for most blockchains. Pi chooses to verify the identities of millions of users through identity verification (KYC) and business identity verification (KYB) to ensure that the identities of individuals and businesses on the mainnet are authentic and reliable. Because Pi firmly believes that true decentralization is not inconsistent with authenticity and legitimacy. Some cryptocurrency critics worry that Pi's users are too mainstream. Is this a problem? We think not. This is precisely the biggest advantage that the Pi network has been working hard to build and build over the past six years. Ordinary people like Pioneers are the driving force behind Pi's development because Pi aims to solve the problems of large-scale applications and real-world practicality. Pi welcomes both cryptocurrency enthusiasts and mainstream people. History has shown that only by meeting the real needs of the mainstream population can technology develop for a long time. With this development trend, the cryptocurrency industry as a whole will also benefit from the participation of a large number of mainstream audiences to jointly create the real utility of blockchain technology. What does it mean to open the network today? This means that the firewall of the Pi blockchain has been removed and connected to the outside world. This makes it easier for merchants to sell goods and services in the local market; developers can further develop applications and improve business model logic; creators can gain greater influence; and ordinary Pioneers can also connect and trade with each other. For new developers, welcome to this widely distributed crypto network. If you already have a business model, come to the Pi network to test and sell your products. For developers who don't have a business model but have an excellent application experience, the Pi application network has prepared a business model for you. The platform will bring you traffic and make you profitable. At the same time, it creates the use value of Pi for all pioneers, which is very beneficial to the Pi network as a whole. So, Pioneers, in the end, don't let external noise distract you. Focus on key matters, focus on things that can have an impact in the crypto field and even the world. Keep working hard, keep creating, and everything else will fall into place. MY MESSAGE Please listen carefully to this video so that you understand, the value is determined by the existing ecosystem, the current ecosystem is GCV $314,159 What small traders do under the auspices of the ambassadors 🥰 Eagle woman 🦅 Nonny Padja NTT 🇮🇩 Believe it or not, it's up to you, the point is we've won with a GCV barter value of $314,159 If you want to succeed Barter with Pioneer and small merchants with GCV value of $314,159❤️

NONNY PADJA NTT ❤ Eagle woman 🦅

45,669 Aufrufe • vor 1 Jahr

Announcing the 2025 Hackathon & GCV Update Happy Saturday, Global Pioneers and Global GCV Ambassadors! This is Doris Yin from Toronto, Canada. How are you doing? I hope everything is going well. Today, I want to share the Core Team announcement about the 2025 Hackathon. The prizes are: First prize: 75,000 Pi Second prize: 45,000 Pi Third prize: 15,000 Pi I know some of you may feel discouraged about GCV because CT uses exchange price for prize. , but there’s no need to worry. Let me explain why. This does not mean GCV has failed, nor does it mean the Core Team supports a low Pi value. As I mentioned before, we have two methods, two paths to strengthen GCV. The first path is offline GCV. This is very important. We still need to implement partial Pi payments at GCV offline, and more merchants are joining in. They appreciate it because it helps local businesses grow. This is already happening in countries like China, Vietnam, the Philippines, Indonesia, Malaysia, Thailand, and India. We can also observe more GCV data being recorded on the blockchain, which is essential to OM fix Pi value. Instead of the Pi value coming from the exchange market, it comes from the community-driven process. You can see this reflected in the blockchain records. Our social media, groups, communities, and education efforts help pioneers recognize and acknowledge the Pi value and GCV. However, we also need online utilities and DApps. This will increase actual usage of Pi after the Open Mainnet. So we have two parts: 1. Value confirmation: We must continue building and creating more GCV data. 2. DApps and utilities usage: We need higher-quality DApps widely usage to guarantee and protect GCV. Currently, DApps are limited and mostly from pioneers, not professionals. We need good-quality DApps. If the Core Team were to simply give a prize of one Pi, it wouldn’t motivate developers—especially top developers inside and outside the community. To truly motivate them, we must use the exchange market price to attract the highest-level developers. For example, the first prize of 75,000 Pi is roughly 20,000–30,000 USD. That’s a meaningful incentive now, and in the future, it could be even higher. Developers can also see the future value of Pi, not just the current 30 cents, which encourages high-quality development. As we develop more, it supports the full realization of GCV. Offline partial Pi payments, partial fiat payments, and industrial alliances in different countries attract more participants. Online, using exchange market price to increase demand and reduce Pi selling pressure, helping to keep the price steadily increasing. When pioneers spend Pi on items, it reduces the circulating supply, creating scarcity, which is positive for the Pi Network and GCV. Some anti-GCV voices laugh and say “GCV has failed,” but they laughed too early because the CT strategy is helping GCV. Even these early critics help GCV by increasing awareness and adoption. I will also write articles to explain this further for everyone. Regarding the Core Team: it wouldn’t make sense for them to target only 30 cents. Their goal is GCV because any project owner wants their product or service to be meaningful and valuable. A higher Pi value is good for the ecosystem. GCV can support the Pi Network long-term, possibly 100 years or even 1,000 years. We don’t have hundreds of billions of Pi in circulation—currently, only about 2 billion exist. When fully released, it will take time, and the value will continue to grow. I hope everyone understands. Happy Saturday! Enjoy your day, keep working, and help the community. I also hope our GCV Ambassadors actively participate in the 2025 Hackathon. Thank you, and goodbye for now! Doris Yin 🪷 🪷🪷 Founder, Global GCV Movement August 16th, 2025

Doris Yin 东方紫莲🪷

28,870 Aufrufe • vor 11 Monaten

I tested Claude Code on a fresh account - 1,500 lines of HTML cost me 50% of my window. Full video and summary is here.. I just ran a recorded test on Claude Code with a fresh account (Pro, not Max - my main account was 20x Max) , and the result is honestly insane. The task was trivial: create 3 simple demo HTML pages, around 500 lines each. Roughly 1,500 lines of code total. Nothing massive. Nothing enterprise-grade. Nothing that should meaningfully stress a premium coding product. And yet Claude Code burned through 40% of my 5-hour window almost immediately. I ran the exact same test with Codex, and it consumed only 2%. Then it got even worse: after the session ended, I did absolutely nothing for 15 minutes, and Claude still ate another 10%. Total: 50% of the 5-hour window gone for a tiny HTML demo. My weekly usage had already started at 2% before I even really used it, and after this tiny test it jumped to 8%. Now let us be generous and assume this entire run used around 30k tokens total. If 30k tokens represents 10% of weekly usage, that implies around 300k tokens per week. That is roughly 1.2M-1.3M tokens per month, and even if you round up aggressively, you are still in the 1.5M token range. Using the Sonnet 4.6 pricing you list: $3 per 1M input tokens $15 per 1M output tokens How exactly is this supposed to make sense for a paid coding product? Because from the user side, this no longer looks like "premium usage protection." It looks like a quota system that is either wildly inefficient, badly broken, or being accounted in a way users are not being told about. And that is before I even get to my main account: my $200 Max plan now dies in a single day. Just a few months ago, similar or heavier usage would last me about a week. So no, I do not buy the "maybe you just used it more" excuse anymore. Something is clearly broken in Claude Code. Either token accounting is broken, context handling is broken, background consumption is broken, or all three. Alex Albert is this really the experience you want users to pay for? Just watch the video. I tried to be very transparent and clear for your team! I was fan of Claude but just disappointed! And if you want, send me the detailed token accounting for this session and let us inspect it together publicly. Because from where I am standing, this is no longer a small pricing annoyance. It looks like something seriously wrong is happening, and users deserve a real explanation.

Hayrettin Tüzel

26,854 Aufrufe • vor 3 Monaten

Researchers found a way to make LLMs 8.5x faster! (without compromising accuracy) Speculative decoding is quite an effective way to address the single-token bottleneck in traditional LLM inference. A small "draft" model first generates the next several tokens, then the large model verifies all of them at once in a single forward pass. If a token at any position is wrong, you keep everything before it and restart from there. This never does worse than normal decoding. But current drafters in Speculative decoding still guess one token at a time. That makes the drafting step itself a bottleneck, capping real-world speedups at 2-3x. DFlash is a new technique that swaps the autoregressive drafter with a lightweight block diffusion model that guesses all tokens in one parallel shot. Drafting cost stays flat no matter how many tokens you speculate. On top of that, the drafter is conditioned on hidden features pulled from multiple layers of the target model and injected into every draft layer, so it makes significantly better guesses than a drafter working from scratch. In the side-by-side demo below, vanilla decoding runs at 48.5 tokens/sec. DFlash hits 415 tokens/sec on the same model, with zero quality loss. It's already integrated with vLLM, SGLang, and Transformers, with draft models on HuggingFace for several models like Qwen3, Qwen3.5, Llama 3.1, Kimi-K2.5, gpt-oss, and many more. I have shared the GitHub repo in the replies! KV caching is another must-know technique to boost LLM inference. I recently wrote an article about it. Read it below. 👉 Over to you: What use case are you working on that can benefit from this new technique?

Avi Chawla

157,390 Aufrufe • vor 2 Monaten

**Doris Yin - 3/28/25 International GCV Group Speech** Pioneers, I encourage you to read all my articles to grasp the big picture. It is essential to understand that different phases come with different tasks. I find that many questions arise from a lack of understanding of these phases and tasks. Your primary task is to understand this first and then help your community to understand as well. 1. We have completed the first stage of coinage at GCV, and we have already succeeded! The Pi GCV value of $314,159 has been encoded. This stage focuses on building Pi value within our community through the enclosed mainnet. The blockchain records are critical, as they will determine the value of Pi in code. 2. Now we are entering a new stage: the Open Network. This means we need to expand our reach to the world. We want Pi GCV to be accepted by governments and regulatory bodies, large companies, and a broader audience. That is why we are engaging in the exchange market, which serves as a bridge to implement the GCV code. Do you understand? We at GCV are taking charge of the entire Pi Network community! GCV is the champion 🏆. This is why blockchain records are now less important than the exchange market in this new stage. Our battlefield has shifted from the blockchain to the exchange. The exchange markets are where Pi can be accepted as a stable coin according to the GCV! How do we achieve that? 1. Increase the demand for Pi in the exchange market. 2. Control the supply of Pi in the exchange market. 3. Educate Pioneers not to sell, except to GCV. Currently, Pi CT is also working on this by using domain name auctions to enhance the demand for Pi, especially from external companies. The goal is to attract more businesses to our ecosystem and bring in more users. At present, we have 11 million wallets, which means there are 11 million Pioneers holding Pi wallets. This is a small population, and we aim to become a global currency. However, we face challenges with only 11 million Pioneers. After implementing the codes, the mining speed will drop to 0.1 or lower annually. At that time, the price will be pegged to GCV, making it difficult for most people to afford 0.01. But don’t worry about those who do not have Pi wallets if you buy from exchange market, it is easy for CT to provide this kind of wallet for the ecosystem. You will have auction purpose wallet to HOLD your Pi from exchange soon. How can we further develop if we don't have enough companies and users of Pi? This is why CT needs lower prices in the exchange market to attract companies and people. Do you understand? Utilize the three-month marketing strategy for Pi! After three months, all low-priced Pi can be eliminated. Then we will have the power to set the Pi price in the exchange market, solidifying Pi as a stable coin according to the code! CT is not allowed to interfere with or guide the exchange market. Therefore, we, the Pioneers, must take responsibility for helping to expand Pi usage. If you understand this logic, do you still have doubts? Everything is in the hands of CT and our GCV CT! This is our shared strategy. None of you should be passive. You have a responsibility to help your community build confidence so that you can cooperate and promote the Domain Auction, encouraging others to join Web3 blockchain and use Pi as payment! Any complaints stem from a lack of understanding. If you cannot think things through, be humble enough to learn. All doubt comes from arrogance and ignorance. We are on the verge of conquering the world and establishing Pi as a global currency! But we need all Pioneers unified and working hard. If complaining could resolve your financial problems, we would work diligently to complain. But can it? Of course not! It wastes both your time and ours and hinders our progress. I have muted the group so that you can read this message clearly. If you can’t contribute positively, I encourage you to find a job to earn money for yourself. Please don’t come to the group to spread complaints and negativity. I have my own job and responsibilities, and I will never quit my job. If you have nothing to do and no job, you may become desperate. So please find a job and work on improving yourself. Once you stabilize your own situation, you are welcome to join the group as a volunteer to help others. Only when we clearly see our path can we walk steadily and reach our destination quickly and successfully. Have a wonderful day! ❤️ Doris Yin 🪷🪷🪷 PS: I've been very busy lately with tax season work, so I don't have time to write articles. However, I still participate in some group daily.

Doris Yin 东方紫莲🪷

20,703 Aufrufe • vor 1 Jahr

GCV Movement: Confidence, Stability, and the Power of Pioneers This is Doris Yin in Toronto, Canada. Today is a beautiful Sunday morning around my condo, and I hope everyone is enjoying the weekend with their family. Our topic today is confidence. We understand what others may want to do with Pi Network. But if you take a moment to read the white paper — just the first few pages — you will understand what Pi Network truly is and how it differs from traditional cryptocurrency. We are doing something completely different. Traditional cryptocurrencies cannot use the blockchain to serve ordinary people. That is exactly why Dr. Nicolas created Pi Network — to build a currency that ordinary people can actually use. If you understand this vision, you also understand Global Consensus Value (GCV). Only GCV can realize Pi as a real currency. And a true currency must have two essential characteristics: 1. Stability – Its value cannot fluctuate wildly like Bitcoin or other cryptocurrencies. 2. Usability – It must be usable in everyday life by ordinary people. Why Stability Matters In traditional cryptocurrency, tokens behave almost like commodities or stocks. People buy and sell for profit when prices go up or down. This speculation creates instability, and instability prevents cryptocurrencies from serving as real money. Pi Network is different. Its mission is to provide a stable, usable currency. That’s why we focus on creating Global Consensus Value (GCV) — the mechanism through which pioneers themselves determine the value of Pi. Who Creates the Value of Pi? Dr. Nicolas has made it clear: the value of Pi is created by pioneers, not the Core Team. The Core Team builds the technology, but we, the pioneers, hold the power to set Pi’s value. Confidence is essential — confidence in the Core Team, yes, but also confidence in ourselves. Some pioneers lack confidence because they only passively mine. But if you participate actively — as a GCV Ambassador, a Pi Warrior, or a contributing pioneer — you will understand the movement and your role in it. Two Steps to a Mature Pi Economy Pi’s development has two key sides: Technical side: Already open. The blockchain infrastructure is connected to the world. Economic side: Not yet open. Real economic activity must wait for GCV implementation to create a mature ecosystem. This is why we focus on ecosystem depth — businesses, services, and real-life use cases that give Pi weight and support its value. Mind + Depth = Stable Value Our mind (pioneers’ consensus) fixes the value. Our depth (ecosystem adoption) supports the value. Together, they make Pi a living, functional currency. Become a Pi Warrior Today, many pioneers and social media supporters are spreading the message of GCV. But many writers and outsiders still don’t understand Pi or GCV. That is why it is our responsibility to share, teach, and invite more pioneers into the movement. We are not only pioneers — we are warriors protecting the Pi Network. The outside world may not yet understand, but we do. And it is our duty to ensure more pioneers learn, support, and actively participate. If you understand GCV, don’t keep it to yourself. Share it, pass it on, and invite others to join. Protect Pi. Build confidence. Build the ecosystem. A Personal Note As I speak this early morning in Toronto, I feel energized from my workouts and yoga. I encourage all pioneers to take care of your health. A strong body supports a positive mindset, and a positive mindset allows us to contribute more to Pi’s mission. Thank you for your attention. Enjoy your day. Stay confident, stay united, and together we will make Pi the world’s first stable, global, people’s currency! 🌍✨ 🔥 Pioneers Create the Value — Warriors Protect the Network! 🔥 Doris Yin 🪷 🪷🪷

Doris Yin 东方紫莲🪷

10,706 Aufrufe • vor 10 Monaten

A tricky LLM interview question: You're serving a reasoning model on vLLM, and it keeps running out of GPU memory on long traces. So you add KV cache compression and evict 90% of the cached tokens. VRAM usage stays as is and GPU still runs out of memory. Why? (answer below) Evicting 90% of the KV cache can free almost none of the memory it was using. This sounds counterintuitive, but it follows directly from how production servers store the cache today. The KV cache grows with every token a model generates. Each token appends its key and value vectors across every layer, and nothing is freed while generation continues. This is the dominant memory cost for reasoning models. If a 32K-token CoT caches ~32K tokens of KV vectors, a Qwen3-32B with 4-bit weights will run out-of-memory around 24K tokens on a 24GB GPU. One obvious solution is to keep the important tokens and drop the rest, since attention is sparse enough to allow it. But this does not solve the memory problem yet. The reason is paged attention, which is the memory manager behind vLLM and most production servers. Under the hood, it splits GPU memory into fixed physical blocks, each one holds the KV for about 16 tokens. This block returns to the allocator only when every slot inside it is empty. Since the eviction logic selects tokens by importance, and such tokens are scattered across blocks... ...so despite eviction, almost every block is left with at least some survivor tokens. For instance, if the logic evicts 14k of 16k tokens across 1,000 blocks, most likely every block will still have a token. This means the allocator frees almost nothing. Placing the new tokens into those freed slots is not ideal because it breaks the cache's layout. Say token 16,001 arrives, and it's placed in the slot the 40th token used to hold. The cache now reads position 38, then 16,001, then 41, so the cache is no longer in token order. Attention can still compute the right answer from that, but only if every slot now carries a separate note recording which position it actually holds. This introduces another bookkeeping cost that an in-order layout inherently avoids. So the cache is logically 90% smaller and still physically the same size. Many compression results miss this because they measure on pre-allocated contiguous tensors rather than a paged server. There's another problem. Eviction methods pick which tokens to keep by looking at the attention scores themselves (as expected). But fast attention kernels used in production, like FlashAttention, never save those scores. They compute attention in small pieces and throw the full score grid away as they go, which is also why they're fast. So the exact signal eviction methods need isn't available in memory. The workaround is to fall back to eager attention and build the full matrix, which gives up the speed FlashAttention was there to provide. NVIDIA published a method called TriAttention to solve both these problems. It never needs attention scores. Instead, it scores tokens from the geometry of the model's key and query vectors before RoPE is applied, where those vectors sit in stable clusters. For the memory problem, it runs a compaction pass every 128 decoded tokens. The surviving tokens slide forward to close the holes eviction creates, so whole blocks empty out and return to the allocator while the cache stays in token order. On long reasoning traces, the approach matches full-attention accuracy while decoding 2.5x faster and using 10.7x less KV memory. KV cache compression is a big infrastructure problem. The number that decides whether it works is the count of freed blocks, not the count of evicted tokens. You can find the NVIDIA write-up here: I wrote a first-principles breakdown of how the KV cache works. It walks through why the model stores keys and values at all, why the cache grows with every token, and a comparison of LLM generation speed with and without KV caching. Read it below.

Avi Chawla

267,206 Aufrufe • vor 18 Tagen

What is an Automated Market Maker (AMM)? ************* Notes: The video is attached. Links to the shorts on other platforms are in the second Tweet. Voting on fees using your LP tokens is limited to the 8 biggest LP holders. For auctions, the discount gets you close to 0% but not effectively 0%. The math example couldn’t exist in reality based on G3M. It is just an example to explain the process. ************* Imagine a robot (AMM) that's always ready to help you trade your money (assets) with others on a special online platform (the XRP Ledger's decentralised exchange). This robot doesn’t need to find someone else to take the other side of your trade; it just makes the trade happen using a big pot of money (pool) it manages. How Does it Work? Trading: You can swap one type of money (asset) for another anytime you want, using the robot’s pot of money. The robot uses a special formula to decide the swap rate. Creating a Pool: Anyone can create a new pot of money for two different types of assets if it doesn’t exist yet, or add to an existing one. Rewards for Pool Creators: People who add money to the pot (liquidity providers) get special tokens (LP Tokens) as a thank-you. These tokens can be used to: • Get a share of the money in the pot back, along with some extra (fees collected). • Have a say in changing the robot’s settings, like trading fees. • Bid to get a temporary discount on trading fees. Risks and Rewards: If many people are swapping money and the pot stays balanced, the people who added money to the pot earn some passive income from the fees. But, if the value of the assets changes a lot, they might lose some money. More Technical Bits: Exchange Rate: The robot adjusts the swap rate based on how much each asset has in its pot. If it has a lot of one asset, that asset becomes cheaper to swap. Trading Fees: The robot charges a small fee for each swap, which goes to the people who added money to the pot. Voting on Fees: People with LP Tokens can vote to change the trading fee; the more tokens you have, the more your vote counts. Auction Slot: There’s a special feature where you can bid to get a discount on trading fees for a day. You bid with LP Tokens, and if you win, you (and up to 4 friends) pay no trading fees for 24 hours. LP Tokens: These are special tokens you get for adding money to the pot. They can be traded, used to vote on fees, or redeemed to pull your money out of the pot. Deleting an AMM: If all the money gets pulled out of the pot, the robot (AMM) gets deleted. But, it can be recreated by adding money to the pot again. In a Nutshell: An AMM is like a robot banker that helps people easily swap different types of money using a big shared pot. People who add money to the pot get special tokens and can earn fees from the swaps, but there are some risks if the market changes a lot. They can also vote on settings and bid for fee discounts. If the pot empties, the robot goes away but can be brought back by refilling the pot. Let’s look at an Example: Step 1: Creating a Money Pot with the AMM Robot Alice creates a new money pot (AMM) using the robot. She chooses two types of money: US Dollars (USD) and XRP. She puts in: 1000 USD 10 XRP In this example, we assume an exchange rate of $1 per XRP for easy math. Alice gets special tokens (LP Tokens) from the robot as a thank-you for adding money to the pot. These tokens prove she added money and can be used later to get her money back, plus some extra if the robot earns fees. Step 2: Bob Makes a Swap Bob wants to swap his 100 USD for XRP. He doesn’t have to wait for someone to take his offer; the robot does it instantly using the money in the pot. The robot uses a formula to decide how much XRP Bob gets for his 100 USD, ensuring it's a fair rate based on how much USD and XRP are in the pot. Step 3: Earning Fees The robot charges Bob a small fee, let’s say 1%, for convenience. So, Bob pays 1 USD as a fee, which stays in the pot. Now, the pot has more money than it started with, which is good for Alice because she can earn that extra when she uses her LP Tokens. Step 4: Alice Withdraws Her Money After some time, Alice decides to take her money out of the pot. Thanks to the fees the robot earned from Bob and others, the pot has grown to: 1101 USD 9 XRP Alice uses her LP Tokens to claim her share of the money in the pot. If she puts in 100% of the original money, she gets 100% of what’s in the pot now, including the extra earned from fees. Step 5: Voting and Discounts Alice can also use her LP Tokens to vote on things, like changing the robot’s fee. And, if she wants a discount on fees, she can bid for a special 24-hour discount slot using her LP Tokens. Conclusion In this example, the AMM robot helped Alice earn extra money by providing a convenient way for Bob to swap his USD for XRP. Alice took on some risk by putting her money into the pot, but she earned fees from Bob’s and others’ trades as a reward. Bob enjoyed the convenience of instant, hassle-free trading. And the AMM robot managed it all automatically!

Daniel "CEO of the XRPL" Keller

238,435 Aufrufe • vor 2 Jahren

RLM is the most import foundation of my Pi Harness (other than Pi of course). It's seeded with late interaction retrieval results (thanks to @lightonai for pylate). The Agent initiates it with query then.. 𝐒𝐞𝐭𝐮𝐩 A python REPL is created and seeded with: 1. Late interaction search to pre-filter. Instead of doing top 3/5/10, it's top hundreds of documents. This is set into a `context` variable. 2. Python functions are loaded in to do more searches if `context` variable isn't enough. And to make llm calls with cheaper models in parallel batches. 𝐈𝐭𝐞𝐫𝐚𝐭𝐢𝐨𝐧 𝐋𝐨𝐨𝐩 From there, an LLM iterates in the REPL based on the query. It's just like exploring in a jupyter notebook. The LLM writes prose (like a markdown cell) and code to be run in the REPL each turn. This allows the LLM to sort, filter, and synthesize information. It can fan out and ask smaller models to summarize, combine, contrast, or do anything else to documents to help it understand the data. After several turns the LLM reponds with the final answer. Either because it found the answer, or hit the budget limit. Context as a Python variable, LLM as the programmer, REPL as the runtime. 𝐖𝐡𝐲 𝐃𝐨𝐞𝐬 𝐓𝐡𝐢𝐬 𝐖𝐨𝐫𝐤 1. Richer Shell. Agents (and subagents) work by intermixing code and prose/thinking. But they use static scripts or bash that run and exit and start over each tool call. That's not ideal for exploration and synthesis of data. For that, state is useful to continue building and exploring the data as you learn more. There's a reason jupyter notebooks have been popular with data scientists. 2. Keeps main agent context clean. The better context you have the better the agent will perform (duh!). This means three thing: better human input, less missing search results, and less incorrect search results. Letting the agent iterate allows it to synthesize just what is needed and nothing else. All bad paths or peeks at something that turns out to be irrelevant stays out of main agent context. 3. Stack the good ideas! People often compare late interaction search vs RLM. Or static vs dynamic languages. Or agentic search vs semantic search. But...You can just use them all together for what they're each good at. Use them all for the area they're really great for. Read the full post which has more detail about how and why.

Isaac Flath

40,212 Aufrufe • vor 2 Monaten

TOPIC #107: PI NETWORK IS A STABLE COIN? -WHO DECIDES PI FULLY OM FIXED VALUE? Dear GCV army, I hope you are all doing great! First of all, I would like to express my sincere gratitude for all your hard work. Many of you have achieved significant milestones, and it’s evident that you are making a great difference. Our influence has grown significantly, with an increasing number of social media posts and YouTubers publicly supporting us. I can see that more and more people are beginning to understand why we advocate for GCV. Today's meeting aims to alleviate any doubts you may have, allowing you to relax and feel confident as we embark on our historic journey together. I will answer the questions I’ve received and address some important issues we need to focus on to maintain our community's efficiency, particularly regarding our Generals, which will be the topic next weekend. I put the questions I received here. "A question addressed to Ms. Doris Yin in the emergency meeting 1– In light of the rapidly changing global circumstances and the increasing discussion about stablecoins backed by U.S. Treasury bonds, how do you see the future role of the Pi Network in this context? And what practical steps should the GCV army take now to accelerate this path? 2_ There are those who promote the idea that the price of Pi is what appears in the market (currently around $0.49) and compare it to the price of GCV within the ecosystem (314,159 Pi = 1 good or service). They say if Pi’s price rises to $2, it means that the value within The ecosystem is approximately 2 million dollars. With sincere appreciation and discipline." This is from the Arab head of GCV Ambassador Mr. Mohammed. Another question: "Hello, my Global Ambassador, I am Ateba Joseph, Ecological Ambassador in Cameroon And a member of the GCV army, I am delighted to exchange with you. Regarding the meeting with the GCV army on Sunday, July 27, 2025.. Here is my concern: A few days ago, a correspondence indicated that Pi is not or is not yet a stable coin. Upon reading this information, we have provided many explanations to help the pioneers understand this. I hope you will focus more on this statement to further strengthen our understanding of the subject. Thank you for taking my concerns into consideration" Thank you for the above questions; my answers are below. The first question concerns stablecoins. Many pioneers are hoping that Pi can be recognized by the U.S. government as a stablecoin. I wrote an article on this in May. On July 18, 2025, President Trump signed the Guiding and Establishing National Innovation for US Stablecoins Act (the GENIUS Act) into law. This legislation establishes a regulatory framework for payment stablecoins and marks the first federal legislation on digital assets enacted since President Trump issued an executive order aimed at making the U.S. the “crypto capital of the world.” U.S.-issued stablecoins are expected to become the primary means of dollar transactions globally, especially in emerging markets with unstable local currencies. The sponsors of the GENIUS Act estimate that by 2030, stablecoin issuers may collectively become the largest holders of U.S. Treasuries, surpassing foreign central banks. From this, we can see that U.S. stablecoins must maintain reserves backing outstanding payment stablecoins on a one-to-one basis, consisting only of specified assets, including U.S. dollars and short-term Treasury securities. It is clear that the Pi Network will not take this path, as it is not part of our plan. A stablecoin is essentially a digital representation of the U.S. dollar. All stablecoin issuers do not create a new currency; rather, it’s akin to purchasing chips at a casino – you must use U.S. dollars to buy those chips. However, Pi is a completely new currency. It does not need to be backed up by U.S. dollars or U.S. Treasuries to be used. If that were the case, we wouldn’t need to establish an ecosystem or have a three-year enclosed mainnet. I previously mentioned the possibility of Pi being an algorithmic stablecoin since only algorithmic stablecoins do not need to be backed by U.S. dollars. However, algorithmic stablecoins have faced significant failures in the past. The collapse of the Terra (LUNA) cryptocurrency resulted in a loss of at least $40 billion in market capitalization, with estimates reaching as high as $60 billion. TerraUSD (UST), an algorithmic stablecoin, lost its peg to the U.S. dollar, contributing to its overall collapse. The new stablecoin legislation recently passed through the Senate effectively ties the U.S. Treasury to crypto, as it essentially bets the government’s cash flow on digital tokens and market speculation. This legislation requires stablecoins to be backed by short-term Treasury bills, generating an estimated $2–$3 trillion in new demand for government debt, which is nearly half the current size of the T-bill market. On paper, this looks beneficial, but in reality, it creates a circular feedback loop: crypto demand fuels stablecoins, stablecoins buy T-bills, and T-bills fund government deficits. The government becomes reliant on speculative capital flows. Thus, we should understand why the U.S. government will not support the Pi Network as a stablecoin, as they require stablecoin issuers to buy T-bills and can no longer trust algorithmic stablecoins. So, what is the future of the Pi Network as a currency? From my perspective, Pi is already listed on exchange markets. It cannot be classified as a security because it is mined freely and is not an ICO. Instead, it should be categorized as a commodity, similar to Bitcoin and ETH. When a currency is listed for trading on an exchange, its price is determined by the balance of supply and demand. However, Pi is a currency in its own right; it has inherent value from Pi holders -Pioneers. Historically, currency has served as a medium of exchange. A medium of exchange is a widely accepted item for buying goods and services in an economy. It facilitates transactions by eliminating the need for a barter system, where goods are directly exchanged for other goods. In modern economies, money (such as currency) serves as the primary medium of exchange. **Functions of Money:** One of the core functions of money is to serve as a medium of exchange, enabling the smooth transfer of value between buyers and sellers, thereby simplifying trade and economic activity. **Examples:** In modern economies, this typically includes currency (paper money, coins) or digital money. In specific historical contexts, other items, such as cigarettes in prisoner-of-war camps, have also served as mediums of exchange. **Importance of Acceptance:** For a medium of exchange to function effectively, it must be widely accepted and trusted within the relevant community. **Not the Same as a Payment Method:** While credit cards and checks are used for payments, they do not serve as mediums of exchange themselves. Therefore, stablecoin is not a new currency. It is more likely to have a credit card or check character. It is a USD digital status. From the analysis presented, we can draw the following conclusions: The current price of Pi on the exchange market primarily serves as a temporary measure to facilitate broad expansion. While this is not our primary objective, it constitutes a strategic approach towards achieving our mission. To gain a clearer perspective, we must adopt a higher-level view of the overall vision for the Pi Network. The mission and vision of Pi Network clearly articulate that it is not intended to function as a commodity for sale, nor is it meant to be an investment vehicle or a speculative security. Instead, it is crucial to recognize that Pi is designed to be a medium of exchange—a new form of currency. As pioneers in this venture, we have the unique opportunity to acquire Pi through free mining. However, it is important to note that the current mining rate is relatively slow. To overcome this limitation and to further our goal of mass adoption, it is essential for more individuals to join the Pi Network and participate in holding Pi. One efficient way to accelerate this process is by allowing Pi to be traded on the exchange market, which can result in rapid and widespread adoption. Since Pi can be mined for free, a lower price could make it more accessible to a larger number of people. It's important to focus on our primary goal during this pre-full Open Mainnet (OM) phase: mass adoption, rather than aiming for high prices, which many pioneers expected. Some pioneers want to sell when the price increases, but if too many sell, it could undermine our goal of achieving mass adoption. This scenario is reminiscent of historical instances when shells served as currency—readily accessible from the sea or buy from the village market. For shells to function effectively as currency, a collective effort was needed to hold and circulate them within the village. If only a select few individuals possess the shells, the currency lacks the necessary circulation to sustain an economy. Hence, our goal should not be centered on achieving a high price; instead, we should strive to make Pi more affordable so that a greater number of individuals can acquire and hold it, thereby fostering a thriving economic ecosystem. Of course, the rising price will build up merchants' confidence to accept it as payment. This is why we refer to it as a buyback campaign, which aims to achieve mass adoption and foster ecosystem confidence. As Pi evolves into a currency, the question of its value becomes pertinent. Given that it is a new currency, its value is not immediately clear. This presents an opportunity for us, the pioneers, to play a crucial role in defining it. The determination of Pi's value is not the responsibility of a central authority such as CT, the government, or the exchange. Instead, it will emerge from a decentralized consensus within the community, which collectively owns Pi. This concept is akin to ancient times when the value of shells was not determined by the sellers. Rather, the value was derived from the collective agreement of the village that utilized them as currency. I hope this elaboration clarifies the distinction between value and price, enabling a deeper understanding of the foundational principles that drive our mission with Pi Network. Pi represents a groundbreaking innovation—a revolution that is poised for long-term economic development on a global scale, rather than perpetuating cycles of plunder and exploitation. By harnessing the power of blockchain technology, Pi empowers ordinary individuals, which creates an inherent conflict of interest with the U.S. government in the short term. Should the U.S. government endorse the Pi Network, it raises questions about the viability of U.S. treasuries and who would ultimately purchase them. Consequently, the government may prioritize support for stablecoins backed by the U.S. dollar and U.S. Treasury securities, as this can help alleviate the U.S. government's issues with limited demand. However, I previously mentioned the potential for Pi to emerge as an algorithmic stablecoin. At that time, the Genius Bill had not yet been enacted. If the Pi Network gains acceptance from the U.S. government, its growth could become rapid and expansive, leading to widespread adoption in other nations. This path would position Pi as a legitimate currency in nearly every country, contingent upon certain conditions. For instance, if the price of Pi in the exchange market can align with the GCV, this could be achieved through a buyback mechanism involving 10 million pioneers. Such a scenario would indicate that Pi differs significantly from past algorithmic stablecoin failures, presenting a compelling case for the U.S. government to view Pi as a low-risk asset. However, it presents a significant challenge to be collectively reached by pioneers, and there are other conditions that we cannot achieve in a short time. While it might appear that Pi Network conflicts with the U.S. dollar or stablecoins in the short term, it has the potential to address the broader issue of overprinting currency, which has plagued the U.S. and many other nations. This would benefit international trade by alleviating concerns about currency appreciation or depreciation in international transactions. The global economy indeed requires a super sovereign currency—one that ensures stability for future generations and fosters lasting peace and prosperity. To comprehend Pi as a currency, it is crucial to recognize that we must cultivate long-term value by generating GCV data. In the short term, our focus needs to be on establishing a robust exchange market and decentralized applications (DApps) to drive mass adoption. If this is understood, there should be no need to feel discouraged by the current low price of Pi. The true value of Pi as a currency derives not from the exchange market, trading platforms, or governmental endorsement, but rather from our community's collective efforts and engagement. You might wonder how a government could adopt Pi, given that it does not take the form of a stablecoin. I would counter with the example of Bitcoin, which has thrived even in environments where many countries have imposed bans. Currently, Pi is transitioning from its traditional commodity status to being recognized as a currency, meaning governmental awareness of Pi Network is still in development. As such, existing regulations generally pertain to older forms of cryptocurrency rather than our innovative approach. Our branding as a digital currency, rather than a cryptocurrency, is intentional. Dr. Nicolas has expressed concerns that many aspects of conventional cryptocurrencies pose challenges to government frameworks and public trust, often leading to economic harm rather than benefit. Our commitment to Know Your Customer (KYC) and Know Your Business (KYB) protocols distinguishes us by mitigating money laundering risks and protecting Pi holders from speculative practices. Many businesses face bankruptcy or closure because consumers lack the disposable income to engage in spending. Imagine how Pi could enable those businesses to survive and thrive—people could utilize Pi to make purchases and easily convert it into fiat currency to sustain operations, thereby preserving many jobs. The function in our wallet that allows users to "buy" Pi is not merely a feature; it represents a vision for the future where conversion to fiat currency can happen immediately, without dependency on third-party exchanges. Moving forward, we can establish a fixed rate (the GCV) for conversions. Once larger institutions and prominent companies recognize the low-risk profile of joining Pi Network due to its GCV stability, we can expect a considerable influx of participants seeking to gain a competitive advantage. You may ask how companies would finance the purchase of Pi at GCV rates. This is an insightful question. My perspective is that the demand for Pi’s stable value will inherently incentivize investments. Much like why individuals purchase stablecoins for their convenience in facilitating cross-border transactions, Pi will appeal to consumers and businesses alike, particularly because we are leveraging Web 3.0 blockchain technology, AI-driven platforms, and a rich ecosystem of decentralized applications (DApps). We are cultivating a loyal customer base that recognizes the value of this innovation. We understand that high-net-worth individuals seek safe investment opportunities. While U.S. treasury bonds currently represent a secure asset class, they are not without risk. Therefore, if Pi Network can maintain a limited supply coupled with blockchain technology and a consistent GCV, it is plausible that affluent investors would allocate a portion of their capital to acquire Pi. This would lead to fiat inflows whenever there is increased demand for Pi, establishing an equilibrium between Pi and fiat currencies. This interplay is why I believe DApps are critically significant. We need broader usage of Pi in real-world applications. I hope my analysis has helped clarify why the price of Pi should not overly concern us. Buying Pi to hold onto it allows pioneers to accumulate more, while building merchant confidence is essential to kickstart the ecosystem. Merchants will be motivated to see Pi’s price appreciation since this removes the risks for DApps and service providers who depend on exchange market prices. A rise in demand for Pi will subsequently reduce its supply, which is beneficial for price increases. I look forward to discussing Pi GCV army management in another session. Thank you for your time. Let’s continue striving for greatness together. Doris Yin 🪷🪷🪷 Founder, Global GCV Movement Disclaimer: This speech is intended solely for educational purposes within the GCV community. The views and content shared here represent my personal perspective and are part of the GCV movement, but do not reflect the official position of the Pi Core Team (PCT). Pi Network represents a new revolution, meaning there is no existing example for us to follow and no guiding manual. As Dr. Fan mentioned, we cannot predict what will happen around the next corner. Therefore, we must practice and forge our own path. As more people traverse this journey, the road will become clearer.

Doris Yin 东方紫莲🪷

17,590 Aufrufe • vor 11 Monaten

dflash-mlx v0.1.7 is out. Big adaptive-runtime update, still focused mostly on Qwen3.6 27B 4-bit. @ 2048 tokens, M5 Max, stock mlx_lm baseline: ► 1024: 33.26 → 98.05 tok/s (x2.95) ► 2048: 32.34 → 90.67 tok/s (x2.81) ► 4096: 30.58 → 93.55 tok/s (x3.06) ► 8192: 26.03 → 79.12 tok/s (x3.04) ► 16384: 21.50 → 60.77 tok/s (x2.78) Main change: adaptive verify got a lot smarter. Instead of blindly trying to verify large 16-token blocks all the time, DFlash now watches acceptance + tokens/cycle + real cycle cost. When the draft gets weaker, it drops to smaller 4-token blocks, then probes back up only when the recent cycles make sense. In practice: less wasted verify work, better long-context behavior, and much more useful metrics to understand what is happening. ► retuned adaptive verify for long-context / agentic decode ► richer metrics: tokens/cycle, adaptive block state, CopySpec counters ► /metrics now has real decode avg + logical/real/restored prefill rates ► AIME25 benchmark suite with exact integer scoring ► Qwen thinking default now follows tokenizer/request behavior ► GDN recurrent exactness fixes I also started running AIME25-style long generations. Even around 45k generated tokens, I was still seeing ~40 tok/s on 27B 4-bit. Over the next few days I’ll share more demos: AIME runs, real OpenCode game/project sessions, and full metrics along the way. Still optimizing hard for 27B 4-bit first, while working on custom kernels per Apple GPU generation so more machines can benefit.

bstn 👁️

16,334 Aufrufe • vor 1 Monat

Pi was built when there were already agent harnesses around. Here’s why Mario Zechner(Mario Zechner), found them suboptimal and built Pi, a minimalist self-modifying agent: #1 - Mario initially was a believer in Claude Code: "I was a believer in Claude code because they were the first that packaged agentic search up in a really compelling package. And at the time that fit my workflow really well. Everything around the LLM was kind of nice and tidy and easy to understand. I was super happy. I was proselytising Claude code." #2 - Reverse engineering Claude Code highlighted the degradation that Mario felt as a user: "I personally like simple tools that are stable and that I can rely on. Even if they have non-deterministic parts, all the deterministic parts should be as stable as possible. That was just not the experience with Claude Code around summer 2025. They would take away your control of the context. They would inject stuff behind your back, which is bad. Then, your workflows stopped working because there's now a system reminder that you don't even see in the UI that would modify the behaviour of the model. They would also do this to the system prompt. I built a little service where I can track the progression or evolution of the system, prompt and tool definitions and, with every release, it was messing with stuff. That just messed with my workflows and I don't appreciate that." #3 - PI was built with an appreciation for simple and reliable tools: "If I commit to a development tool, I want it to be a stable, reliable thing like a hammer. I don't want my hammer to break a different spot every day. That's terrible. We need somebody who goes the full velocity kind of way. But I don't want to work with a tool like that."

The Pragmatic Engineer

62,825 Aufrufe • vor 2 Monaten