Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I finally landed on a memory-optimal way to render audio waveforms in the browser. The full audio is decoded once, then chunked into 2s bins. Each bin stores peaks at 800 peaks/sec in a Uint8Array. Bins are persisted individually in IndexedDB, which keeps the data as raw Uint8 arrays...

32,463 görüntüleme • 6 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

See that red tape line on the floor? You better not cross it before they tell you “GO!” or you’ll not only get yelled at, you’ll make about 100 people instantly dislike you. My first experience at the Goodwill bins… this operation is so much crazier than I was expecting. This sweet woman spotted me sticking out like a sore thumb. “You a first timer?” She proceeded to give me the rundown: “The college kid resellers are aggressive. See those bins along that wall? Be careful if you go there. They’ll snatch things right out of your hands.” “Every 30-45 minutes they swap out the bins. You have to stay behind the tape line.” “Don’t bring your cart on the floor. Go to the register and get a piece of paper to tape your name on the cart and leave it along the wall.” I have never seen anything like it. And of course, I snuck by the warehouse doors to peek inside what’s happening behind the scenes. Massive pallet racking FULL of clothes bales. I’m talking hundreds of thousands of pieces. Conveyer belt sorting systems with everything you can imagine. Pallets of bicycles. Filthy vacuums. And rolling bins. A bazillion rolling bins full of who knows what, but apparently some treasure. Before you get triggered by “people making money off donations that are ‘supposed’ to support people who are impoverished,” I invite you to go see an operation like this. The amount of excess materialism is astounding, and this is a microscopic fraction of it. Resellers duking it out over labels and prized goods all day everyday at places like this are playing an extremely important role in a circular economy that is making a difference in the appalling about of waste we have created as a society. You won’t find me doing this to source inventory, but of course I snagged a small stack of books because who would I be if I didn’t 😜 And I have a lot of respect for the number of young adults I saw hustling their way through this chaos, leaving with garbage bags full of items that are putting food on their tables. Wild.

Mindi

19,955 görüntüleme • 5 ay önce

Day 12/90 of Inference Engineering What is chunked prefill within vLLM? In continuation of yesterday's post on the high level architecture of vLLM, I want to dive deeper into vLLM core engine starting with the mechanics of chunked prefill. In this post, I will closely follow the original blog on the anatomy of vLLM. To start, let's define chunked prefill. It's a runtime inference optimization technique that splits a long input request so that it doesn’t monopolize the whole GPU. Keep in mind this is all within the context of vLLM. And since vLLM is an inference engine that's meant to serve a model to multiple concurrent users, having a GPU that’s fully monopolized on a single user's request means other users' requests would be in queue waiting to be processed. It isn’t too good to have the whole GPU occupied on a single request when the GPU is meant to be shared! So the key idea behind chunked prefill is to break the long request into smaller chunks, so that each chunk along with other users' requests gets processed and written into the KV cache together. Suppose we split up the long request into chunks and each chunk has 8 tokens. Now each memory block can hold 4 tokens. Therefore, 8 tokens can fit into 2 blocks of memory. After the first forward pass, 2 blocks are occupied, and after the second forward pass, 4 blocks of memory are occupied and so forth. Each forward pass handles a small chunk of the long request so that there's room in the same pass to keep serving other users' requests. Here's a small animation that I made today to fully visualize the idea behind chunked prefill when learning this topic~

max fu

29,197 görüntüleme • 24 gün önce

Researchers made KMeans 200x faster. And the new technique also beats approaches like cuML and FAISS. Flash-KMeans is an IO-aware implementation of exact KMeans that redesigns the algorithm around modern GPU bottlenecks. By attacking the memory bottlenecks directly, Flash-KMeans achieves: - 33x speedup over cuML - 200x speedup over FAISS This speedup comes from how it moves through GPU memory. Standard KMeans runs in two steps, and both are bottlenecked by reads and writes to GPU memory: 1) The first step matches every point to its nearest centroid. Standard KMeans computes the full point-to-centroid distance matrix, writes it out to GPU memory, then reads it back to find each nearest centroid. That write-then-read round trip is the bottleneck. Flash-KMeans combines the distance calculation with the nearest-centroid step, so the result is computed on-chip and the full matrix is never written out. 2) The second step recomputes each centroid by averaging the points assigned to it. Standard KMeans has thousands of threads writing into the same centroid slots at once, so they stall waiting for their turn. Flash-KMeans sorts points by cluster first, turning scattered writes into sequential reductions that read and write memory in one efficient pass. Using these two optimizations at the million-scale, Flash-KMeans completes a standard KMeans iteration in a few milliseconds. The video below depicts this in action. Several reasons why this is important: KMeans has always been an offline primitive. Something you run once to preprocess data and move on. These speedups make the approach viable in several runtime-critical systems. ↳ Vector indices like FAISS use KMeans to build search indices. Faster KMeans means you can re-index dynamically as data changes. ↳ LLM quantization methods need KMeans to find optimal weight codebooks, per layer, repeatedly. What takes hours could now take minutes. ↳ MoE models need fast token routing at inference time. Flash-KMeans makes it viable to run this inside the inference loop, not just in preprocessing. I have shared the paper in the replies. That said, memory is the real constraint Flash-KMeans solves, and the problem is not just limited to clustering. The vectors a RAG system stores after indexing create similar bottlenecks. I wrote a detailed walkthrough recently on cutting this vector memory by 32x with binary quantization, querying 36M+ vectors in a few milliseconds. Read it below.

Avi Chawla

89,234 görüntüleme • 1 ay önce

Claude Monet painted the same stretch of cliff more than ninety times. The place is Étretat, a small fishing village on the coast of Normandy, where the chalk cliffs fall into the sea in great arches and a single spire of rock, the Aiguille, stands alone in the water. Monet had known the place since childhood. He grew up in Normandy, and these cliffs were among the first landscapes he ever saw... He returned to paint them again and again. He worked through the 1880s in front of the same rock formations, and across that time he produced more than ninety canvases of them: the cliffs at dawn, at sunset, under storm, under calm, in winter light and in the gold of a clear evening. In his letters to Alice, the woman he would later marry, he described the agony of it: the weather turning, the tide rising, the sun moving, the colour he had begun to capture vanishing before he could finish. He often worked on several canvases at once, switching between them as the conditions changed, racing each one against the hour. In a letter to his friend Frédéric Bazille he wrote: "It is beautiful here in Etretat. Every day I discover even more beautiful things. It is intoxicating me, and I want to paint it all, my head is bursting. I want to fight, scratch it off, start again, because I start to see and understand. It seems to me as if I can see nature and I can catch it all." The cliffs of Étretat had stood for millions of years and would look, to most people, the same on any given day. Monet saw that they were never the same even for two minutes. He stood on that shore and tried to hold, on canvas, something that exists only for an instant and then is gone forever. And that's exactly what those paintings really are: 90 attempts to keep a single, vanishing moment of light from disappearing. As Dylan Thomas once wrote: "Do not go gentle into that good night. Rage, rage against the dying of the light." -- -- -- If you want a deeper dive into the craft of painting, I recently wrote a piece exploring it in detail. You can read it here: And if you'd like to support my work, a paid subscription is what makes it possible:

James Lucas

57,710 görüntüleme • 2 ay önce

The Odyssey maximizer. Of the people who claim to have read the Odyssey, I would say at best 15% of them have. And of that 15%, maybe 10% genuinely had the knowledge, familiarity with the time, people, place, technology, wars, cultures and conflicts to have anything of interest extracted and result in knowledge of the material. It’s like they “died with the odyssey” rather than “from the odyssey” Most normal people don’t want to spend a lifetime in the rabbit holes of “why did xyz use this word and not that word” “why did he say this and not that” and so on and so on, forever. How many copies of the book sold last year, maybe at best, I’d guess worldwide - maybe around 200,000 and that’s across all countries, languages, translations and they all seem to those convene on X like it’s the bar on Cheers “Norm!” I have studied in depth Machiavelli, the sources Machiavelli refers to, the Borgia’s, The medicis, the history of Florence, his plays and not just Livy’s histories but the histories he used as source material, so I understand machiavelli’s intention of irony, I understand thr use of cruelty in the shocking death of de orco , I understand his use of numbers and so in and so in. I have read many many academic papers covering the most minute things in his works. I don’t discuss Machiavelli except in passing, I acknowledge “oh you read The Prince (a shorter book usually assigned in schools because it easily fits within the semester)” and then usually disengage. Should a movie be made of any of his works I would see it and if it gets a few people interested in learning more and going to the library that would be great. Likewise, for almost all people - the Machiavelli movie would be enough to have satiated their desire to know ‘who he is and what he wrote and why he wrote it’ I am not a snob. I read just enough Plato to say “I read Plato” and that’s it. Some people want to delve deep into his works. I didn’t - but by definition I have “read Plato” But Plato is easy to read because it’s bite size. The odyssey isn’t bite size. Remarkable that on this platform that exploits a super quick attention span, these same users who can’t make it though an axios article or a 4 tweet thread can flip a switch in their noodle and transform themselves into the Burgess Meredith character in The Twilight Zone. These are the notes I have taken of the things I have read and my own writing to please the cognitive senses👇 (The ones marked “audiobook’d” are so I could also absorb the material by “hearing it in my head”) 👇

Adam Townsend

25,365 görüntüleme • 16 gün önce

The ATG School One-Pager I’m not trying to reinvent schooling. There are just a handful of things I believe in which I haven’t seen in any school I’ve been around as a student or parent. Policy #1: Each student gets to be responsible for growing some of their own food, no matter how small, and THROUGHOUT schooling (not just a quickie project here or there). Policy #2: Minimum 1:1 ratio of time NOT SITTING IN THE CLASSROOM. What you do with this is up to you. There are so many real world skills, sports, gardening, music, etc. The strict ratio in the school day is the key for me. Common sense and personal interests can take it from there. Policy #3: Daily time to read whatever you want to read about. The biggest barrier for my reading was INTEREST. Be there to ensure the book is at their level, and to help them if they don’t understand something. Other than that, LET THEM ENJOY READING, ALL THE WAY THROUGH SCHOOL, not just in early years. Policy #4: (This is the most unusual yet the biggest reason I’m in education.) High school is a 50/50 bridge to winning in real life. Mornings are for actual work, making and SAVING UP MONEY. Afternoons are for learning finances and professional skills of YOUR INTEREST. With average work, you’ll finish school with $50,000-$100,000 in the bank, more skills than the norm, and a greater chance of creating your life and work from there on out, rather than conforming to make a paycheck. Policy #5: As part of the high school 50/50 system, ensure each student learns the adult financial red tape in your state/country before you’ve got bills, kids, etc.

KneeOverToesGuy

31,525 görüntüleme • 4 ay önce

"PRICE IS WHAT YOU PAY. VALUE IS WHAT YOU GET." I keep buying $Kekec and I have a strong conviction. Here's Why: While the market is down, and Kekec is declining with it, there are data points that few are considering. Kekec borned in October and since then has been posting a different and original 30-second video every day, which I find extremely funny. For the past couple of months, they have also been posting daily on Instagram, and the attention on Kekec (which doesn't present itself on social media as a memecoin) is growing, moreover, it's increasing exponentially. The number of followers is increasing by about 500-1000 a day. This is largely due to the fact that they are not just focused on the main account but have several others that post reels and redirect to the main one. In short, an excellent strategy to keep growing more and more. Instagram link: Guess What? Not only are the followers increasing, but the team's workload is also growing. In fact, for a little over a month, they have also started pushing on YouTube, and the data here is promising as well. YouTube link: If we want to make a comparison, we can take Pudgy Penguins as an example, which has shown it can reach millions and millions of users without mentioning that they are a WEB3 company that owns an NFT collection. Or, if we want to be more appropriate by comparing one memecoin to another, we could take PONKE. Thanks to the use of social media and the quality of their content, they managed to achieve incredible numbers, which then translated into an increase in the coin's price. Kekec came before PONKE, but that doesn't necessarily mean it's better than PONKE. I believe PONKE is unbeatable in terms of content, but I want to make you reflect on an important point. PONKE came after KEKEC, and after PONKE's success, many coins have emerged trying to imitate it. One of KEKEC's strengths, in my opinion, is precisely the fact that it leverages social media without being a copy-paste. Instead, it is a unique meme derived from a 90's film, and it uses a unique form of content. In short, KEKEC > KEKEC and no one else. I want to conclude by suggesting you follow them on Instagram and evaluate not only the exponential growth of their followers day by day but also observe how the views of each reel increase accordingly. Pay special attention to the comments. Many of the people commenting have no idea what it is, and you can see from the comments how Kekec generates particular emotions in people—strange but still emotions. Personally, I believe that when something is unique and even very strange, it needs time to be adopted. However, once it happens, it usually explodes and spreads like never before. A few days ago, a Kekec video was posted by a very popular meme page. They probably don't know what Kekec is about but thought the video could spark interest among their followers. How many other pages will do the same? Lastly, but not least, I want to point out how Kekec maintains a good market cap despite everything that has happened in the crypto world since October 2023. As far as I know and have personally observed, everything is extremely organic. There is no cabal behind it, and the quality is not reflected in a single jpeg but in work that has been ongoing daily for months. Every day they work harder, and the quality of their videos grows as well. I have no affiliations with the team, but I believe that Kekec truly deserves more in this world where we push celebrity or cabal-backed coins to hundreds of millions in market cap. I keep buying because the numbers suggest so. Don't just evaluate the chart (price), evaluate the data (value). BÂLKÂN DWÂRF

m0ment0

133,194 görüntüleme • 2 yıl önce

1 Neural Network + Obsidian + Karpathy’s 1-file method = the most unhinged second brain build of 2026. It remembers everything you’ve ever done, and it costs $0 on top of what you already pay. The base is Karpathy’s append and review: 1 giant note, new thoughts stack on top, old ones sink, every few days you reread and pull the survivors back up. No folders, no tags, no plugins the rereading IS the system, because review is what turns storage into thinking. The flaw: past 10,000 lines, no human rereads anything. That’s where the neural network takes over. You keep the note in Obsidian 1 vault, everything dumps to the top: ideas, links, meeting fragments, half-thoughts. You never organize, you only dump. It all lives as plain markdown on your own disk, and that detail is the whole trick. Because now you point Claude Code at the vault folder, and it reads every line you’ve ever written. “What did I think about pricing in March.” “Find the 3 ideas I keep circling.” “What did I drop that deserves a second look.” It answers from YOUR notes, with quotes, in 15 seconds. Then once a week, 1 prompt closes the loop: read the last 7 days, surface the 5 entries worth pulling back up, flag anything that contradicts what I wrote a month ago. The model does the sinking and surfacing Karpathy did by hand, and the note stays alive instead of turning into a graveyard. Week 1 feels like nothing. Week 4 you hit the first “I already solved this in January.” Month 3 you consult your past self more than Google. Most second brains die in 11 days under 40 plugins and 200 folders. This one is 1 file and a loop, and it compounds because dumping takes 0 discipline. Notion stores what you thought. This thing argues back.

West Lord

24,679 görüntüleme • 26 gün önce

What happens when an autonomous robotaxi gets into an accident? So far, nothing. Yesterday, I rode in a Zoox robotaxi and got hit by an RTC bus in front of New York New York. The Zoox was trying to turn right into New York New York on Tropicana Avenue just after crossing Las Vegas Boulevard and the bus was trying to get over to make its stop. What I saw, was the RTC bus merging into the front left of the Zoox robotaxi and then a crunching sound followed by a grinding sound. Pretty sure it was the RTC bus at fault. Impact detected. The Zoox robotaxi stayed in place while a warning popped up on the user display. Zoox support came over the in-car speaker and asked if I was okay and then eventually had me exit the vehicle at the New York New York rideshare area. Then, it just took off. The RTC bus? It also took off. The driver never got out to check to see what happened. Loaded up some passengers and went about the day. Nobody stayed around to file a police report, so I did. The Nevada State Troopers are scratching their heads at what to do here and so am I. Now I have a lot of questions that won’t get answered probably. I am okay and not injured thankfully, just shaken up a bit. As far as riding Zoox again, I feel it is safe to ride and highly recommend trying it out if you haven’t. On a side note: The Zoox took the hit pretty well and I couldn’t see damage when I checked it out. The bus had a nice scrape on its right wheel fender. I will keep you all updated on this.

Chris Holmes

94,476 görüntüleme • 5 ay önce

Another WTF moment. A developer just open-sourced a coding agent harness that boots 245x faster than Claude Code. It's called jcode. You launch it and the first frame renders in 14 milliseconds. Claude Code takes 3,436. One active session uses 27.8 MB of RAM. Claude Code uses 386.6. Run ten sessions in parallel and jcode holds at 117 MB while OpenCode swells to 3.2 GB. Each agent has a semantic memory graph instead of a scratchpad. Every turn gets embedded as a vector. The graph is queried on every turn for related memories, and a sideagent verifies the hits before injecting them into context. Consolidation runs in the background to check for stale or conflicting facts. No manual /remember calls. No token burn on lookup tools. The provider list is 30+ deep. Claude, ChatGPT, Gemini, GitHub Copilot, Azure, OpenRouter, DeepSeek, Groq, Mistral, Perplexity, Fireworks, Ollama, LM Studio, and any OpenAI-compatible endpoint you point it at. Ran out of tokens on your first ChatGPT Pro sub? /account swaps to the second. Then there's Swarm. Spawn two agents in the same repo and the server manages them. When agent A edits a file agent B has been reading, agent B gets pinged and can check the diff. Agents can DM each other, broadcast to the room, or spawn their own worker teams for parallel tasks. Groups, channels, and completion statuses are handled automatically. The UI has live side panels that render mermaid diagrams inline. To make it fast, the author wrote a Rust mermaid renderer 1800x faster than the JavaScript one, then wrote a custom terminal called Handterm because no existing terminal could do smooth partial-line scrolling. Self-dev mode is where it gets wild. Tell your agent to enter self-dev and it starts editing jcode's own source code, rebuilds the binary, reloads it live, and keeps working across your existing sessions. You can also resume broken sessions from Claude Code, Codex, OpenCode, or pi directly inside jcode. Anthropic's cache goes cold at the 5-minute mark and you're staring down a big cache miss on your next turn? The UI warns you before you spend the tokens. Written in Rust. MIT licensed. Runs on macOS, Windows, Linux, and Termux. Sitting at 11.2k stars with a native iOS app coming.

Brady Long

203,987 görüntüleme • 15 gün önce