正在加载视频...

视频加载失败

I chatted with yash about MatX, chip design and where silicon designed for LLMs is headed (8:17) Tightly coupling SRAM and HBM on one chip (14:03) More MoE FLOPS, smaller KV cache load (16:08) Numerics: from 32-bit to 4-bit (19:02) Targeting both training and inference (22:14) Chip timelines (27:15)...

71,082 次观看 • 3 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

New interview: Reiner Pope, co-founder/CEO of MatX A counterintuitive throughput insight: “Low latency means small batch sizes. That is just Little’s law. Memory occupancy in HBM is proportional to batch size. So you can actually fit longer contexts than you could if the latency were larger. Low latency is not just a usability win, it improves throughput.” We get into: • The hybrid SRAM + HBM bet, and why pipeline parallelism finally works • Why sparse MoE drives MatX to “the most interconnect of any announced product” • Why frontier labs are willing to bet on an AI ASIC startup • Memory-bandwidth-efficient attention, numerics, and what MatX publishes (and what it does not) • Why 95% of model-side news is noise for chip design • The biggest challenges ahead 00:00 “We left Google one week before ChatGPT” 00:24 Intro: who is MatX 01:17 Origin story: leaving Google for LLM chips 02:21 GPT-3 and the “too expensive” problem 04:25 Why buy hardware that is not a GPU 05:52 Overcoming the CUDA moat 08:46 Early investors 09:35 The name MatX 09:59 The chip: matrix multiply + hybrid SRAM/HBM 12:11 Why pipeline parallelism finally works 14:22 Reading papers and Google going dark 15:20 Research agenda: attention and numerics 17:06 Five specs and meeting customers where they are 19:24 Why frontier labs are the natural first customer 20:32 Workloads: training, prefill, decode 22:18 Little’s law and the throughput case for low latency 24:29 Interconnect and MoE topology 26:35 Inside the team: 100 people, full stack 28:32 Agentic AI: 95% noise for hardware 30:35 KV cache sizing in an agentic world 32:11 How MatX uses AI for chip design (Verilog + BlueSpec) 34:23 Go to market: proving credibility under NDA 35:12 Porting effort for frontier labs 36:34 Biggest skepticism: manufacturing at gigawatt scale 37:32 Hiring plug Vikram Sekar

Semi Doped

19,439 次观看 • 4 个月前

Updated: Vocals & Rap - #성화 #Seonghwa 00:00 Still Here 00:15 Wonderland 00:36 Halazia 00:47 Answer 01:21 Cyberpunk 01:27 Wave 01:37 Utopia 01:50 My Way 02:00 With U 02:16 Be With You 02:54 Star 1117 03:21 Turbulence (야간비행) 03:39 Days 04:26 Promise 04:38 Fever 04:54 Sunrise 05:19 Mist 05:43 Take Me Home 06:11 Better 06:34 All About You 06:43 Aurora 06:55 Blue Summer 07:23 Diamond 07:46 Time Of Love 07:58 Stay 08:07 Desire 08:21 WDIG 08:28 New World 08:35 Dreamers 08:53 Not Too Late 09:03 The Letter 09:19 One Day At A Time 09:28 Dazzling Light 09:40 Light 09:50 The Ring 10:04 Paradigm 10:18 This World 10:38 Bouncy 10:51 Not Okay 11:15 The King 11:23 Inception 11:52 Fireworks 12:03 Limitless 12:19 Precious 12:28 Rocky 12:41 Let’s Get Together 13:07 White Love 13:17 The Leaders 13:27 Crazy Form 13:43 Arriba 13:57 Silver Light 14:06 Dreamy Day 14:26 Matz 15:15 Outlaw 15:23 Twilight 15:31 Dune 15:38 Hala Hala 15:43 Deja Vu 15:50 Horizon 15:54 Say My Name 15:57 Sector 1 16:02 Good Lil Boy 16:09 Don’t Stop 16:12 Still Here (Acoustic Ver) 16:19 Siren 16:31 Guerrilla 16:45 We Know 17:00 Empty Box 17:28 Wake Up 17:40 Dancing Like Butterfly Wings 17:49 Work 18:09 Thanxx 18:26 If Without U 18:45 Shaboom 19:01 Outlaw 19:18 Treasure 19:33 Eternal Sunshine 20:03 Django 20:31 Turbulence Japanese Ver. 20:55 Blind 21:16 Pirate King 21:24 Forevermore 22:00 Birthday 22:11 Deep Dive 22:26 Ice On My Teeth 22:50 Man On Fire 23:10 Selfish Waltz 23:25 Enough

Hwanakin

62,764 次观看 • 1 年前

Etched is deploying two new technologies in chip design: low-voltage inference and cluster-scale memory. CEO Gavin Uberti says they'll make their chips much more power-efficient and way, way faster than today's leading GPUs. He breaks it down: "We looked at a lot of early research directions, and we realized the key things that models need are way more compute and way faster memory." "If you think about inference, there are two key parts: prefill and decode. For prefill, it's a compute-bound problem. You need to have more FLOPS, more operations per second on each of your chips." "On our GPU, the bottleneck's actually thermals. You can't really run a GPU at more than around 50% of what it could theoretically do, or it'll melt." "So we're using a new technology today called low-voltage inference to try to solve this problem. You bring the voltage of the chip down dramatically, which allows us to have way, way better efficiency in terms of how much power is drawn per unit of math, and thus fit way way more flops onto the chip..." "For decode, it's all about bandwidth. Not just bandwidth on a chip, but bandwidth across your cluster. That's why we have this technology we call cluster-scale memory. It reduces the amount of time it takes to communicate from one chip to another dramatically." "As a result we can go use all of our HBM, HBM bandwidth, SRAM, SRAM bandwidth, and our scale-up domain as a single coherent pool. And that means if you're a user, you can go get much faster tokens per second, while still keeping your costs low."

TBPN

20,404 次观看 • 1 个月前

2025 #지훈 챌린지 & 릴스 모음💝 00:00 sticky 00:16 샹하이 로맨스 00:40 Boom Boom Base (remix ver.) 01:01 오늘만 I LOVE YOU 01:30 💥💥💥 01:44 Make A Wish 02:20 뱅(Bang) ! 02:39 Kiss Kiss Shy Shy 02:52 wall🪼❤️‍🔥 03:07 🍉🍓🍊👌 03:24 Sweet Dreams 03:52 Lucifer 04:21 WE LIKE 2 PARTY 04:51 かわいいだけじゃだめですか? 05:08 Ayo 05:36 BEBE 05:56 NIN 06:10 Come on!⚡️ 06:24 GO 지훈🎉 GO 지훈🥳 06:40 🪼💸 07:07 BANDIT 07:32 KNOW ABOUT ME 07:53 뭘봐 08:15 Cool & hot 08:38 SOURPATCH 08:55 Chains 09:24 이뻐이뻐 09:55 행복 10:22 move like that🎵 10:40 Shake It To The Max✌️ 10:52 boy for the 42🩵 11:08 JIHOON Calling📞 11:13 I Feel Good 11:34 HANDS UP 12:12 ROCKSTAR 12:36 Thunder 12:59 Bad Desire 13:17 시끄러!! 13:26 Touch It🪼 13:43 good vibes☀️ 13:52 Killin' It Girl 14:16 ECHO! 14:41 🚘🕶️ 14:56 Buzzin💭 15:07 FAMOUS 15:18 빌려온 고양이 15:35 Domino 15:51 The Blue Sun 16:07 POP 16:32 シュガ リード ライブ 16:52 훈제란즈✌️✌️ 17:02 되고파 너의 17:17 🪼vs🪼 17:34 before sleep 🛌 17:44 Walk Like👟 17:54 🌼 18:02 Barbie Girl 18:11 HOWL 18:23 Tempo 18:43 🪼🔄 18:52 Dougie🤙 19:10 What You Want 19:37 😎😎 19:51 Bang🪼 19:58 ✌️✌️ 20:10 EZ 20:29 M.O. 20:55 I‘m right here 💐 21:12 산책 21:24 body 21:42 SPAGHETTI 22:15 Blue Valentine 22:50 Hollywood Action 23:17 BURNING UP 23:40 하얀 그리움 24:20 Break your legs👟 24:29 Let‘s 🪩 24:47 Talk to You 25:16 My Body 25:37 MISMATCH 26:02 Do you wanna dance?🎵 26:12 🦾 26:41 All I Want for Christmas Is You 26:58 Hmm🕶️ 27:08 ˏ₍⸜̠̇⸝̠̇₎ˎ ̀⁽⸌̠̇⸍̠̇⁾ ́ˏ₍⸜̠̇⸝̠̇₎ˎ ̀⁽⸌̠̇⸍̠̇⁾ ́ 27:22 You like it? 27:28 락 (樂) 27:48 Love Shot

🏝️

102,961 次观看 • 7 个月前

내가 보려고 모은 #조이 역대 브릿지 파트 모음.zip (Ice Cream Cake~Sweet Dreams) 💚 * 레드벨벳 앨범만 포함했습니다 00:00 Somethin Kinda Crazy 00:05 Take It Slow 00:13 사탕 (Candy) 00:20 Dumb Dumb 00:22 Campfire 00:31 Lady’s Room 00:33 Day 1 00:43 Coold World 00:51 My Dear 00:55 Bad Dracula 00:58 Happily Ever After 01:03 빨간 맛 (Red Flavor) 01:09 여름빛 (Mojito) 01:13 I Just 01:17 Kingdom Come 01:23 두 번째 데이트 (My Second Date) 01:27 Attaboy 01:36 Perfect 10 01:42 달빛소리 01:53 Bad Boy 01:59 Time To Love 02:09 #Cookie Jar 02:13 Aitai-tai 02:20 Power Up 02:23 한 여름의 크리스마스 (With You) 02:30 Mr.E 02:35 Mosquito 02:41 RBB (Really Bad Boy) 02:47 So Good 02:51 멋있게 (Sassy Me) 02:54 Swimming Pool 02:57 Sayonara 03:04 짐살라빔 (Zimzalabim) 03:12 Sunny Side Up! 03:16 Milkshake 03:21 친구가 아냐 (Bing Bing) 03:29 안녕, 여름 (Parade) 03:32 LP 03:41 음파음파 (Umpah Umpah) 03:48 카풀 (Carpool) 03:57 Love Is The Way 04:05 Jumpin’ 04:11 눈 맞추고, 손 맞대고 (Eyes Locked, Hand Locked) 04:17 Psycho 04:24 In & Out 04:34 Remember Forever 04:44 Milky Way 04:52 Queendom 05:00 Pose 05:07 Knock On Wood 05:15 Better Be 05:25 Feel My Rhythm 05:29 Rainbow Halo 05:36 Beg For Me 05:43 In My Dreams 05:48 Marionette 05:50 WILDSIDE 05:54 Jackpot 06:00 Snap Snap 06:08 ‘Cause it’s you 06:14 Color of Love 06:16 Birthday 06:19 BYE BYE 06:22 롤러코스터 (On A Ride) 06:29 Zoom 06:40 Celebrate 06:48 Chill Kill 06:56 Knock Knock (Who’s There?) 06:59 Nightmare 07:03 One Kiss 07:10 Wings 07:21 풍경화 (Scenery) 07:32 Sunflower 07:38 Love Arcade 07:44 Bubble 07:51 Night Drive 07:57 Sweet Dreams

맑음쨩 🍏

20,678 次观看 • 1 年前

E133: Sam Blackshear - How Libra Sparked the Move Language and Why Sui Is the Real Endgame! Sam Blackshear is the Co-founder and CTO of MystenLabs.sui , the company behind the Sui, and the Creator of the Move programming language that's revolutionizing smart contract development. Timestamps: 0:00 Introduction 1:54 Partnerships: Jupiter, KAST (old), , Sui, Mantle, Forza! BTC 2:44 The Power of Preparation 5:14 Discipline Behind the Podcast 6:27 Translating Thought Into Code 8:19 Who is Sam Blackshear? 9:27 Choosing What Truly Matters 10:25 Self-Custody with Trezor 11:18 Crypto vs. AI Thinking 12:28 The Power of Support 16:04 From Court Dreams to Reality 17:55 Challenging the Limits of Code 22:52 Chose Learning Over a Job 24:09 The Internship That Changed Everything 27:35 PhD Skills Meet Facebook 29:05 Entering Crypto Through Facebook 32:15 Why Libra Needed Move 33:42 Solving Scarcity in Code 36:37 Bitcoin & Ethereum Mistakes 38:45 Creating a New Language 41:41 Problem-Driven Innovation 44:47 Avoiding Analysis Paralysis 48:11 What is Unstructured Thinking? 50:50 Why Unstructured Thinking Works 53:14 Future of Crypto Protocols 54:21 Why Move is the Best Programming Language 55:00 What is the Sui Network? 56:25 What Makes Sui Different? 57:05 Why is Sui The Best Blockchain? 59:05 Managing Energy Long-Term 1:01:02 Satisfaction Without Closure 1:03:37 90% Love, 10% Grind 1:05:37 Mental State of Surfing 1:06:47 Non-Consensus Beliefs 1:07:34 What is Memory Safety? 1:09:07 What Was the Equifax Hack? 1:10:53 Rethinking Software Safety 1:12:00 Right Dose of Regulation 1:13:00 Biggest Prediction for the Next 24 Months? 1:14:02 Scaling Crypto Developers 1:16:07 Concluding Remarks

MR SHIFT 🦁

164,280 次观看 • 1 年前

Steph Ango (kepano) is a designer, entrepreneur, and the CEO of Obsidian. In this episode, we discussed his journey from creating Winamp skins to leading Obsidian, and the fundamental patterns and inclinations that drive everything he explores and makes. We discussed Obsidian on multiple different dimensions, his deluxe chocolate chip cookie recipe, his exploration through furniture design, and his default inclination to push “too far” into anything he is exploring. Steph Ango demo'd the design process of several furniture projects he’s been working on at home as well as a custom piano learning app he created to teach himself music theory. This is a conversation about craftsmanship, pursuing a deep understanding, and what that reveals about who we are. The Other Stuff is hosted by internetVin — filmmaker, entrepreneur, and possibly the most curious man on Earth. Produced by New. The Other Stuff #28 — Kepano: The Interconnectedness of Everything — Timestamps 00:03:55 Origin of Kepano 00:10:34 Relationship with Computers 00:15:25 Online Communities & Video Games 00:30:47 Winamp Skins 00:40:04 Uniformity in Design 00:51:05 Obsidian 00:59:20 Bidirectional Linking, And The Relationship Between Everything 01:23:18 Obsidian Sync, Publish, and Bases 01:32:06 Why File Over App 01:43:15 The Deluxe Chocolate Chip Cookie Taste Test 01:49:48 Living Fully 02:09:50 Early Project Walkthrough 02:19:03 Furniture Design Walkthrough 02:49:00 Constraint and Patterns 02:58:47 Kepiano 03:13:00 The Future of AI and Startups 03:31:10 Closing

The Other Stuff Podcast

71,626 次观看 • 8 个月前

#명재현 댄스 챌린지 모음 zip 00:00 Candy 00:26 특 00:51 # menow 01:20 최애의 아이 01:36 NIGHT DANCER 01:57 Seven 02:21 Cream Soda 02:47 RINDAMAN 03:23 In Bloom 03:41 ALOHA 04:12 해금 04:29 Killin' Me Good 04:56 Bubble 05:19 블루체크 05:36 Ready or Not 05:49 Perfume 06:04 겐토 06:29 ビートDEトーヒ 07:00 3D 07:41 Worth It 07:52 B.O.M.B 08:28 첫 눈 08:43 War Cry 08:58 Perfect Night 09:37 Like I Do 09:48 Honey 10:05 DASH 10:27 Standing Next To You 10:46 Hype Boy 11:13 첫 만남은 계획대로 되지 않아 11:41 사랑스러워 12:07 때깔 12:22 Legit 12:51 Water 13:04 Two of Hearts 13:12 EASY 13:32 Smoke Remix 14:09 TAP 14:46 Martini Blue 15:03 BODY 15:26 PICK IT UP 15:41 LIGHTHOUSE 16:00 EENIE MEENIE 16:22 Nectar 16:45 C'est La Vie 17:07 쩔어 17:26 꿈빛 파티시엘 17:56 Impossible 18:14 포켓몬 18:29 SWEAT 18:51 빠나나날라 19:41 SPOT! 20:05 포철고 20:28 빛 20:56 MAESTRO 21:21 Girls Never Die 21:45 KICK IT 22:12 Armageddon 22:39 Taxi Blurr 23:00 Nothin' on You 23:20 Feel the POP 23:39 Shooting Star 24:00 진격의 방탄 24:16 ZOMBIE 24:30 LIKE THAT 24:45 ABCD 25:01 Boom Boom Bass 25:16 Yo Bunny 25:31 BADVILLAIN 25:51 올드스쿨 뉴스쿨 26:08 Supernatural 26:31 How Sweet 27:08 내일에서 기다릴게 27:31 Peaches 27:46 GOOD SO BAD 28:13 별별별 28:41 CRAZY 29:03 슈퍼슈퍼 29:32 껌 29:52 I Need A Girl 30:14 SAD SONG 30:32 네모네모 30:51 옴브리뉴 31:12 반가워, 나의 첫사랑 31:33 혀끝 32:00 Hit the Floor 32:16 기억사탕 32:34 Cherish

91,257 次观看 • 1 年前