Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I spent my summer building TinyTPU : An open source ML inference and training chip. it can do end to end inference + training ENTIRELY on chip. here's how I did it👇:

suryasure05's profile picture

surya

3,498 subscribers

354,929 Aufrufe • vor 10 Monaten •via X (Twitter)

Gesundheit & WellnessWissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA
1:31

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA

Yukang Chen

58,301 Aufrufe • vor 1 Monat

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering
27:58

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 Aufrufe • vor 3 Monaten

Long video generation is a systems problem. Introducing LongLive-2.0 from NVIDIA Research: an end-to-end NVFP4 training and inference system for long video generation. Low-precision deployment often relies on post-training quantization, creating a gap between how models are trained and how they run. LongLive-2.0 aligns NVFP4-aware training, distillation, and W4A4 inference, maintaining strong benchmark quality while improving speed and memory efficiency.
0:59

Long video generation is a systems problem. Introducing LongLive-2.0 from NVIDIA Research: an end-to-end NVFP4 training and inference system for long video generation. Low-precision deployment often relies on post-training quantization, creating a gap between how models are trained and how they run. LongLive-2.0 aligns NVFP4-aware training, distillation, and W4A4 inference, maintaining strong benchmark quality while improving speed and memory efficiency.

NVIDIA AI

60,445 Aufrufe • vor 1 Monat

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.
0:47

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.

The Linux Foundation

32,930 Aufrufe • vor 1 Jahr

ELON: TESLA FUTURE'S HINGES ON THE AI5 CHIP PROJECT "The AI5 chip, which is going to be a great chip, all of Tesla hinges on that chip. That's the chip that is going into our next generation of self-driving cars, and it's also essential for the Optimus robot. So that chip program was in bad shape. It wasn't closing because it's quite an ambitious chip design, and it really wasn't on a path to success. And then we also had the Dojo program, which was doing okay but not on a path to be competitive with NVIDIA. So I collapsed the two programs into just one program, which is to get everyone focused on the AI5 chip, which is essential. Continue to use NVIDIA for training, but we need the AI5 inference chip, which is a very powerful chip, but it's also a very low-power chip. So it doesn't use a lot of power. Its performance per watt is extremely good. I think it's probably going to be at least 2 to 4 times better than NVIDIA performance per watt at the inference level in the car and the robot. And I don't know, 10% of the cost of an NVIDIA chip, something like that. So these are very important numbers to achieve." Source: Elon Musk, Baron Capital, Ron Baron, Tesla
2:09

ELON: TESLA FUTURE'S HINGES ON THE AI5 CHIP PROJECT "The AI5 chip, which is going to be a great chip, all of Tesla hinges on that chip. That's the chip that is going into our next generation of self-driving cars, and it's also essential for the Optimus robot. So that chip program was in bad shape. It wasn't closing because it's quite an ambitious chip design, and it really wasn't on a path to success. And then we also had the Dojo program, which was doing okay but not on a path to be competitive with NVIDIA. So I collapsed the two programs into just one program, which is to get everyone focused on the AI5 chip, which is essential. Continue to use NVIDIA for training, but we need the AI5 inference chip, which is a very powerful chip, but it's also a very low-power chip. So it doesn't use a lot of power. Its performance per watt is extremely good. I think it's probably going to be at least 2 to 4 times better than NVIDIA performance per watt at the inference level in the car and the robot. And I don't know, 10% of the cost of an NVIDIA chip, something like that. So these are very important numbers to achieve." Source: Elon Musk, Baron Capital, Ron Baron, Tesla

Mario Nawfal

225,142 Aufrufe • vor 7 Monaten

Watch and listen to this video carefully to the end. Imagine I made Dwayne Johnson say absolutely EVERYTHING I wanted in less than 5 minutes. And anyone can do the same. Here's how I did it: OPEN THIS ↓
0:39

Watch and listen to this video carefully to the end. Imagine I made Dwayne Johnson say absolutely EVERYTHING I wanted in less than 5 minutes. And anyone can do the same. Here's how I did it: OPEN THIS ↓

FELIX

134,147 Aufrufe • vor 1 Jahr

Recently, Evan lin designed an open-source TPU (from scratch). With Instachip, YOU can "pip install" Evan's TinyTPU into your own project! How? Check it out 👇
0:51

Recently, Evan lin designed an open-source TPU (from scratch). With Instachip, YOU can "pip install" Evan's TinyTPU into your own project! How? Check it out 👇

Sathvik Redrouthu

24,444 Aufrufe • vor 1 Jahr

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!
0:29

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!

Eric Zhang

22,085 Aufrufe • vor 5 Monaten

If you're curious how I managed to do over $20,000 in inference on the last 48 hours, here's a video all about it. Spoiler: loops are really powerful
24:44

If you're curious how I managed to do over $20,000 in inference on the last 48 hours, here's a video all about it. Spoiler: loops are really powerful

Theo - t3.gg

332,539 Aufrufe • vor 21 Tagen

Our first open-source release. YOLO26-MLX, native YOLO26 on Apple Silicon. No PyTorch. No external GPU. Up to 2.6x faster inference. Up to 1.7x faster training. Accuracy within 0.2% of official results. It won't be the last.
2:31

Our first open-source release. YOLO26-MLX, native YOLO26 on Apple Silicon. No PyTorch. No external GPU. Up to 2.6x faster inference. Up to 1.7x faster training. Accuracy within 0.2% of official results. It won't be the last.

webAI

96,990 Aufrufe • vor 3 Monaten

I built an open source TPU chip in 4 days 8x8 systolic array, 16 instruction ISA, 64 MACs/cycle all in ~3,400 lines of SystemVerilog I sent it to Tiny Tapeout for fabrication soon here's the full arch
0:33

I built an open source TPU chip in 4 days 8x8 systolic array, 16 instruction ISA, 64 MACs/cycle all in ~3,400 lines of SystemVerilog I sent it to Tiny Tapeout for fabrication soon here's the full arch

Jaber

29,079 Aufrufe • vor 5 Monaten

Will Howard: “We did it, man.” A long embrace at the end with Chip Kelly.
1:03

Will Howard: “We did it, man.” A long embrace at the end with Chip Kelly.

Ross Dellenger

205,438 Aufrufe • vor 1 Jahr

After five days of training sessions, I FINALLY DID IT. UI Hidden and predicting Sigillum's HP to end with Ultimate finish. #wutheringwaves #wuwabattle
3:32

After five days of training sessions, I FINALLY DID IT. UI Hidden and predicting Sigillum's HP to end with Ultimate finish. #wutheringwaves #wuwabattle

Rexlent

169,224 Aufrufe • vor 1 Monat

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference
1:17

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference

Cerebras

128,577 Aufrufe • vor 2 Jahren

Vibe coded this customizable video game entirely with AI. You can add custom nano banana tiles and 3D models from Tripo. It's open sourced (repo at the end) and here's how it works 👇
0:27

Vibe coded this customizable video game entirely with AI. You can add custom nano banana tiles and 3D models from Tripo. It's open sourced (repo at the end) and here's how it works 👇

TechHalla

96,354 Aufrufe • vor 4 Monaten

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
1:30

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵

Google Magenta Project

111,830 Aufrufe • vor 1 Monat

I will never forget Roki’s contributions to the 2025 chip and how electric it was. Hope my man figures it out
1:00

I will never forget Roki’s contributions to the 2025 chip and how electric it was. Hope my man figures it out

Nate

49,949 Aufrufe • vor 3 Monaten

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:
0:34

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

Uomi

18,816 Aufrufe • vor 18 Tagen