Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Why rent GPUs on Hyperbolic? Get started in under a minute. Check out the full step-by-step tutorial and this week's prices: > H200 - $2.25/gpu/hr > H100 SXM - $1.50/gpu/hr > RTX 4090 - $0.40/gpu/hr > RTX 3080 - $0.20/gpu/hr > RTX 3070 - $0.16/gpu/hr

Hyperbolic

50,324 subscribers

19,659 просмотров • 1 год назад •via X (Twitter)

Финансы Наука и технологии Образование

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля Hyperbolic

Hyperbolic1 год назад

Become GPU rich by visiting Hyperbolic at

Фото профиля Quant Data

Quant Data1 год назад

🚨 $NVDA is down over 16% 🚨 Yesterday evening, we tweeted about the $25M in Puts being purchased on $NVDA. DeepSeek AI news came out and NVDA dropped $24 today. Want to see trades like this? Try our 7 day free trial at:

Фото профиля wincy.eth

wincy.eth1 год назад

this is cheaper than my morning coffee and does more for productivity! ppl need to think about it)

Фото профиля Hyperbolic

Hyperbolic1 год назад

💯💯

Фото профиля Hyperbolic

Hyperbolic1 год назад

@jesriley12 we appreciate you

Фото профиля Dip 𐤊∆₹m∆𐤊∆₹

Dip 𐤊∆₹m∆𐤊∆₹1 год назад

On a mission to make AI accessible for everyone. Lets make us GPU rich.

Фото профиля Hyperbolic

Hyperbolic1 год назад

GPU rich!

Фото профиля RONIN🀄️

RONIN🀄️1 год назад

This is real and important use case Nice work @hyperbolic_labs

Фото профиля Hyperbolic

Hyperbolic1 год назад

thank you

Фото профиля MD YOUSUF ALI 🌊

MD YOUSUF ALI 🌊1 год назад

Yeah why not ✅

Фото профиля Hyperbolic

Hyperbolic1 год назад

$1 free credit to use inference when signing up

Похожие видео

on-demand H100 for $0.99/hr, 4090 for $0.20/hr at Hyperbolic likely the cheapest GPUs around tell me what you're building, and I'll spot you free credits for an 8xH100 node for at least a few hours to start.

on-demand H100 for $0.99/hr, 4090 for $0.20/hr at Hyperbolic likely the cheapest GPUs around tell me what you're building, and I'll spot you free credits for an 8xH100 node for at least a few hours to start.

Yuchen Jin

190,705 просмотров • 1 год назад

We just launched On-Demand GPU Cloud at Hyperbolic! - H100s at $1.49/hr - reliable nodes with persistent storage - spin up a cluster of GPU nodes with Infiniband in just a few clicks Tell me what you're building. I'm giving out free credits to cool projects.

We just launched On-Demand GPU Cloud at Hyperbolic! - H100s at $1.49/hr - reliable nodes with persistent storage - spin up a cluster of GPU nodes with Infiniband in just a few clicks Tell me what you're building. I'm giving out free credits to cool projects.

Yuchen Jin

53,409 просмотров • 1 год назад

GPU GIVEAWAY Buy a GPU × GTC 2026 = Give a GPU > RTX PRO 6000 Blackwell > 96GB VRAM • NVFP4 > ~$15K value > Brand new If this does well I’ll ask NVIDIA for more GPUs next time… maybe even DGX Sparks How to enter? Short clip here Full clip in the replies GO GO GO

Ahmad

36,697 просмотров • 6 месяцев назад

Scale your AI inference, graphics, and analytics workloads with the GPU power to get you there. Amazon EC2 G7 instances are now generally available—accelerated by @NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, first on AWS.

Scale your AI inference, graphics, and analytics workloads with the GPU power to get you there. Amazon EC2 G7 instances are now generally available—accelerated by @NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, first on AWS.

Amazon Web Services

1,960,434 просмотров • 2 месяцев назад

STAGE 2.5 STARTED! I'm now officially a Prover My RTX 4090 is active and producing real-time proof in stage 2.5 of the Succinct testnet. Detailed information will be shared by Succinct soon. PLEASE do not rent a GPU before these announcements. You can check the document to understand the process and for more details: Thank you crashout

STAGE 2.5 STARTED! I'm now officially a Prover My RTX 4090 is active and producing real-time proof in stage 2.5 of the Succinct testnet. Detailed information will be shared by Succinct soon. PLEASE do not rent a GPU before these announcements. You can check the document to understand the process and for more details: Thank you crashout

CryptoMeii

14,887 просмотров • 1 год назад

Photon-traced caustics in Blender Cycles 💡 One click. No fakes, no tricks. Full disclosure. Henrik the dev reached out and gave me a free copy. Gotta say I'd buy it myself though. Single-GPU only for now. Captured on a RTX 4090 #b3d #blender #caustics

Photon-traced caustics in Blender Cycles 💡 One click. No fakes, no tricks. Full disclosure. Henrik the dev reached out and gave me a free copy. Gotta say I'd buy it myself though. Single-GPU only for now. Captured on a RTX 4090 #b3d #blender #caustics

Raphael Rau

35,145 просмотров • 4 дней назад

GPU tradeoff series: A100 is not much more powerful than 4090 🫠 GPU Perf and Price: - 4090: 330 fp16 TFLOPs, $1,749 - A100 (80GB): 312 fp16 TFLOPs, $20,000 > A100 is 11.4X more pricy Training speed for GPT-2(124M) with llm.c: - 4090: 153K tokens/s - A100 (80GB): 195K tokens/s > A100 is only 1.3X faster (both trained using a single card, A100 llm.c training is shown in the video, 4090 video is in the quoted tweet) Conclusion: 4090 has a much better cost vs performance ratio Why: As in the H100 vs. 4090 comparison, the biggest difference between A100 and 4090 is their GPU memory size/bandwidth and cross-GPU communication bandwidth, which does not matter too much if your model can fit into a single 4090. Specs: 4090: - GPU memory size: 24GB - memory bandwidth: 1 TB/s - communication bandwidth: 64 GB/s A100: - GPU memory size: 80GB - memory bandwidth: 2 TB/s - communication bandwidth: 900 GB/s Nvidia killed off NVLink (a high-speed communication link that connects GPUs) on 4090. (Jensen Huang smiling face) If multiple 4090s could be interconnected via NVLink, their performance would be closer to datacenter-grade A100 GPUs, even for training larger models. Additionally, 4090 isn't allowed in datacenters, that's how Nvidia makes 💰💰💰

GPU tradeoff series: A100 is not much more powerful than 4090 🫠 GPU Perf and Price: - 4090: 330 fp16 TFLOPs, $1,749 - A100 (80GB): 312 fp16 TFLOPs, $20,000 > A100 is 11.4X more pricy Training speed for GPT-2(124M) with llm.c: - 4090: 153K tokens/s - A100 (80GB): 195K tokens/s > A100 is only 1.3X faster (both trained using a single card, A100 llm.c training is shown in the video, 4090 video is in the quoted tweet) Conclusion: 4090 has a much better cost vs performance ratio Why: As in the H100 vs. 4090 comparison, the biggest difference between A100 and 4090 is their GPU memory size/bandwidth and cross-GPU communication bandwidth, which does not matter too much if your model can fit into a single 4090. Specs: 4090: - GPU memory size: 24GB - memory bandwidth: 1 TB/s - communication bandwidth: 64 GB/s A100: - GPU memory size: 80GB - memory bandwidth: 2 TB/s - communication bandwidth: 900 GB/s Nvidia killed off NVLink (a high-speed communication link that connects GPUs) on 4090. (Jensen Huang smiling face) If multiple 4090s could be interconnected via NVLink, their performance would be closer to datacenter-grade A100 GPUs, even for training larger models. Additionally, 4090 isn't allowed in datacenters, that's how Nvidia makes 💰💰💰

Yuchen Jin

234,951 просмотров • 1 год назад

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Min Choi

464,141 просмотров • 1 год назад

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

elvis

261,622 просмотров • 2 лет назад

There's a free, open-source music generator that claims to land between Suno v4.5 and Suno v5 in quality, and it'll run locally on a GPU with under 4GB of VRAM. It's called ACE-Step 1.5. → Free to try instantly, no GPU, no install → Generates a full song in under 10 seconds on a regular RTX 3090 → Train it on your own sound: feed it about 8 of your own songs and it learns your style as a LoRA in about an hour Paste a genre and mood, get back a finished song with vocals, in any of 50+ languages.

There's a free, open-source music generator that claims to land between Suno v4.5 and Suno v5 in quality, and it'll run locally on a GPU with under 4GB of VRAM. It's called ACE-Step 1.5. → Free to try instantly, no GPU, no install → Generates a full song in under 10 seconds on a regular RTX 3090 → Train it on your own sound: feed it about 8 of your own songs and it learns your style as a LoRA in about an hour Paste a genre and mood, get back a finished song with vocals, in any of 50+ languages.

Simplifying AI

15,832 просмотров • 9 дней назад

#Battlefield6 NVIDIA DLSS 4 Reveal Trailer 📽️ The game includes support for DLSS 4 with Multi Frame Generation, DLSS Frame Generation, DLSS Super Resolution, DLAA, and NVIDIA Reflex. Desktop GPUs Performance At 4K, Ultra settings, DLSS 4 with Multi Frame Generation and DLSS Super Resolution multiply Battlefield 6's GeForce RTX 50 Series frame rates by an average of 3.8X. ▪️ GeForce RTX 5090 performance rockets to over 470 FPS. ▪️ GeForce RTX 5080 exceeds 330 FPS. ▪️ GeForce RTX 5070 Ti is in touching distance of 300 FPS. ▪️ GeForce RTX 5070 surpasses 230 FPS. At 2560x1440, Ultra settings, DLSS 4 with Multi Frame Generation and DLSS Super Resolution increase Battlefield 6 frame rates by an average of 3X. ▪️ GeForce RTX 5090 runs at almost 600 FPS. ▪️ GeForce RTX 5060 Ti over 240 FPS. At 1920x1080, Ultra settings, the combination of DLSS 4 with Multi Frame Generation and DLSS Super Resolution boost Battlefield 6’s GeForce RTX 50 Series frame rates by an average of 2.9X. ▪️ Allowing every GPU in NVIDIA's line-up to play at over 230 FPS, maxing out at over 740 FPS on the GeForce RTX 5090. Laptop GPUs Performance GeForce RTX 50 Series Laptop GPUs benefit similarly from DLSS 4 with Multi Frame Generation and DLSS Super Resolution, with Battlefield 6 frame rates multiplied by 3X on average at 2560x1600, with Ultra settings, enabling performance of up to 360 FPS. At 1920x1080, Ultra settings, GeForce RTX 50 Series Laptop GPU performance increases by 2.8X on average, enabling Battlefield 6 frame rates to surpass 480 FPS, and the range to run at over 200 frames per second.

#Battlefield6 NVIDIA DLSS 4 Reveal Trailer 📽️ The game includes support for DLSS 4 with Multi Frame Generation, DLSS Frame Generation, DLSS Super Resolution, DLAA, and NVIDIA Reflex. Desktop GPUs Performance At 4K, Ultra settings, DLSS 4 with Multi Frame Generation and DLSS Super Resolution multiply Battlefield 6's GeForce RTX 50 Series frame rates by an average of 3.8X. ▪️ GeForce RTX 5090 performance rockets to over 470 FPS. ▪️ GeForce RTX 5080 exceeds 330 FPS. ▪️ GeForce RTX 5070 Ti is in touching distance of 300 FPS. ▪️ GeForce RTX 5070 surpasses 230 FPS. At 2560x1440, Ultra settings, DLSS 4 with Multi Frame Generation and DLSS Super Resolution increase Battlefield 6 frame rates by an average of 3X. ▪️ GeForce RTX 5090 runs at almost 600 FPS. ▪️ GeForce RTX 5060 Ti over 240 FPS. At 1920x1080, Ultra settings, the combination of DLSS 4 with Multi Frame Generation and DLSS Super Resolution boost Battlefield 6’s GeForce RTX 50 Series frame rates by an average of 2.9X. ▪️ Allowing every GPU in NVIDIA's line-up to play at over 230 FPS, maxing out at over 740 FPS on the GeForce RTX 5090. Laptop GPUs Performance GeForce RTX 50 Series Laptop GPUs benefit similarly from DLSS 4 with Multi Frame Generation and DLSS Super Resolution, with Battlefield 6 frame rates multiplied by 3X on average at 2560x1600, with Ultra settings, enabling performance of up to 360 FPS. At 1920x1080, Ultra settings, GeForce RTX 50 Series Laptop GPU performance increases by 2.8X on average, enabling Battlefield 6 frame rates to surpass 480 FPS, and the range to run at over 200 frames per second.

Battlefield Bulletin

30,559 просмотров • 10 месяцев назад

Revolutionizing Access to #GPU Power - One Node at a Time.⚡️ Our 10th Utility is coming out on June 20.🚨 BIG GPU Nodes Platform isn’t just another name in the crowded GPU cloud services space, we’re a game-changer. Our platform is purpose-built to bridge the gap between server owners and those hungry for raw, high-performance computing power. 🖥️ We specialize in connecting suppliers from individual server owners to enterprise-scale GPU rig operators with consumers who demand serious horsepower for AI, machine learning, data science, and other compute-heavy applications. Whether you’re offering a sleek single-GPU setup or a massive mining-style array with multiple GPUs, BIG GPU Nodes is your launchpad. We make it simple to rent out underutilized GPU resources and just as easy for users to find exactly what they need — fast, affordable, and tailored to their workload.⛓️‍💥 This is more than cloud computing. This is decentralized GPU power for the future of innovation. ♾️ This product will generate revenue and we will give back to our loyal $CNCT holders. ✨ We’re proud to have MESSIER | M87 as our trusted partner and advisor, backing us with this vision. #M87 🤝 $CNCT From the very beginning, we promised you ONE BIG ECOSYSTEM, and a seamless space where everything you need comes together. Now, that vision is becoming reality. Millions of users will soon be connected, working, creating, and thriving within it. 🌍

Revolutionizing Access to #GPU Power - One Node at a Time.⚡️ Our 10th Utility is coming out on June 20.🚨 BIG GPU Nodes Platform isn’t just another name in the crowded GPU cloud services space, we’re a game-changer. Our platform is purpose-built to bridge the gap between server owners and those hungry for raw, high-performance computing power. 🖥️ We specialize in connecting suppliers from individual server owners to enterprise-scale GPU rig operators with consumers who demand serious horsepower for AI, machine learning, data science, and other compute-heavy applications. Whether you’re offering a sleek single-GPU setup or a massive mining-style array with multiple GPUs, BIG GPU Nodes is your launchpad. We make it simple to rent out underutilized GPU resources and just as easy for users to find exactly what they need — fast, affordable, and tailored to their workload.⛓️‍💥 This is more than cloud computing. This is decentralized GPU power for the future of innovation. ♾️ This product will generate revenue and we will give back to our loyal $CNCT holders. ✨ We’re proud to have MESSIER | M87 as our trusted partner and advisor, backing us with this vision. #M87 🤝 $CNCT From the very beginning, we promised you ONE BIG ECOSYSTEM, and a seamless space where everything you need comes together. Now, that vision is becoming reality. Millions of users will soon be connected, working, creating, and thriving within it. 🌍

Fixera AI

26,682 просмотров • 1 год назад

GLM 5.2 in pi running at almost 100 tokens/sec on 8x H200. I really like this model. It feels a frontier-level model you can actually self-host. Next step: squeeze more out of it by benchmarking different quants, tuning the stack, and figuring out the minimum GPU setup people can realistically run it on. Expect more on this soon.

GLM 5.2 in pi running at almost 100 tokens/sec on 8x H200. I really like this model. It feels a frontier-level model you can actually self-host. Next step: squeeze more out of it by benchmarking different quants, tuning the stack, and figuring out the minimum GPU setup people can realistically run it on. Expect more on this soon.

Atharva Ingle

26,742 просмотров • 2 месяцев назад

Kimi K2.5 is now live on GPU-accelerated endpoints for free prototyping, so you can quickly start building with a frontier-scale multimodal model instead of just reading about it. Want to get started? We’ve got you: • Step-by-step tutorial • Ready-to-run GitHub notebook • First inference in minutes, not hours 📖 All available in the technical blog →

Kimi K2.5 is now live on GPU-accelerated endpoints for free prototyping, so you can quickly start building with a frontier-scale multimodal model instead of just reading about it. Want to get started? We’ve got you: • Step-by-step tutorial • Ready-to-run GitHub notebook • First inference in minutes, not hours 📖 All available in the technical blog →

NVIDIA AI Developer

108,727 просмотров • 6 месяцев назад

I won an RTX 5090 GPU at Mistral AI worldwide hackathon in Paris, and I have absolutely no idea on how to use it. Here's what I actually built: an image generation model fine-tuned to do technical analysis on trading charts. I trained it on an NVIDIA cloud GPU then back-tested it against Binance historical data. The model was profitable. The jury didn't quite catch the vibe. But apparently someone did because two weeks later, they reached out to tell me I'd won the NVIDIA track. Today, a €4,000 RTX Founders Edition showed up at my door. Absolutely gorgeous piece of hardware. One small problem: I use a MacBook. So if anyone has creative suggestions for what to do with a top-tier GPU and no desktop to put it in… I'm listening Huge thanks to NVIDIA, Mistral AI and Iterate team for appreciating my weird idea and an attempt to push tech to its boundaries

I won an RTX 5090 GPU at Mistral AI worldwide hackathon in Paris, and I have absolutely no idea on how to use it. Here's what I actually built: an image generation model fine-tuned to do technical analysis on trading charts. I trained it on an NVIDIA cloud GPU then back-tested it against Binance historical data. The model was profitable. The jury didn't quite catch the vibe. But apparently someone did because two weeks later, they reached out to tell me I'd won the NVIDIA track. Today, a €4,000 RTX Founders Edition showed up at my door. Absolutely gorgeous piece of hardware. One small problem: I use a MacBook. So if anyone has creative suggestions for what to do with a top-tier GPU and no desktop to put it in… I'm listening Huge thanks to NVIDIA, Mistral AI and Iterate team for appreciating my weird idea and an attempt to push tech to its boundaries

Kirill

52,513 просмотров • 4 месяцев назад

$0.05 PER KWH IN PARAGUAY VS $0.15 IN THE US, A 5,000 GPU FARM NEAR ASUNCION CLEARS $4.7M/MO ON VAST AI WHILE US OPERATORS NET $1.8M ON THE SAME RACK the warehouse in the clip is somewhere outside asuncion, multi story racks running floor to ceiling, the operator built it next to a hydroelectric dam where electricity costs 5 cents per kilowatt hour a US warehouse running the same 5,000 GPU rack burns through $1.6M a month in electricity at $0.15/kWh, the same rack in paraguay burns $530K, the gap is $1M of pure margin every 30 days the racks host RTX 4090s, A100s and H100s on vast ai and clore ai, indie AI startups and image generation services rent them by the hour because aws is rationing GPU access to fortune 500 a 4090 nets the US operator $500 to $1,000 a month, the paraguay operator clears $850 to $1,400 on the same card because power eats half what it does north of the equator bitfarms, riot and core scientific have all expanded into paraguay since 2024, the next 10,000 GPU AI farm coming online in 2026 is more likely to sit near a paraguayan dam than in texas bookmark this and read the article below

$0.05 PER KWH IN PARAGUAY VS $0.15 IN THE US, A 5,000 GPU FARM NEAR ASUNCION CLEARS $4.7M/MO ON VAST AI WHILE US OPERATORS NET $1.8M ON THE SAME RACK the warehouse in the clip is somewhere outside asuncion, multi story racks running floor to ceiling, the operator built it next to a hydroelectric dam where electricity costs 5 cents per kilowatt hour a US warehouse running the same 5,000 GPU rack burns through $1.6M a month in electricity at $0.15/kWh, the same rack in paraguay burns $530K, the gap is $1M of pure margin every 30 days the racks host RTX 4090s, A100s and H100s on vast ai and clore ai, indie AI startups and image generation services rent them by the hour because aws is rationing GPU access to fortune 500 a 4090 nets the US operator $500 to $1,000 a month, the paraguay operator clears $850 to $1,400 on the same card because power eats half what it does north of the equator bitfarms, riot and core scientific have all expanded into paraguay since 2024, the next 10,000 GPU AI farm coming online in 2026 is more likely to sit near a paraguayan dam than in texas bookmark this and read the article below

starmex

27,045 просмотров • 2 месяцев назад

Qwen3.6 35B-A3B dropped yesterday, so I ran it on 4 GPUs to see how it performs: 🟣 RTX 3090 — 49.78 tok/s, TTFT 852ms 🟡 RTX 4090 — 118.93 tok/s, TTFT 686ms 🟢 RTX 5090 — 160.37 tok/s, TTFT 409ms 🔵 DGX Spark — 59.98 tok/s, TTFT 228ms I went with ollama as the backend because honestly, it's the easiest way for most people to get started. One command, model pulled, done. I used Q4_K_M (24GB) across all four cards. The reason is the 3090 and 4090 don't support NVFP4 (only the 5090 and DGX Spark could use it). Keeping the same quant everywhere felt like the fairest way to compare. And yes, you can absolutely squeeze more performance out of every card with vLLM, SGLang, or TensorRT-LLM. But that's not what this test is about. This is just the out-of-the-box experience for folks who own a GPU and want to try the new model tonight.

Qwen3.6 35B-A3B dropped yesterday, so I ran it on 4 GPUs to see how it performs: 🟣 RTX 3090 — 49.78 tok/s, TTFT 852ms 🟡 RTX 4090 — 118.93 tok/s, TTFT 686ms 🟢 RTX 5090 — 160.37 tok/s, TTFT 409ms 🔵 DGX Spark — 59.98 tok/s, TTFT 228ms I went with ollama as the backend because honestly, it's the easiest way for most people to get started. One command, model pulled, done. I used Q4_K_M (24GB) across all four cards. The reason is the 3090 and 4090 don't support NVFP4 (only the 5090 and DGX Spark could use it). Keeping the same quant everywhere felt like the fairest way to compare. And yes, you can absolutely squeeze more performance out of every card with vLLM, SGLang, or TensorRT-LLM. But that's not what this test is about. This is just the out-of-the-box experience for folks who own a GPU and want to try the new model tonight.

stevibe

402,323 просмотров • 4 месяцев назад

MiniMax M2.7 is 230B params. Can you actually run it at home? I tested Unsloth's UD-IQ3_XXS (80GB) on 4 different rigs: 🟠 4x RTX 4090 (96GB): 71.52 tok/s, TTFT 1045ms 🟢 4x RTX 5090 (128GB): 120.54 tok/s, TTFT 725ms 🟡 1x RTX PRO 6000 (96GB): 118.74 tok/s, TTFT 765ms 🟣 DGX Spark (128GB) — 24.41 tok/s, TTFT 741ms Backend: llama.cpp. Context: 32k. Max tokens: 4096. I went with IQ3_XXS because it's the biggest quant that fits in 96GB VRAM while still leaving safe headroom for 32k context. Same quant across all four rigs, fairest comparison I could run. Now look at rough peak GPU power draw: 🟠 4x4090 → 1,800W peak (450W × 4) 🟢 4x5090 → 2,300W peak (575W × 4) 🟡 RTX PRO 6000 → 600W peak 🟣 DGX Spark → 240W peak (whole system) The RTX PRO 6000 is the quiet winner. One card, 96GB, matching a 4x5090 rig at roughly a quarter of the power and zero multi-GPU headaches. Best tokens-per-watt by a wide margin. DGX Spark is slow on generation but pulls the least power of any rig here, around 240W for the whole system. Prefill-friendly, memory-rich, wall-socket-friendly. And yes, plenty of people cap their cards. Even then, 4x 4090 or 4x 5090 still pulls well over 1,200W from the GPUs alone.

MiniMax M2.7 is 230B params. Can you actually run it at home? I tested Unsloth's UD-IQ3_XXS (80GB) on 4 different rigs: 🟠 4x RTX 4090 (96GB): 71.52 tok/s, TTFT 1045ms 🟢 4x RTX 5090 (128GB): 120.54 tok/s, TTFT 725ms 🟡 1x RTX PRO 6000 (96GB): 118.74 tok/s, TTFT 765ms 🟣 DGX Spark (128GB) — 24.41 tok/s, TTFT 741ms Backend: llama.cpp. Context: 32k. Max tokens: 4096. I went with IQ3_XXS because it's the biggest quant that fits in 96GB VRAM while still leaving safe headroom for 32k context. Same quant across all four rigs, fairest comparison I could run. Now look at rough peak GPU power draw: 🟠 4x4090 → 1,800W peak (450W × 4) 🟢 4x5090 → 2,300W peak (575W × 4) 🟡 RTX PRO 6000 → 600W peak 🟣 DGX Spark → 240W peak (whole system) The RTX PRO 6000 is the quiet winner. One card, 96GB, matching a 4x5090 rig at roughly a quarter of the power and zero multi-GPU headaches. Best tokens-per-watt by a wide margin. DGX Spark is slow on generation but pulls the least power of any rig here, around 240W for the whole system. Prefill-friendly, memory-rich, wall-socket-friendly. And yes, plenty of people cap their cards. Even then, 4x 4090 or 4x 5090 still pulls well over 1,200W from the GPUs alone.

stevibe

191,782 просмотров • 4 месяцев назад

Introducing KausaCompute. Running AI models privately is expensive and complicated. Traditional cloud providers require credit cards, KYC verification, and complex setup processes. For many developers, especially in emerging markets, accessing GPU compute remains out of reach. KausaCompute changes that. Deploy any Docker container with NVIDIA GPU, pay with USDC from Maze Pocket, no KYC, no credit card, no cloud provider account needed. GPU pricing starts at $0.47/hr with competitive rates across all tiers. KausaCompute lives inside KausaLayer Pocket. Open a pocket, swap SOL to USDC using the built-in swap feature, and start deploying GPU containers right away. Everything stays within one ecosystem. What it actually does: Private LLM endpoints. Deploy Llama 3, Mistral, CodeLlama, or any open-source model as a personal API. No one logs the prompts. No one reads the data. Full control. AI coding assistants that never see external servers. Speech-to-text processing for thousands of audio files in minutes instead of hours. Sentiment analysis across millions of data points. Document summarization at scale. Multi-modal AI that processes images and text together. All running on dedicated NVIDIA GPUs. A6000, T4, L4, L40, A100, H100, and more. Pick the hardware, pick the duration, deploy in one click. The billing is straightforward. USDC is deducted from Maze Pocket before deployment. Pro tip: Maze Pocket supports multiple pockets per wallet. Create a dedicated pocket just for KausaCompute to keep GPU spending separate from other activities like trading or transfers. Clean separation, easy tracking. KausaCompute is not another cloud provider. It is the fastest path from USDC to a running GPU, with zero identity requirements. Live now at

Introducing KausaCompute. Running AI models privately is expensive and complicated. Traditional cloud providers require credit cards, KYC verification, and complex setup processes. For many developers, especially in emerging markets, accessing GPU compute remains out of reach. KausaCompute changes that. Deploy any Docker container with NVIDIA GPU, pay with USDC from Maze Pocket, no KYC, no credit card, no cloud provider account needed. GPU pricing starts at $0.47/hr with competitive rates across all tiers. KausaCompute lives inside KausaLayer Pocket. Open a pocket, swap SOL to USDC using the built-in swap feature, and start deploying GPU containers right away. Everything stays within one ecosystem. What it actually does: Private LLM endpoints. Deploy Llama 3, Mistral, CodeLlama, or any open-source model as a personal API. No one logs the prompts. No one reads the data. Full control. AI coding assistants that never see external servers. Speech-to-text processing for thousands of audio files in minutes instead of hours. Sentiment analysis across millions of data points. Document summarization at scale. Multi-modal AI that processes images and text together. All running on dedicated NVIDIA GPUs. A6000, T4, L4, L40, A100, H100, and more. Pick the hardware, pick the duration, deploy in one click. The billing is straightforward. USDC is deducted from Maze Pocket before deployment. Pro tip: Maze Pocket supports multiple pockets per wallet. Create a dedicated pocket just for KausaCompute to keep GPU spending separate from other activities like trading or transfers. Clean separation, easy tracking. KausaCompute is not another cloud provider. It is the fastest path from USDC to a running GPU, with zero identity requirements. Live now at

KausaLayer

10,914 просмотров • 3 месяцев назад

AMD has the opportunity to make the price to performance king. RX 9070 XT will be miles better than RTX 5080 if priced appropriately. We know by now that FSR 4 is miles better than FSR 3.1 as shown in this video here (credit: Hardware Unboxed) With the right marketing and highlighting the performance and quality jump that these new GPUs have, I could see AMD gaining a lot of GPU market share.

AMD has the opportunity to make the price to performance king. RX 9070 XT will be miles better than RTX 5080 if priced appropriately. We know by now that FSR 4 is miles better than FSR 3.1 as shown in this video here (credit: Hardware Unboxed) With the right marketing and highlighting the performance and quality jump that these new GPUs have, I could see AMD gaining a lot of GPU market share.

NikTek

61,186 просмотров • 1 год назад