Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

⚡️ We just added support for Nvidia G4 (RTX Pro 6000 Blackwell Server Edition) GPUs in Colaboratory! 🔥 With a peak rating of 960 BF16 TFLOPs (~50% more than the A100-80G) and 96 GB of VRAM (20% more than the A100-80G), it’s the most efficient high-performance GPU we’ve ever... show more

Colaboratory

72,246 subscribers

62,384 Aufrufe • vor 5 Monaten •via X (Twitter)

Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

245 tokens/sec on DeepSeek-V4-Flash and it’s only using 2 RTX 6000 Blackwell GPUs. tinycorp dropped a 2-GPU tinybox edition in honor of DeepSeek fully ready to expand to 4 GPUs later. The GPU middle class just got a serious upgrade.

245 tokens/sec on DeepSeek-V4-Flash and it’s only using 2 RTX 6000 Blackwell GPUs. tinycorp dropped a 2-GPU tinybox edition in honor of DeepSeek fully ready to expand to 4 GPUs later. The GPU middle class just got a serious upgrade.

Md Ismail Šojal 🕷️

16,148 Aufrufe • vor 11 Tagen

What’s in sarah guo's bag? The ultimate robotics brain. 🧠 NVIDIA Jetson AGX Thor, packing up to 2,070 FP4 TFLOPS of AI compute and 128 GB of memory. Power next generation humanoids and autonomous systems with real-time reasoning and server class performance, built for the lab, factory, and field. Learn more 👉

What’s in sarah guo's bag? The ultimate robotics brain. 🧠 NVIDIA Jetson AGX Thor, packing up to 2,070 FP4 TFLOPS of AI compute and 128 GB of memory. Power next generation humanoids and autonomous systems with real-time reasoning and server class performance, built for the lab, factory, and field. Learn more 👉

NVIDIA Robotics

92,342 Aufrufe • vor 13 Tagen

> 8 GPUs in one server rig > dude went homeless to build it > electrical bill costs more than rent now > while everyone else pays $400/month to openai > a 2 GPU desktop kills the api bill forever > rtx 4080 super + rtx 5060 ti = 32gb vram > runs qwen 3.6 with 100k context locally > no rate limits, no api keys, no data leaving the room > agents loop 400 times for free > claude opus still wins on hard reasoning > but local handles 90% of daily work > $1,200 setup pays itself off in 4 months > bookmark this and read the article below

> 8 GPUs in one server rig > dude went homeless to build it > electrical bill costs more than rent now > while everyone else pays $400/month to openai > a 2 GPU desktop kills the api bill forever > rtx 4080 super + rtx 5060 ti = 32gb vram > runs qwen 3.6 with 100k context locally > no rate limits, no api keys, no data leaving the room > agents loop 400 times for free > claude opus still wins on hard reasoning > but local handles 90% of daily work > $1,200 setup pays itself off in 4 months > bookmark this and read the article below

starmex

167,058 Aufrufe • vor 2 Monaten

🔥🔥🔥We’ve been listening to your feedback! Our latest world model HY-World 1.5 just got a major upgrade to make world generation more accessible than ever: 🛠️ Open Training Code: Fully customizable code for building and training your own models. ⚡ Accelerated Inference: Turbocharged speed and optimized VRAM for real-time interaction. 📉 Lite 5B Model: A new lightweight model that fits into small-VRAM GPUs. 🙌 Zero Waitlist: Our online app is now fully open to everyone—no application required. This is just the beginning. HY-World is building the future of spatial intelligence—open, accessible, and community-driven. 🕹️ Play now: ⭐ GitHub:

🔥🔥🔥We’ve been listening to your feedback! Our latest world model HY-World 1.5 just got a major upgrade to make world generation more accessible than ever: 🛠️ Open Training Code: Fully customizable code for building and training your own models. ⚡ Accelerated Inference: Turbocharged speed and optimized VRAM for real-time interaction. 📉 Lite 5B Model: A new lightweight model that fits into small-VRAM GPUs. 🙌 Zero Waitlist: Our online app is now fully open to everyone—no application required. This is just the beginning. HY-World is building the future of spatial intelligence—open, accessible, and community-driven. 🕹️ Play now: ⭐ GitHub:

Tencent Hy

20,581 Aufrufe • vor 7 Monaten

⬛️ We are currently accelerating the incubation of GPU Nodes into the infraX Network, with 12 H100’s currently available for operation. Despite the incubation of such immense GPU power, the infraX Platform is optimally designed to run on the least amount of computational power possible, meaning a lot of our available GPU nodes are currently sitting idle. Currently, we're utilising a single gigantic NVIDIA H100 server with 80GB of VRAM and over 220GB of RAM to run our Platform. To put that in perspective, it rivals the computational power of an adult human brain. This setup enables us to handle immense computational load and deliver high-quality AI content to our users, however we have much more in store. Our remaining, immense network of GPU units is currently being prepared for rental operations as we look to transform the corporate GPU lending sphere through our corporate GPU lending protocol. We already have many high tier Web3 Players ready for technical integration, with more approaching us daily. Through our V3 DApp we look to make these integrations publicly viewable with real time usage graphs integrated directly into our Platform, allowing for exceedingly unique viewing opportunities. $INFRA

⬛️ We are currently accelerating the incubation of GPU Nodes into the infraX Network, with 12 H100’s currently available for operation. Despite the incubation of such immense GPU power, the infraX Platform is optimally designed to run on the least amount of computational power possible, meaning a lot of our available GPU nodes are currently sitting idle. Currently, we're utilising a single gigantic NVIDIA H100 server with 80GB of VRAM and over 220GB of RAM to run our Platform. To put that in perspective, it rivals the computational power of an adult human brain. This setup enables us to handle immense computational load and deliver high-quality AI content to our users, however we have much more in store. Our remaining, immense network of GPU units is currently being prepared for rental operations as we look to transform the corporate GPU lending sphere through our corporate GPU lending protocol. We already have many high tier Web3 Players ready for technical integration, with more approaching us daily. Through our V3 DApp we look to make these integrations publicly viewable with real time usage graphs integrated directly into our Platform, allowing for exceedingly unique viewing opportunities. $INFRA

infraX | $INFRA

42,843 Aufrufe • vor 1 Jahr

Ball Swap! 🏀🔥 Groups start with one more ball than the amount of people. Challenge groups to make the most swaps in a row! For more information on educational visits, CPD and much more, visit and get in touch!

Ball Swap! 🏀🔥 Groups start with one more ball than the amount of people. Challenge groups to make the most swaps in a row! For more information on educational visits, CPD and much more, visit and get in touch!

WannaTeachPE

22,377 Aufrufe • vor 1 Jahr

13 months after we reached 500k, we’ve just hit 600k! Honestly can say I am enjoying what we’re producing more than ever, the team behind the scenes is the strongest it’s ever been and I get a good feeling about what’s next for United. Thank you all for helping me make the best community I could have ever dreamed of x

13 months after we reached 500k, we’ve just hit 600k! Honestly can say I am enjoying what we’re producing more than ever, the team behind the scenes is the strongest it’s ever been and I get a good feeling about what’s next for United. Thank you all for helping me make the best community I could have ever dreamed of x

Sam Peoples

41,089 Aufrufe • vor 2 Monaten

We just closed the largest AI agent pre-sale ever. 76,831 Sol in under 36 hours. This historic raise shows Web3 needs proven builders. With a track record of creating virtual humans since 2018, delivering for top-tier brands and sustaining real revenue, we can’t wait to continue delivering on this vision. We’re grateful for the support. It’s more than we ever expected and more than we need. That’s why we’re returning 50% to everyone who contributed. • Refunds will be issued within 24 hours. • Launch this week. We will use the remaining 50% to support the launch, provide liquidity, pay listing fees (if any), and continue to build this project out long term. As we finalize next steps, we’re proud to share an early look at what we’ve been building:

We just closed the largest AI agent pre-sale ever. 76,831 Sol in under 36 hours. This historic raise shows Web3 needs proven builders. With a track record of creating virtual humans since 2018, delivering for top-tier brands and sustaining real revenue, we can’t wait to continue delivering on this vision. We’re grateful for the support. It’s more than we ever expected and more than we need. That’s why we’re returning 50% to everyone who contributed. • Refunds will be issued within 24 hours. • Launch this week. We will use the remaining 50% to support the launch, provide liquidity, pay listing fees (if any), and continue to build this project out long term. As we finalize next steps, we’re proud to share an early look at what we’ve been building:

MIRAI

252,184 Aufrufe • vor 1 Jahr

Run Gemma 4 26B MoE on 8GB VRAM with 250k context at 20+ tokens/sec If you own any 8GB VRAM graphics card, stop what you are doing. Local AI just had its absolute "Holy Shit" moment for budget hardware. Yesterday, I benchmarked Unsloth Gemma 4 12B Q4_K_XL on an 8GB card. The community went wild but immediately demanded more: "Can we run a 25B+ model on budget GPUs?" Today, I’m delivering exactly that. I am running a massive 26B parameter Mixture of Experts (MoE) model locally on a standard 8GB VRAM setup with 250k full native context!. If you own an RTX 3060, 3070, 4060, or any budget GPU with 8GB of VRAM, the local AI paradigm has completely changed. The performance metrics are astonishing: - 20 tokens/sec flat decode throughput. - Stable, flat decode speed even with massive prompts. - I threw a 60k token prompt at it, and it still clocked in at 20 TPS without dropping a single frame. # What about prefill? Yes, Time To First Token (TTFT) is slightly high when swallowing massive contexts. But with a solid 200 tokens/sec prefill speed, the wait is barely noticeable and highly usable. And this is running completely without Multi Token Prediction (MTP) active. How is this possible? It’s the magic of Google's new QAT (Quantization Aware Training) quants for Gemma 4. The model weight file (unsloth gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf) is only 13.2 GB, making it the ultimate local powerhouse. # The Test Setup: CPU: Intel Core i7 RAM: 16GB System RAM GPU: NVIDIA GeForce RTX 4060 Laptop GPU (8GB VRAM) # The Secret Sauce (The -cmoe Flag) To make this work properly on any 8GB card, you must use the -cmoe (CPU MoE) flag in llama.cpp. This flag isolates the heavy MoE expert weights directly to system memory (CPU/RAM) while letting your GPU focus strictly on the Attention layers and the KV Cache. It prevents VRAM spillage and holds the throughput rock solid. # The flags: -m "gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf" -cmoe -c 248000 -v Once running, just open the UI on localhost and toggle the new reasoning lightbulb icon in the text input box to watch the model perform multi step thinking. Are you still running smaller models, or are you ready to scale up your budget local setups? Let's discuss in the replies

Run Gemma 4 26B MoE on 8GB VRAM with 250k context at 20+ tokens/sec If you own any 8GB VRAM graphics card, stop what you are doing. Local AI just had its absolute "Holy Shit" moment for budget hardware. Yesterday, I benchmarked Unsloth Gemma 4 12B Q4_K_XL on an 8GB card. The community went wild but immediately demanded more: "Can we run a 25B+ model on budget GPUs?" Today, I’m delivering exactly that. I am running a massive 26B parameter Mixture of Experts (MoE) model locally on a standard 8GB VRAM setup with 250k full native context!. If you own an RTX 3060, 3070, 4060, or any budget GPU with 8GB of VRAM, the local AI paradigm has completely changed. The performance metrics are astonishing: - 20 tokens/sec flat decode throughput. - Stable, flat decode speed even with massive prompts. - I threw a 60k token prompt at it, and it still clocked in at 20 TPS without dropping a single frame. # What about prefill? Yes, Time To First Token (TTFT) is slightly high when swallowing massive contexts. But with a solid 200 tokens/sec prefill speed, the wait is barely noticeable and highly usable. And this is running completely without Multi Token Prediction (MTP) active. How is this possible? It’s the magic of Google's new QAT (Quantization Aware Training) quants for Gemma 4. The model weight file (unsloth gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf) is only 13.2 GB, making it the ultimate local powerhouse. # The Test Setup: CPU: Intel Core i7 RAM: 16GB System RAM GPU: NVIDIA GeForce RTX 4060 Laptop GPU (8GB VRAM) # The Secret Sauce (The -cmoe Flag) To make this work properly on any 8GB card, you must use the -cmoe (CPU MoE) flag in llama.cpp. This flag isolates the heavy MoE expert weights directly to system memory (CPU/RAM) while letting your GPU focus strictly on the Attention layers and the KV Cache. It prevents VRAM spillage and holds the throughput rock solid. # The flags: -m "gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf" -cmoe -c 248000 -v Once running, just open the UI on localhost and toggle the new reasoning lightbulb icon in the text input box to watch the model perform multi step thinking. Are you still running smaller models, or are you ready to scale up your budget local setups? Let's discuss in the replies

Alok

292,770 Aufrufe • vor 2 Monaten

A week ago, we launched the OptimAI Core Node. Today, the numbers speak for themselves; but the story behind them speaks even louder. More than 3,000 active Core Nodes now power the OptimAI Network: + 43,831 CPU cores + 75,289 GB RAM + Over 1,000 GPUs spanning NVIDIA, AMD, Intel, Apple, and more Together, they form a distributed AI supercomputer - built not by a corporation, but by the community. This is how the future of Agentic AI begins: AI that learns from live data, reasons across the open web, and evolves through human collaboration. We’re not just running nodes. We’re building the backbone of decentralized intelligence. 👉Join the movement:

A week ago, we launched the OptimAI Core Node. Today, the numbers speak for themselves; but the story behind them speaks even louder. More than 3,000 active Core Nodes now power the OptimAI Network: + 43,831 CPU cores + 75,289 GB RAM + Over 1,000 GPUs spanning NVIDIA, AMD, Intel, Apple, and more Together, they form a distributed AI supercomputer - built not by a corporation, but by the community. This is how the future of Agentic AI begins: AI that learns from live data, reasons across the open web, and evolves through human collaboration. We’re not just running nodes. We’re building the backbone of decentralized intelligence. 👉Join the movement:

OptimAI Network

20,649 Aufrufe • vor 9 Monaten

There is nothing more valuable than your time. And yet it is time that most goes to waste. Money can’t give you more time. But money can get you the time of others. And that time is worth much much more than most folks are being compensated in exchange for it. You can’t get that time back. The majority believing there is little value for their time is part of how those who do assign high value to their own time keep their control. Time is a real resource. Money is a social construct. One of the two is much more valuable. But what do I know, I’m just a silly girl with hand puppets.

There is nothing more valuable than your time. And yet it is time that most goes to waste. Money can’t give you more time. But money can get you the time of others. And that time is worth much much more than most folks are being compensated in exchange for it. You can’t get that time back. The majority believing there is little value for their time is part of how those who do assign high value to their own time keep their control. Time is a real resource. Money is a social construct. One of the two is much more valuable. But what do I know, I’m just a silly girl with hand puppets.

Liz Katz

45,099 Aufrufe • vor 14 Tagen

🚨 Nexar just had a makeover… and it’s nothing short of revolutionary. We didn’t just improve our swap aggregator. We rebuilt it from the ground up to give traders what they’ve been missing. 🔥 2,000+ Tokens: A massive expansion of trading options. 🔥 7 Active Liquidity Providers: Deeper liquidity, tighter spreads, and best prices. 🔥 Auto Route Selection: The smart engine finds the most efficient path instantly. 🔥 Manual Route Control – For the pros who want to optimize their swaps themselves. 🔥 Refund Guarantee: If your swap fails, your funds come right back. No losses. 🔥 Fresh New Design: Intuitive, fast, and built for serious trading. 🔥 USD Value Display: Know exactly what your swap is worth in real-time. This isn’t just a new version. It’s the future of aggregation. More tokens. More liquidity. More security. More control. With this upgrade, Nexar isn’t competing with other aggregators. It’s leaving them behind. 🚀 Welcome to the most powerful swap aggregator in DeFi. Welcome to

🚨 Nexar just had a makeover… and it’s nothing short of revolutionary. We didn’t just improve our swap aggregator. We rebuilt it from the ground up to give traders what they’ve been missing. 🔥 2,000+ Tokens: A massive expansion of trading options. 🔥 7 Active Liquidity Providers: Deeper liquidity, tighter spreads, and best prices. 🔥 Auto Route Selection: The smart engine finds the most efficient path instantly. 🔥 Manual Route Control – For the pros who want to optimize their swaps themselves. 🔥 Refund Guarantee: If your swap fails, your funds come right back. No losses. 🔥 Fresh New Design: Intuitive, fast, and built for serious trading. 🔥 USD Value Display: Know exactly what your swap is worth in real-time. This isn’t just a new version. It’s the future of aggregation. More tokens. More liquidity. More security. More control. With this upgrade, Nexar isn’t competing with other aggregators. It’s leaving them behind. 🚀 Welcome to the most powerful swap aggregator in DeFi. Welcome to

Privix

16,758 Aufrufe • vor 10 Monaten

Run Gemma 4 26b MTP on 8 GB VRAM GPUs at 25+ tokens/second. Flags included! local llm space is moving at terminal velocity. only 3 days ago google released gemma 4 26b a4b qat quants. more efficient than before, ran on 8gb vram at 20 tok/sec. and now just a few hours ago, mainline llama.cpp merged a massive update and we just shattered our own record. decode throughput went 25-40% up on the same 8 GB VRAM setup! Before MTP: 20 tps -> After MTP: 28 tps! llama.cpp just officially merged PR #23398 ("add Gemma4 MTP"), bringing native Multi-Token Prediction (MTP) support to Gemma 4 models. By running speculative drafting on the same 8GB VRAM RTX 4060 setup, my decode throughput on a 64k context instantly leaped to a blistering 25–27 tokens/sec thats 25-30% increase with the same hardware. Here is the architectural catch you need to know: Unlike the Qwen 3.5 and 3.6 series, which bake the MTP heads directly into the base GGUF, the Gemma 4 MTP head is not built in. You must download a separate, specialized MTP drafter GGUF (the assistant model) to act as the speculator. (I've dropped the download link in the replies). copy and try the exact flags: -m gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf --spec-type draft-mtp --spec-draft-n-max 6 --spec-draft-p-min 0.7 --spec-draft-model gemma-4-26b-A4B-it-assistant-Q4_0.gguf -c 64000 -v n-max 4 and p-min 0.7 is also worth checking out. benchmark on your setup and workflow. if you have a single 8 gb vram nvidia rtx 4060, 3060, 3070, 2080, 2070, grab the MTP drafter GGUF link in the comments and try it yourself. Check it out even if you have asmaller or a larger gpu, such as a single rtx 3090, 4090, 3060, 2060. MTP works for all gemma 4 sizes such as gemma 4 12b, gemma 4 31b etc. but remember to grab the correct mtp draft assistant models respectively. what are you benchmarking today

Run Gemma 4 26b MTP on 8 GB VRAM GPUs at 25+ tokens/second. Flags included! local llm space is moving at terminal velocity. only 3 days ago google released gemma 4 26b a4b qat quants. more efficient than before, ran on 8gb vram at 20 tok/sec. and now just a few hours ago, mainline llama.cpp merged a massive update and we just shattered our own record. decode throughput went 25-40% up on the same 8 GB VRAM setup! Before MTP: 20 tps -> After MTP: 28 tps! llama.cpp just officially merged PR #23398 ("add Gemma4 MTP"), bringing native Multi-Token Prediction (MTP) support to Gemma 4 models. By running speculative drafting on the same 8GB VRAM RTX 4060 setup, my decode throughput on a 64k context instantly leaped to a blistering 25–27 tokens/sec thats 25-30% increase with the same hardware. Here is the architectural catch you need to know: Unlike the Qwen 3.5 and 3.6 series, which bake the MTP heads directly into the base GGUF, the Gemma 4 MTP head is not built in. You must download a separate, specialized MTP drafter GGUF (the assistant model) to act as the speculator. (I've dropped the download link in the replies). copy and try the exact flags: -m gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf --spec-type draft-mtp --spec-draft-n-max 6 --spec-draft-p-min 0.7 --spec-draft-model gemma-4-26b-A4B-it-assistant-Q4_0.gguf -c 64000 -v n-max 4 and p-min 0.7 is also worth checking out. benchmark on your setup and workflow. if you have a single 8 gb vram nvidia rtx 4060, 3060, 3070, 2080, 2070, grab the MTP drafter GGUF link in the comments and try it yourself. Check it out even if you have asmaller or a larger gpu, such as a single rtx 3090, 4090, 3060, 2060. MTP works for all gemma 4 sizes such as gemma 4 12b, gemma 4 31b etc. but remember to grab the correct mtp draft assistant models respectively. what are you benchmarking today

Alok

200,913 Aufrufe • vor 2 Monaten

🚨 NVIDIA just flipped the entire AI game… and this is NOT about gaming. DeepSeek-V4-Pro is now live on their build platform. 1.6 TRILLION parameters. Yes… the largest open-source model on the planet right now. And here’s the crazy part: They’re letting you run it FREE On Blackwell GPUs in the cloud. This is the same level of hardware companies like Google, Meta, and Microsoft fight billions to access. Now it’s just… available. No waitlist. No insane setup. Just raw power. We’re watching the shift happen in real time: → From closed AI → open domination → From GPU scarcity → free access → From Big Tech control → builders winning This isn’t an update. It’s a warning shot. Who’s already testing this? Link👇

🚨 NVIDIA just flipped the entire AI game… and this is NOT about gaming. DeepSeek-V4-Pro is now live on their build platform. 1.6 TRILLION parameters. Yes… the largest open-source model on the planet right now. And here’s the crazy part: They’re letting you run it FREE On Blackwell GPUs in the cloud. This is the same level of hardware companies like Google, Meta, and Microsoft fight billions to access. Now it’s just… available. No waitlist. No insane setup. Just raw power. We’re watching the shift happen in real time: → From closed AI → open domination → From GPU scarcity → free access → From Big Tech control → builders winning This isn’t an update. It’s a warning shot. Who’s already testing this? Link👇

divyansh tiwari

29,941 Aufrufe • vor 3 Monaten

Tokenized US Treasuries have exceeded $7B in TVL for the first time, and are hitting milestones faster than ever. It took stablecoins five years to reach this scale. Tokenized Treasuries got there in less than three. Ondo is driving much of this growth with the most widely-held tokenized Treasury assets, capturing over 80% of all asset holders in the category, according to We've already onboarded more than $1.25B in capital. But the future of RWAs is just getting started.

Tokenized US Treasuries have exceeded $7B in TVL for the first time, and are hitting milestones faster than ever. It took stablecoins five years to reach this scale. Tokenized Treasuries got there in less than three. Ondo is driving much of this growth with the most widely-held tokenized Treasury assets, capturing over 80% of all asset holders in the category, according to We've already onboarded more than $1.25B in capital. But the future of RWAs is just getting started.

Ondo Finance

44,760 Aufrufe • vor 1 Jahr