Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

🟢 News: GPU compute in the browser is finally real. WebGPU now ships by default in Chrome, Firefox, Safari, and Edge—not a polyfill, not behind a flag. You can run LLMs client-side. Transformers.js and ONNX Runtime already ship WebGPU backends. Eight years of spec work. No more asterisks. 🔗...

12,762 görüntüleme • 5 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Free NVIDIA GPU with 16 GB VRAM GPU for Running Local LLMs! If you want to master local LLMs but you're waiting until you can afford a $1,500 GPU, you're honestly not going to make it. The open source AI ecosystem is moving way too fast for you to wait on your budget to catch up. Especially when you can build a bleeding edge inference engine from scratch right now, completely for free. You don't need a heavy local rig to start. Google is literally letting you use an enterprise grade NVIDIA Tesla T4 GPU for $0/hour. At standard cloud computing rates (~$0.20/hr), Google Colab’s 4 hour daily free tier hands you roughly $24 worth of data center tier GPU compute every single month. And most people just waste it. Let’s talk about the hardware you get access to for free. The NVIDIA Tesla T4 is an absolute workhorse: - Architecture: NVIDIA Turing (TU104) - VRAM: 16GB GDDR6 (320 GB/s bandwidth) - Compute: 320 Tensor Cores | 2560 CUDA Cores - Performance: 130 TOPS INT8 | 8.1 TFLOPS FP32 - Power: Sipping energy at a max 70W TDP This is the exact same hardware I used to run DeepMind's Gemma 4 26B A4B QAT MoE at a 250,000 context window without a single Out Of Memory (OOM) crash. If you have a web browser and 10 minutes, you have everything you need. I’ve put together a fully documented, cell by cell Google Colab notebook that teaches you exactly how to do this. Here is what the notebook actually teaches you: - How to provision an Ubuntu Linux environment with CUDA 13.0 and verify your driver stack. - How to pull the source code and compile the latest llama.cpp C++ binaries from scratch, specifically optimizing the build for your exact GPU using the -DCMAKE_CUDA_ARCHITECTURES=native flag. - How to directly download quantized local LLMs (GGUF format) straight from HuggingFace using the CLI. - How to manage 16GB VRAM limits, offload neural network layers to the GPU, and push massive context windows. Compile raw llama.cpp, ollama run a model, or spin up the LM Studio CLI. Pick whatever stack you are comfortable with. just start building. No hardware. No credit card. No excuses. Bookmark this post right now so you don't lose the tutorial. Even if you don't have time to run it today, you are going to want this workflow in your engineering toolkit. The link to the free Colab Notebook is in the comments below. Lemme know if you need more tutorials like this.

Alok

174,987 görüntüleme • 14 gün önce

$IREN "we haven't disclosed the specific amount of GPUs" 1. 🤮 reminds me of $NBIS 2. Setting a terrible precedent here for future deals 3. Making it purposely difficult, to not let analysts properly value your 2027 revenue 4. Increasing the polarized view on IREN by the market However: "approximately 60MW of air-cooled Blackwells" 1. You typically don't talk about gross capacity in a deployment like this 2. If it would be gross capacity, the GPU hour rate at IT level would be crazy high (at PUE 1.2, $680m / 50 = 13.6m/MW) 3. At 60MW IT load, and ~14kW draw at DGX server level, we can get to ~4,286 DGX systems with 8 GPUs per. 4. Based on this we can conclude that 60MW of IT load can run approximately 34k DGX B300. 5. 34k DGX B300 at $680m/yr, would represent a GPU hour price of $2.28 Now this is the problem with not disclosing your GPU quantity. You purposely make your business model look bad, because by approach, you get to a GPU hour price that would imply a payback period of 4 years, where only the last year of the contract is 100% margin. But of course, we can also take "the glass is half full" approach. IREN has ordered 50K B300s from Dell. They have 2 purchase orders for this, 1 between Dell Canada and IE CA Leasing Ltd for 4 phases, and 1 between Dell USA and IE US Hardware 1 Inc (amended from IE US Hardware 4 Inc on April 27, 2026). The order for Canada is divided in 4 phases, and are going to Mackenzie for 80MW of gross capacity, which happens to be 4 buildings of 20MW. The order for Childress is divided in 2 phases, and are going to DC35 and DC36, (as depicted in the earnings presentation) and those are 50MW gross. The purchase price of the order for Childress was $1.2B, and for Canada it was $2.3B If we go with 50,000 B300s for a total of $3.5B then $1.2 would represent 34.285% of the 50,000 GPUs, or 17,140 B300s rounded down. For this calculation I will consider that $IREN will deploy 17,140 GPUs in 50MW gross capacity in DC35 and DC36 of block 3 in Childress.. That would imply at 1.2 PUE, IREN can run 17,140 B300s in 41.67MW IT load. Now by that ratio, they can run 24,680 GPUs in 60MW IT load — a massive difference with 34k units through the Nvidia DGX reference calculation. If common sense is applied, you can still get to 2 completely different outcomes, that show a difference of more than 9k GPUs. The GPU hour rate at 24.68k GPUs would be $3.145 per B300, as MASSIVE difference from the earlier calculated $2.28. Sure, the DGX system may be a factor here. And I'm sure that the reality is somewhere in the middle. But I personally hate this as an investor, to be unable to calculate profitability on unit economic basis. After all, contracts are signed on a $/GPU hour basis. Why hide this from your investors? Not being able to calculate payback periods, unable to calculate ROIC. And most importantly, we cannot properly assess the $NVDA deal on a contract basis. I really hope the payback period of this contract is not 4 years. I want the glass to be half full, but by starting to censor the purchases, IREN is taking a step in the wrong direction. Not a fan of this.

Frans Bakker

146,717 görüntüleme • 2 ay önce

The Visual Studio Code insiders version that just shipped and will ship in the next few days will come with an insane amount of new capabilities. A few highlights: - You can now run sub-agents in parallel. Yes, really. I even attached a video. - Major UX improvements for sub agents, especially visible in the chat window - A new search tool wrapped as a sub-agent that iteratively runs multiple search tools: semantic_search, file_search, grep_search Which connects nicely to the point above: multiple searches running in parallel, efficiently and fast - Anthropic’s Message API is now enabled by default - You can choose the model for the cloud agent (three available, all premium) - Extended thinking support when using the Claude cloud agent This is part of the broader multi-vendor cloud support under AgentsHQ I wrote about a few weeks ago - Tasks sent to the background agent (basically the CLI tool) now always run in isolation, each with its own git worktree - In a multi-repo workspace, assigning a task to a cloud agent prompts you to choose the target repo Same behavior when opening an empty workspace with no repo - Support for building an external index for files not supported by GitHub’s default indexing - UI/UX improvements for starting new sessions and switching between local / background / cloud agents - Skills are now first-class citizens, just like prompt files, with better UX indicating when a skill is loaded - Improved API for dynamic contribution of prompt files New V2 includes skills as part of the model. Curious to see the extensions that will leverage this - Finally, initial support for showing context usage percentage per session - Skills are enabled by default - Resizable chat window and session view. Small thing, but it was driving me crazy 😁 - A new integrated browser meant to replace the old simple browser Maybe the beginning of real browser use? - Better UI/UX for token streaming in chat - Ability to index external files not supported by GitHub There’s a lot more. Some of it hasn’t fully landed yet, but everything that has is already in Insiders. The next stable release should drop in early February. As usual, I’m just shocked by the volume of features this team ships every month. After the holiday slowdown, this one is shaping up to be a wild release.

Oren Melamed

29,555 görüntüleme • 6 ay önce

OptimAI Lite Node v1.1: Built for Scale, Designed for You! 💕 In just 2 weeks since the launch, the OptimAI Network has seen explosive growth—130,000+ active node participants powering the future of decentralized AI. With this incredible momentum came a new challenge: ensuring our network could scale seamlessly to support massive concurrent connections and real-time participation. That’s why we’ve rolled out OptimAI Lite Node v1.1—a major upgrade focused on: + Stabilizing infrastructure to handle high traffic from a global community. + Enhancing performance for smoother data mining, validation, and edge compute participation. + Refining user experience with UI updates that make contributing effortless. Every line of code and infrastructure upgrade was made with one goal in mind: to support YOU—the builders, validators, and visionaries of the OptimAI ecosystem. Now’s the time to bring more friends into the journey. 🔥 The more we grow, the smarter and stronger the network becomes—and the greater the rewards. Let’s keep building, validating, scaling. Together we’re not just powering AI—we’re reshaping how it’s built. Join or revisit the node here: 🌐 Chrome Extension: 📱Telegram Mini-App: What’s Coming Next: OptimAI Edge Node & the Rise of Agentic AI 🔸OptimAI Edge Node (Mobile) We’re working hard on the next major release: the Edge Node for mobile, which will allow mining and AI tasks to run in the background—unlocking more earning opportunities and decentralized compute power from your smartphones. 🔸More Task Types & Missions Expect new types of contributions, from AI-enhanced data validation to edge inference and scraping automation—powered by autonomous mining agents. 🔸Expanded Rewards Program As we grow, more reward tiers, bonuses, and campaigns will be introduced. Your participation now paves the way for long-term benefits. Also, do not forget to checkout our article below and learn more about our latest Community Tips & Best Practices!👇 __________________ OptimAI Network #L2 #DePIN Reinforcement Data Network for #Agentic #AI Mine Data. Fuel AI. Earn Rewards. Turn Your Data into Tomorrow’s AI #Agent. Visit our website at:

OptimAI Network

76,401 görüntüleme • 1 yıl önce

SEVEN RTX 3090S IN A WATER TANK FOR AI SERVER it is a private AI server with the power bill moved into your room. not a clean Mac mini. not a quiet box under a monitor. loose vertical GPUs sit inside a transparent tank. bubbles rise through distilled water. ALLIED CONTROL is printed on the side. it looks closer to a lab accident than a normal workstation. but the logic is obvious: seven RTX 3090s = seven 24GB cards. that is the used-market shortcut for people who want local inference without paying cloud tax on every run. put Ollama, llama.cpp, vLLM, Open WebUI, Tailscale, Qwen, DeepSeek, or Llama on top. now the box can handle client files, code agents, scraping jobs, evals, transcription, and boring overnight work. not because it beats frontier cloud models. because it changes the bill shape. no rate limit. no per-token anxiety. no sensitive client context leaving the building. no monthly stack quietly turning into rent. the ugly part is physical. seven 3090s can pull serious power, dump serious heat, and punish lazy cooling. distilled water is the weird visual, not a setup tip. real immersion rigs live or die on coolant chemistry, insulation, pumps, maintenance, and whether the room can handle the heat. local AI PCs are becoming less like gaming builds and more like small private data centers. the early question is not: can it run ChatGPT? it is: what work is repetitive, private, expensive in the cloud, and worth owning in hardware?

kocer

577,120 görüntüleme • 3 gün önce