Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

New Demo: Connect any Hyperbolic GPU to a Colaboratory notebook using SSH tunneling with custom port selection. This demo guides you through setting up a Colab Local Runtime and running high-performance matrix multiplication directly on one of our H100 SXM instances. It's a great workflow for fine-tuning via Unsloth... show more

Hyperbolic

54,891 subscribers

22,639 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

11 Comments

Hyperbolic1 year ago

Thanks to @theamrelhady for the demo! Check out the full guide in our docs:

Hyperbolic1 year ago

Get started renting GPUs in < 1 min:

Rainmaker2 years ago

Here I share an XGBoost model that delivers a 25% CAGR with minimal drawdown on Visa stock. In this free Substack post I share code and commentary for a powerful Machine Learning strategy that delivers powerful returns.

JOELLY1 year ago

@GoogleColab Awesome job @theamrelhady

Hyperbolic1 year ago

@GoogleColab @theamrelhady agreed!

FoFan1 year ago

@GoogleColab You did amazing job team, that's why I bullish on you!

Hyperbolic1 year ago

@GoogleColab Bullish on him also

amin (Ø,G)1 year ago

@GoogleColab i’ve been looking for a way to boost my colab projects with some serious gpu power, and connecting to an h100 SXM through ssh tunneling sounds like a game changer.

Hyperbolic1 year ago

@GoogleColab Google x Hyperbolic, match made in heaven

Jimmy (Ø,G)1 year ago

@GoogleColab Hyperbolic just made Colab feel like a supercomputer lab

Hyperbolic1 year ago

@GoogleColab 💻💻

Related Videos

"I don’t have a GPU" is no longer an excuse 🤯 You can now train LLMs directly in VS Code using a free Google Colab runtime. → Connect any fine-tuning notebook to Colab → Train locally or on a free cloud GPU → Works with Unsloth

"I don’t have a GPU" is no longer an excuse 🤯 You can now train LLMs directly in VS Code using a free Google Colab runtime. → Connect any fine-tuning notebook to Colab → Train locally or on a free cloud GPU → Works with Unsloth

Alvaro Cintas

86,187 views • 4 months ago

Demo of Tether's QVAC running local inference on a mobile device at incredible speed, via llama.cpp + LLAMA 3.2 1B parameters. QVAC is a generalized inference and fine-tuning runtime able to adapt to any device, from smartphones, to laptops and servers. Lots of models being supported already. More to come. No limits. Infinite intelligence. Coming soon

Demo of Tether's QVAC running local inference on a mobile device at incredible speed, via llama.cpp + LLAMA 3.2 1B parameters. QVAC is a generalized inference and fine-tuning runtime able to adapt to any device, from smartphones, to laptops and servers. Lots of models being supported already. More to come. No limits. Infinite intelligence. Coming soon

Paolo Ardoino 🤖

42,015 views • 11 months ago

The quickest/simplest demo of running a microVM for claude on a Linux machine you own. Here I connect via the API or SSH to run commands. Also included cp, exec, and port-forwarding for syncing work and ralph loops.

The quickest/simplest demo of running a microVM for claude on a Linux machine you own. Here I connect via the API or SSH to run commands. Also included cp, exec, and port-forwarding for syncing work and ralph loops.

Alex Ellis

25,556 views • 5 months ago

Unsloth AI and NVIDIA are Revolutionizing Local LLM Fine-Tuning: From RTX Desktops to DGX Spark Fine-tune popular AI models faster with Unsloth on NVIDIA RTX AI PCs such as GeForce RTX desktops and laptops to RTX PRO workstations and the new DGX Spark to build personalized assistants for coding, creative work, and complex agentic workflows. The landscape of modern AI is shifting. We are moving away from a total reliance on massive, generalized cloud models and entering the era of local, agentic AI. Whether it is tuning a chatbot to handle hyper-specific product support or building a personal assistant that manages intricate schedules, the potential for generative AI on local hardware is boundless. However, developers face a persistent bottleneck: How do you get a Small Language Model (SLM) to punch above its weight class and respond with high accuracy for specialized tasks? The answer is Fine-Tuning, and the tool of choice is Unsloth. Unsloth provides an easy and high-speed method to customize models. Optimized for efficient, low-memory training on NVIDIA GPUs, Unsloth scales effortlessly from GeForce RTX desktops and laptop all the way to the DGX Spark, the world’s smallest AI supercomputer...... Full analysis: NVIDIA NVIDIA AI NVIDIA AIDev NVIDIAnewsroom Unsloth AI Unsloth

Unsloth AI and NVIDIA are Revolutionizing Local LLM Fine-Tuning: From RTX Desktops to DGX Spark Fine-tune popular AI models faster with Unsloth on NVIDIA RTX AI PCs such as GeForce RTX desktops and laptops to RTX PRO workstations and the new DGX Spark to build personalized assistants for coding, creative work, and complex agentic workflows. The landscape of modern AI is shifting. We are moving away from a total reliance on massive, generalized cloud models and entering the era of local, agentic AI. Whether it is tuning a chatbot to handle hyper-specific product support or building a personal assistant that manages intricate schedules, the potential for generative AI on local hardware is boundless. However, developers face a persistent bottleneck: How do you get a Small Language Model (SLM) to punch above its weight class and respond with high accuracy for specialized tasks? The answer is Fine-Tuning, and the tool of choice is Unsloth. Unsloth provides an easy and high-speed method to customize models. Optimized for efficient, low-memory training on NVIDIA GPUs, Unsloth scales effortlessly from GeForce RTX desktops and laptop all the way to the DGX Spark, the world’s smallest AI supercomputer...... Full analysis: NVIDIA NVIDIA AI NVIDIA AIDev NVIDIAnewsroom Unsloth AI Unsloth

Marktechpost AI Dev News ⚡

31,551 views • 6 months ago

The new Colaboratory bridges the gap between local environments and the cloud, providing a zero-friction execution platform for developers and AI agents alike. The CLI Supports: ⚡️ Agent-driven Colab workflows ⚡️ Instant GPU/TPU provisioning ⚡️ Remote script execution ⚡️ Interactive runtime access (console/REPL) Learn more in the blog:

The new Colaboratory bridges the gap between local environments and the cloud, providing a zero-friction execution platform for developers and AI agents alike. The CLI Supports: ⚡️ Agent-driven Colab workflows ⚡️ Instant GPU/TPU provisioning ⚡️ Remote script execution ⚡️ Interactive runtime access (console/REPL) Learn more in the blog:

Google for Developers

45,869 views • 17 days ago

"I don't have a GPU" is officially dead. VS Code now connects directly to Google Colab. → You get a free T4 GPU inside your editor. → Your local files. Their compute.

"I don't have a GPU" is officially dead. VS Code now connects directly to Google Colab. → You get a free T4 GPU inside your editor. → Your local files. Their compute.

Simplifying AI

618,268 views • 5 months ago

Impressive demo running on a single box The future of AI is local btw

Impressive demo running on a single box The future of AI is local btw

Ahmad

40,078 views • 1 month ago

🔥 We fine-tuned Gemma 3 using Unsloth AI on a custom instruction dataset scraped and built with . The model is now able to answer questions about OpenAI Agents SDK documentation. Check out the demo below👇

🔥 We fine-tuned Gemma 3 using Unsloth AI on a custom instruction dataset scraped and built with . The model is now able to answer questions about OpenAI Agents SDK documentation. Check out the demo below👇

Eric Ciarla (hiring)

28,794 views • 1 year ago

Slash AI costs by 99%, run 1000+ models on a single GPU! OpenLoRA lets you run thousands of models on one GPU instead of one per model, drastically cutting costs and boosting flexibility. Excited to work with Aethir, Hyperbolic for infrastructure and for verifiability. Watch the demo:

Slash AI costs by 99%, run 1000+ models on a single GPU! OpenLoRA lets you run thousands of models on one GPU instead of one per model, drastically cutting costs and boosting flexibility. Excited to work with Aethir, Hyperbolic for infrastructure and for verifiability. Watch the demo:

OpenLedger

155,267 views • 1 year ago

Custom Port Configuration Now Live on Hyperbolic’s GPU Marketplace After dozens of user interviews and feature requests, we’re launching something many of you have been asking for: Custom Port Configuration for GPU Instances is now available. This update gives you full control over how your applications communicate over the network. Whether you're running inference servers, custom APIs, full-stack apps, or specialized workflows, now you can expose the ports you need, directly from your instance. Thanks to Product Lead Kai Huang for the demo!

Custom Port Configuration Now Live on Hyperbolic’s GPU Marketplace After dozens of user interviews and feature requests, we’re launching something many of you have been asking for: Custom Port Configuration for GPU Instances is now available. This update gives you full control over how your applications communicate over the network. Whether you're running inference servers, custom APIs, full-stack apps, or specialized workflows, now you can expose the ports you need, directly from your instance. Thanks to Product Lead Kai Huang for the demo!

Hyperbolic

24,906 views • 1 year ago

Yesterday at Lugano Plan ₿ I presented a preview of Tether's Local AI development kit, privacy focused, powered by peer-to-peer technology 🍐🍐 Write the code once, and run everywhere, from a 40$ phone, to a flagship smartphone, from a laptop to a mainframe with many H100, from a smart fridge to a car entertainment system. Based on 🐻 Terher's AI SDK is extremely modular, it uses supports any model (Marian, Llama, ...) and loads/stores weights and fine-tuning data in P2P data structures. Open source once battle tested. Demo of a sample local and 100% private translation app working on any device 👇

Yesterday at Lugano Plan ₿ I presented a preview of Tether's Local AI development kit, privacy focused, powered by peer-to-peer technology 🍐🍐 Write the code once, and run everywhere, from a 40$ phone, to a flagship smartphone, from a laptop to a mainframe with many H100, from a smart fridge to a car entertainment system. Based on 🐻 Terher's AI SDK is extremely modular, it uses supports any model (Marian, Llama, ...) and loads/stores weights and fine-tuning data in P2P data structures. Open source once battle tested. Demo of a sample local and 100% private translation app working on any device 👇

Paolo Ardoino 🤖

127,841 views • 1 year ago

primis is the pricing layer for compute. we help builders access compute through one unified layer instead of dealing directly with fragmented providers, unstable pricing, and infra complexity. this is our Bags Hackathon demo submission.

primis is the pricing layer for compute. we help builders access compute through one unified layer instead of dealing directly with fragmented providers, unstable pricing, and infra complexity. this is our Bags Hackathon demo submission.

Khouba

45,073 views • 1 month ago

We're thrilled to announce that Hyperbolic has secured $20M in total funding with our Series A, led by Variant and Polychain Capital, to advance our mission of building verifiable, high-performance AI through an open, accessible ecosystem—making AI tools and services like compute and inference more affordable than ever. In this “AI Rainforest,” the future of AI is open, accessible, and thriving. Take your ideas Hyperbolic🌪️ at

We're thrilled to announce that Hyperbolic has secured $20M in total funding with our Series A, led by Variant and Polychain Capital, to advance our mission of building verifiable, high-performance AI through an open, accessible ecosystem—making AI tools and services like compute and inference more affordable than ever. In this “AI Rainforest,” the future of AI is open, accessible, and thriving. Take your ideas Hyperbolic🌪️ at

Hyperbolic

4,470,701 views • 1 year ago

🔥 Launching the Fireworks AI Experimentation Platform (GA) and Build SDK (Beta)🔥 Top AI teams don't win by chance - they win by running 10X more experiments than competitors. Launching early, collecting feedback, tuning and selecting models, running offline evals, and validating impact with product metrics in a fast, continuous cycle is critical to build successful AI products. But, the need to manage complex infrastructure, wait for GPUs, reconcile differences between training and serving, and maintain reliability, slow AI teams down. Now, with the Firework’s experimentation platform, experimenting with open models just got a whole lot easier. With the help of our brand-new Python SDK (in beta), you can: → Stop waiting for GPUs, fine-tune and deploy 1000s of models on a single GPU deployment using Multi-LoRA → Programmatically run large-scale fine-tuning experiments → Scale evals with fully managed and autoscaling GPU deployments Check out our blog post to learn more and see a demo of running 125 experiments in 3 minutes on a single deployment:

Fireworks AI

17,619 views • 1 year ago

First hands-on with Microsoft’s new Surface Laptop Ultra. Microsoft is clearly positioning this as a new class of creator and AI laptop, powered by new NVIDIA silicon with an RTX GPU built for local AI, creative workflows, and gaming. A few standout specs: -New NVIDIA chip with RTX GPU -Up to 1 petaflop of AI compute -Up to 128GB unified memory -15-inch mini-LED PixelSense Ultra touchscreen -3:2 aspect ratio -262 PPI -Up to 2,000 nits peak HDR brightness -Less than 18mm thick

First hands-on with Microsoft’s new Surface Laptop Ultra. Microsoft is clearly positioning this as a new class of creator and AI laptop, powered by new NVIDIA silicon with an RTX GPU built for local AI, creative workflows, and gaming. A few standout specs: -New NVIDIA chip with RTX GPU -Up to 1 petaflop of AI compute -Up to 128GB unified memory -15-inch mini-LED PixelSense Ultra touchscreen -3:2 aspect ratio -262 PPI -Up to 2,000 nits peak HDR brightness -Less than 18mm thick

Chubby♨️

65,993 views • 19 days ago

Here's a quick demo using the Claude desktop app, where we've configured MCP: Watch Claude connect directly to GitHub, create a new repo, and make a PR through a simple MCP integration. Once MCP was set up in Claude desktop, building this integration took less than an hour.

Here's a quick demo using the Claude desktop app, where we've configured MCP: Watch Claude connect directly to GitHub, create a new repo, and make a PR through a simple MCP integration. Once MCP was set up in Claude desktop, building this integration took less than an hour.

Alex Albert

260,230 views • 1 year ago

Gitlip Editors: Demo Launch 🌷 Gitlip is a collaborative coding platform, and today we’re launching the demo for Gitlip Editors - our take on collaborative coding environments. If you've ever wanted to collaborate on Markdown or code with the convenience of Google Docs, our demo is for you.

Gitlip Editors: Demo Launch 🌷 Gitlip is a collaborative coding platform, and today we’re launching the demo for Gitlip Editors - our take on collaborative coding environments. If you've ever wanted to collaborate on Markdown or code with the convenience of Google Docs, our demo is for you.

Natalie Marleny

35,862 views • 1 year ago

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:

QVAC

34,043 views • 1 month ago

This new demo is running on the Dreamcast using the new raylib port. The system really is quite capable and is rendering this 3D scan along with multiple realtime point lights moving around it. This demo would’ve blown my mind in 1999.

This new demo is running on the Dreamcast using the new raylib port. The system really is quite capable and is rendering this 3D scan along with multiple realtime point lights moving around it. This demo would’ve blown my mind in 1999.

Brielle Garcia

135,699 views • 1 year ago