Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

DiffusionGemma can now run at 2000+ tokens/sec! ⚡ We made local DiffusionGemma inference 1.8× faster. Run it on 18GB RAM via Unsloth Studio. GitHub: Guide:

UnslothAI's profile picture

Unsloth AI

68,807 subscribers

161,439 Aufrufe • vor 2 Tagen •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You can now run GPT, Claude & other models in Unsloth. Connect + run APIs in a local UI: - Code execution, web search, image gen, editing - Auto prompt caching to save costs - Provider features like cites, sandboxes GitHub: Guide:
0:36

You can now run GPT, Claude & other models in Unsloth. Connect + run APIs in a local UI: - Code execution, web search, image gen, editing - Auto prompt caching to save costs - Provider features like cites, sandboxes GitHub: Guide:

Unsloth AI

29,427 Aufrufe • vor 19 Tagen

Inference in Unsloth Studio is now ~20% faster. You can also use older pre-downloaded GGUFs from Hugging Face etc. AMD chat support for Linux now works. Data Recipes now works on macOS, AMD, CPU setups. GitHub: Changelog:
0:25

Inference in Unsloth Studio is now ~20% faster. You can also use older pre-downloaded GGUFs from Hugging Face etc. AMD chat support for Linux now works. Data Recipes now works on macOS, AMD, CPU setups. GitHub: Changelog:

Unsloth AI

25,355 Aufrufe • vor 2 Monaten

You can now fine-tune TTS models with Unsloth! Train, run and save models like Sesame-CSM and OpenAI's Whisper locally with our free notebooks. Unsloth makes TTS training 1.5x faster with 50% less VRAM. GitHub: Docs & Notebooks:
0:29

You can now fine-tune TTS models with Unsloth! Train, run and save models like Sesame-CSM and OpenAI's Whisper locally with our free notebooks. Unsloth makes TTS training 1.5x faster with 50% less VRAM. GitHub: Docs & Notebooks:

Unsloth AI

126,049 Aufrufe • vor 1 Jahr

4-bit Qwen3.6 MTP GGUF managed to search 70+ sites from a single prompt. Try this locally on 20GB RAM via Unsloth Studio. Unsloth now supports auto MTP + speculative decoding & auto-selects the best MTP settings for your device (Mac, CPU, GPU). GitHub:
0:28

4-bit Qwen3.6 MTP GGUF managed to search 70+ sites from a single prompt. Try this locally on 20GB RAM via Unsloth Studio. Unsloth now supports auto MTP + speculative decoding & auto-selects the best MTP settings for your device (Mac, CPU, GPU). GitHub:

Unsloth AI

71,505 Aufrufe • vor 26 Tagen

2-bit Gemma 4 12B GGUF, only 4.66 GB on disk, managed to cite 15 sites from a single prompt. Try this locally on >6GB RAM via Unsloth Studio. GitHub:
0:48

2-bit Gemma 4 12B GGUF, only 4.66 GB on disk, managed to cite 15 sites from a single prompt. Try this locally on >6GB RAM via Unsloth Studio. GitHub:

Unsloth AI

140,386 Aufrufe • vor 10 Tagen

Introducing Unsloth Studio ✨ A new open-source web UI to train and run LLMs. • Run models locally on Mac, Windows, Linux • Train 500+ models 2x faster with 70% less VRAM • Supports GGUF, vision, audio, embedding models • Auto-create datasets from PDF, CSV, DOCX • Self-healing tool calling and code execution • Compare models side by side + export to GGUF GitHub: Blog and Guide: Available now on Hugging Face, NVIDIA, Docker and Colab.
0:45

Introducing Unsloth Studio ✨ A new open-source web UI to train and run LLMs. • Run models locally on Mac, Windows, Linux • Train 500+ models 2x faster with 70% less VRAM • Supports GGUF, vision, audio, embedding models • Auto-create datasets from PDF, CSV, DOCX • Self-healing tool calling and code execution • Compare models side by side + export to GGUF GitHub: Blog and Guide: Available now on Hugging Face, NVIDIA, Docker and Colab.

Unsloth AI

1,670,040 Aufrufe • vor 2 Monaten

2-bit Qwen3.6-27B GGUF made 26 tool calls, triaged 15 GitHub issues and fixed, tested + reproed our repo’s 3 latest issues. 🔥 Try this locally in Unsloth Studio with just 12GB RAM. Studio also has a new look! GitHub:
0:36

2-bit Qwen3.6-27B GGUF made 26 tool calls, triaged 15 GitHub issues and fixed, tested + reproed our repo’s 3 latest issues. 🔥 Try this locally in Unsloth Studio with just 12GB RAM. Studio also has a new look! GitHub:

Unsloth AI

77,531 Aufrufe • vor 1 Monat

Smol TTS keeps getting better! Introducing OuteTTS v0.2 - 500M parameters, multilingual with voice cloning! 🔥 > Multilingual - English, Chinese, Korean & Japanese > Cross platform inference w/ llama.cpp > Zero-shot voice cloning > Trained on 5 Billion audio tokens > Qwen 2.5 0.5B LLM backbone > Trained via HF GPU grants Model weights on the hub, you can even run this on a Raspberry Pi! Go run, inference now! 🐐
0:50

Smol TTS keeps getting better! Introducing OuteTTS v0.2 - 500M parameters, multilingual with voice cloning! 🔥 > Multilingual - English, Chinese, Korean & Japanese > Cross platform inference w/ llama.cpp > Zero-shot voice cloning > Trained on 5 Billion audio tokens > Qwen 2.5 0.5B LLM backbone > Trained via HF GPU grants Model weights on the hub, you can even run this on a Raspberry Pi! Go run, inference now! 🐐

Vaibhav (VB) Srivastav

44,566 Aufrufe • vor 1 Jahr

Can a $351 mini PC run a 30B+ AI model locally? 👀 We tested the MINISFORUM UM790 Pro with Qwen 35B — and the results might surprise you. 💻 Powered by: • AMD Ryzen™ 9 7940HS • Radeon™ 780M iGPU • 48GB DDR5 RAM (dual-channel) 🚀 Smooth local inference at 20+ tokens/sec (based on our test setup, results may vary) No cloud. No API fees. Just local AI. 🔒 🔗 Learn more: #MINISFORUM #UM790Pro #LocalAI #MiniPC #AI #LLM #Tech
1:21

Can a $351 mini PC run a 30B+ AI model locally? 👀 We tested the MINISFORUM UM790 Pro with Qwen 35B — and the results might surprise you. 💻 Powered by: • AMD Ryzen™ 9 7940HS • Radeon™ 780M iGPU • 48GB DDR5 RAM (dual-channel) 🚀 Smooth local inference at 20+ tokens/sec (based on our test setup, results may vary) No cloud. No API fees. Just local AI. 🔒 🔗 Learn more: #MINISFORUM #UM790Pro #LocalAI #MiniPC #AI #LLM #Tech

MINISFORUM Official

73,924 Aufrufe • vor 1 Monat

Can it run doom was yesterday. Today is "can it run Gemma4". It even runs on a Nintendo Switch 1 @ 1.5 t/sec
2:57

Can it run doom was yesterday. Today is "can it run Gemma4". It even runs on a Nintendo Switch 1 @ 1.5 t/sec

Chubby♨️

20,542 Aufrufe • vor 2 Monaten

Your AI agent is costing you money for no reason. OpenClaw can now run UNLIMITED for free. No subscriptions. No token limits. No cloud dependency. All you need: • Max Studio • Ollama • GLM 4.7 Flash Install it once. Run it locally. Unlimited tokens. Most people are still paying monthly for what you can now run free.
0:32

Your AI agent is costing you money for no reason. OpenClaw can now run UNLIMITED for free. No subscriptions. No token limits. No cloud dependency. All you need: • Max Studio • Ollama • GLM 4.7 Flash Install it once. Run it locally. Unlimited tokens. Most people are still paying monthly for what you can now run free.

Julian Goldie SEO

44,309 Aufrufe • vor 3 Monaten

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from
0:22

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from

Visual Studio Code

57,355 Aufrufe • vor 8 Monaten

Ram Mahal Dhaba at Kurla station Run by Rahim? Can someone confirm it? 😳
0:28

Ram Mahal Dhaba at Kurla station Run by Rahim? Can someone confirm it? 😳

Kreately.in

85,023 Aufrufe • vor 4 Monaten

Can You Run Faster On All Fours? 🤔
0:27

Can You Run Faster On All Fours? 🤔

Zack D. Films

49,965 Aufrufe • vor 22 Tagen

Llama 4 Scout 109B can actually run pretty fast on a 64GB M4 Max using a mixed 3/6 bit quant (4.0 bits-per-weight). Here it is generating 600+ tokens at 42 tok/sec on my laptop!
0:22

Llama 4 Scout 109B can actually run pretty fast on a 64GB M4 Max using a mixed 3/6 bit quant (4.0 bits-per-weight). Here it is generating 600+ tokens at 42 tok/sec on my laptop!

Awni Hannun

39,146 Aufrufe • vor 1 Jahr

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner
0:34

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta

20,350 Aufrufe • vor 23 Tagen

DiffusionGemma is out 🔥 it's compute-bound so 4x faster compared to other Gemma-4 models (1k tok/s on H100) 💨 also great on coding, generate and iterate on any code from 3D generation to front-end ⤵️
0:36

DiffusionGemma is out 🔥 it's compute-bound so 4x faster compared to other Gemma-4 models (1k tok/s on H100) 💨 also great on coding, generate and iterate on any code from 3D generation to front-end ⤵️

merve

40,717 Aufrufe • vor 4 Tagen

llmfit. Useful tool that probes hardware and tells you exactly which LLMs will actually run. - handles MoE expert offloading, picks the best quantization for your RAM, estimates tokens/sec before you even pull the weights. Essential for local dev.
0:22

llmfit. Useful tool that probes hardware and tells you exactly which LLMs will actually run. - handles MoE expert offloading, picks the best quantization for your RAM, estimates tokens/sec before you even pull the weights. Essential for local dev.

Wildminder

247,214 Aufrufe • vor 3 Monaten

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:
0:20

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 Aufrufe • vor 1 Jahr