Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Watch: What happens to your CPU when Windows 11's Low Latency Profile feature is enabled. CPU usage automatically spikes briefly to speed up the launch of Windows 11's Start menu, Notifications Center, Control Center, right-click menu, and other OS-level features. The same CPU boost is coming soon to Windows...

83,664 Aufrufe • vor 2 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You don't need a GPU for fast studio grade voice cloning anymore. Qwen3 TTS (1.7B Q4_K_M) + mainline llama.cpp is officially the fastest way to generate zero shot voice clones using 100% pure CPU execution. Following up on my last post where we ran the Q8 model on a GPU, we just took local C++ voice synthesis a massive step further. The open source community quantized Alibaba's SOTA Qwen3 TTS model down to Q4_K_M GGUF, completely freeing local audio pipelines from dedicated graphics hardware. Here is the real world benchmark and hardware breakdown of running SOTA voice cloning on CPU: # Architecture & Model Setup Using Qwen3-TTS-12Hz-1.7B-Base-Q4_K_M.gguf paired with the 8 bit multimodal projector (mmproj-Q8_0.gguf), llama.cpp executes the entire pipeline in pure C++. No PyTorch, no CUDA dependencies, and no VRAM bottlenecks. # Real-World Memory Footprint - Baseline RAM: 1.6 GB system idle. - Peak Generation RAM: 8 GB RAM during active voice synthesis. - Requirement: Any basic machine with at least 8 GB of system RAM can run this easily. # Real World CPU Benchmarks - Google Colab Free Tier (Throttled 2 Core CPU): Synthesizes a 5 sec studio quality audio clip (~8 words) in 45 seconds. - Modern Consumer CPU (Intel i5/i7 13th/14th Gen or AMD Ryzen 7000/9000): generation should drop to 5 to 20 seconds (nearly 1:1 real-time generation speed!). # Zero Shot Voice Cloning Quality Pass any 5 to 20 second .wav audio sample to the C++ engine using the --tts-speaker-file flag. It yields clean, natural sounding cloned speech with virtually zero quality loss compared to unquantized FP16 weights. To make testing seamless, I built an updated zero config Google Colab notebook. It pulls the official pre built llama.cpp CPU binaries (zero compilation time!) launches a live Gradio web app right in your browser. Record a 5 second clip from your mic (or drop a .mp3, .wav file), type text, and generate cloned audio on CPU. Native C++ audio models are making edge based, offline AI voice agents a reality. Links to the free Q4 CPU Colab notebook and the Q4_K_M GGUF HuggingFace repository are in the replies below! Which models have you been running on your CPUs? What CPU hardware are you using for local inference?

Alok

60,514 Aufrufe • vor 10 Tagen

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 Aufrufe • vor 5 Monaten

Holy shit... someone built a free portable tool that activates Windows, kills the bloatware, and shuts down every telemetry service Microsoft buried in your OS. It's called GTweak. One .exe file. No install. No subscription. You download it, run it, and your Windows is finally yours. Every "Windows debloater" before this made you pick one trade-off. Activate but keep the spyware. Debloat but lose update control. Disable telemetry but break Defender toggles. GTweak does all of it inside a single portable executable. Here's what makes it different from every Windows tweaker that came before: → HWID + KMS activation built in, no sketchy batch scripts, no Massgrave links, no PowerShell one-liners pasted from a Reddit thread → Removes Cortana, Copilot, Recall, OneDrive, Edge, and every pre-installed UWP app on Windows 10 and 11 in one click → Disables keyloggers and telemetry across Windows and NVIDIA including the data collection tasks hiding in Task Scheduler that nobody talks about → Blocks Microsoft's shadow domains at the hosts file AND firewall level so the OS literally cannot phone home → Disables Defender, SmartScreen, Antimalware, VBS, and UAC with proper toggles instead of registry hacks that break on the next update → Pauses Windows Updates entirely and wipes the cached update files Microsoft refuses to let you delete → Kills Teredo, ISATAP, and IPv6 along with the diagnostic services running silently in the background → Activates the hidden Ultimate Performance power plan and fixes the Realtek audio delay bug nobody at Microsoft has patched in 5 years → Runs custom .ps1, .cmd, .bat, .reg scripts with TrustedInstaller privileges, the highest permission level Windows has → Built-in hardware monitor, NTFS compression, RAM cleaner, and secure Windows.old wipe Killed: $30 Windows 11 Pro keys, every "debloat script" repo with 47 forks and no maintenance, the $5/mo "PC optimizer" garbage running on YouTube ads. Works on every official Windows build since 10 (18362.116). One .NET Framework 4.8 dependency that's already on your machine. BSD 3-Clause License. 100% Opensource.

Guri Singh

171,691 Aufrufe • vor 3 Monaten