Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Today, we're shipping MLX support for TADA, our open-source text-to-speech model, which means the entire pipeline (LLM, flow-matching, and decoder) can now run locally on any Apple Silicon device. We're seeing a 45% reduction in memory usage and a 10x speed-up when using it quantized. With these improvements, you... show more

Hume AI

23,213 subscribers

24,765 Aufrufe • vor 6 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Introducing Novo Launching today a new project I coded for myself in 1 weekend in May and decided to finish this week. Novo is a dead simple to-do app that lets you "Speech-To-Tasks", or paste a huge text and organize for you. You can customize the AI and make it organize in any criteria: - Auto-tag by category - Schedule some types of tasks to certain days - Prioritize based on your own rules Try it:

Introducing Novo Launching today a new project I coded for myself in 1 weekend in May and decided to finish this week. Novo is a dead simple to-do app that lets you "Speech-To-Tasks", or paste a huge text and organize for you. You can customize the AI and make it organize in any criteria: - Auto-tag by category - Schedule some types of tasks to certain days - Prioritize based on your own rules Try it:

Pedro

76,232 Aufrufe • vor 1 Jahr

Are you a developer working on iOS 27 app updates? Drowning in screenshots and screen recordings? I made something for you. Free and open source. Apple Frames CLI lets you (or your agent) frame any screenshot or screen recording from any Apple device. It supports *every* official Apple frame color, grouped batches, it can merge images and videos, and so much more. I just released version 1.4 with even faster performance, videos with transparent background, and lots of fixes. This has been a labor of love over the last few months, and I hope it can help you automate your App Store screenshots as much as it helps me for my articles ☺️ Enjoy:

Are you a developer working on iOS 27 app updates? Drowning in screenshots and screen recordings? I made something for you. Free and open source. Apple Frames CLI lets you (or your agent) frame any screenshot or screen recording from any Apple device. It supports every official Apple frame color, grouped batches, it can merge images and videos, and so much more. I just released version 1.4 with even faster performance, videos with transparent background, and lots of fixes. This has been a labor of love over the last few months, and I hope it can help you automate your App Store screenshots as much as it helps me for my articles ☺️ Enjoy:

Federico Viticci

23,960 Aufrufe • vor 22 Tagen

Introducing: OpenGranola 🔥 I built an open source meeting copilot for macOS. It transcribes both sides of your call on-device, searches your own notes in real time, and hands you talking points right when the conversation needs them. No audio leaves your Mac. Point it at a folder of markdown files, pick any LLM through OpenRouter (Claude, GPT-4o, Gemini, Llama), and it just works. It's invisible to screen share too — nobody knows you have it. The whole thing is open source. Link below

Introducing: OpenGranola 🔥 I built an open source meeting copilot for macOS. It transcribes both sides of your call on-device, searches your own notes in real time, and hands you talking points right when the conversation needs them. No audio leaves your Mac. Point it at a folder of markdown files, pick any LLM through OpenRouter (Claude, GPT-4o, Gemini, Llama), and it just works. It's invisible to screen share too — nobody knows you have it. The whole thing is open source. Link below

yazin

293,378 Aufrufe • vor 6 Monaten

You can now watch your agents work live as Hermes Desktop streams the screen of any bot's screen or session in real time. Watch it drive a browser, type into a terminal, or open a window. Take over anytime to interact with the Bot Screen or type credentials and seamlessly hand back off when you're done.

You can now watch your agents work live as Hermes Desktop streams the screen of any bot's screen or session in real time. Watch it drive a browser, type into a terminal, or open a window. Take over anytime to interact with the Bot Screen or type credentials and seamlessly hand back off when you're done.

Nous Research

472,599 Aufrufe • vor 7 Tagen

You don't need a GPU for fast studio grade voice cloning anymore. Qwen3 TTS (1.7B Q4_K_M) + mainline llama.cpp is officially the fastest way to generate zero shot voice clones using 100% pure CPU execution. Following up on my last post where we ran the Q8 model on a GPU, we just took local C++ voice synthesis a massive step further. The open source community quantized Alibaba's SOTA Qwen3 TTS model down to Q4_K_M GGUF, completely freeing local audio pipelines from dedicated graphics hardware. Here is the real world benchmark and hardware breakdown of running SOTA voice cloning on CPU: # Architecture & Model Setup Using Qwen3-TTS-12Hz-1.7B-Base-Q4_K_M.gguf paired with the 8 bit multimodal projector (mmproj-Q8_0.gguf), llama.cpp executes the entire pipeline in pure C++. No PyTorch, no CUDA dependencies, and no VRAM bottlenecks. # Real-World Memory Footprint - Baseline RAM: 1.6 GB system idle. - Peak Generation RAM: 8 GB RAM during active voice synthesis. - Requirement: Any basic machine with at least 8 GB of system RAM can run this easily. # Real World CPU Benchmarks - Google Colab Free Tier (Throttled 2 Core CPU): Synthesizes a 5 sec studio quality audio clip (~8 words) in 45 seconds. - Modern Consumer CPU (Intel i5/i7 13th/14th Gen or AMD Ryzen 7000/9000): generation should drop to 5 to 20 seconds (nearly 1:1 real-time generation speed!). # Zero Shot Voice Cloning Quality Pass any 5 to 20 second .wav audio sample to the C++ engine using the --tts-speaker-file flag. It yields clean, natural sounding cloned speech with virtually zero quality loss compared to unquantized FP16 weights. To make testing seamless, I built an updated zero config Google Colab notebook. It pulls the official pre built llama.cpp CPU binaries (zero compilation time!) launches a live Gradio web app right in your browser. Record a 5 second clip from your mic (or drop a .mp3, .wav file), type text, and generate cloned audio on CPU. Native C++ audio models are making edge based, offline AI voice agents a reality. Links to the free Q4 CPU Colab notebook and the Q4_K_M GGUF HuggingFace repository are in the replies below! Which models have you been running on your CPUs? What CPU hardware are you using for local inference?

You don't need a GPU for fast studio grade voice cloning anymore. Qwen3 TTS (1.7B Q4_K_M) + mainline llama.cpp is officially the fastest way to generate zero shot voice clones using 100% pure CPU execution. Following up on my last post where we ran the Q8 model on a GPU, we just took local C++ voice synthesis a massive step further. The open source community quantized Alibaba's SOTA Qwen3 TTS model down to Q4_K_M GGUF, completely freeing local audio pipelines from dedicated graphics hardware. Here is the real world benchmark and hardware breakdown of running SOTA voice cloning on CPU: # Architecture & Model Setup Using Qwen3-TTS-12Hz-1.7B-Base-Q4_K_M.gguf paired with the 8 bit multimodal projector (mmproj-Q8_0.gguf), llama.cpp executes the entire pipeline in pure C++. No PyTorch, no CUDA dependencies, and no VRAM bottlenecks. # Real-World Memory Footprint - Baseline RAM: 1.6 GB system idle. - Peak Generation RAM: 8 GB RAM during active voice synthesis. - Requirement: Any basic machine with at least 8 GB of system RAM can run this easily. # Real World CPU Benchmarks - Google Colab Free Tier (Throttled 2 Core CPU): Synthesizes a 5 sec studio quality audio clip (~8 words) in 45 seconds. - Modern Consumer CPU (Intel i5/i7 13th/14th Gen or AMD Ryzen 7000/9000): generation should drop to 5 to 20 seconds (nearly 1:1 real-time generation speed!). # Zero Shot Voice Cloning Quality Pass any 5 to 20 second .wav audio sample to the C++ engine using the --tts-speaker-file flag. It yields clean, natural sounding cloned speech with virtually zero quality loss compared to unquantized FP16 weights. To make testing seamless, I built an updated zero config Google Colab notebook. It pulls the official pre built llama.cpp CPU binaries (zero compilation time!) launches a live Gradio web app right in your browser. Record a 5 second clip from your mic (or drop a .mp3, .wav file), type text, and generate cloned audio on CPU. Native C++ audio models are making edge based, offline AI voice agents a reality. Links to the free Q4 CPU Colab notebook and the Q4_K_M GGUF HuggingFace repository are in the replies below! Which models have you been running on your CPUs? What CPU hardware are you using for local inference?

Alok

105,756 Aufrufe • vor 1 Monat

You can now use GLM-5.3 Flash completely FREE 😱 GLM-5.3 is now officially out and free on No bank card needed. You can also use Qwen3.8, HY3, MiMo-V2.5 and other models for $0. Setup: 2 mins: > Go to > Create a free account > Pick any model showing 0 credits > Use it in chat or create an API key No official end date yet. Grab it before the free access disappears.

You can now use GLM-5.3 Flash completely FREE 😱 GLM-5.3 is now officially out and free on No bank card needed. You can also use Qwen3.8, HY3, MiMo-V2.5 and other models for $0. Setup: 2 mins: > Go to > Create a free account > Pick any model showing 0 credits > Use it in chat or create an API key No official end date yet. Grab it before the free access disappears.

CDG

13,405 Aufrufe • vor 1 Monat

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Alok

65,387 Aufrufe • vor 3 Monaten

You know that saying "a picture speaks a thousand words"? Now it... can! In addition to being able to upload images to use in your Flow videos, you can also add speech to the images you upload. Get your pet ready for its close-up and a monologue 🎬 Audio generation on Flow is still experimental, but we're excited for you try it out. Add your videos below ⬇️

You know that saying "a picture speaks a thousand words"? Now it... can! In addition to being able to upload images to use in your Flow videos, you can also add speech to the images you upload. Get your pet ready for its close-up and a monologue 🎬 Audio generation on Flow is still experimental, but we're excited for you try it out. Add your videos below ⬇️

Google Labs

47,734 Aufrufe • vor 1 Jahr

⚠️ NSFW ⚠️ Looks like Hume made a virtually uncensored voice-native LLM called Octave—the first language model built specifically for TTS. You can generate any type of voice you want with a prompt, and their WebUI tool can auto-generate corresponding example dialogue! The model grasps user intent from text quite well, but as you’ll hear in the second example there can be (somewhat unsettling) glitches inb4 glitch orgasms become a new fetish category 🙃

Sensitive content

⚠️ NSFW ⚠️ Looks like Hume made a virtually uncensored voice-native LLM called Octave—the first language model built specifically for TTS. You can generate any type of voice you want with a prompt, and their WebUI tool can auto-generate corresponding example dialogue! The model grasps user intent from text quite well, but as you’ll hear in the second example there can be (somewhat unsettling) glitches inb4 glitch orgasms become a new fetish category 🙃

Pliny the Liberator 🐉󠅫󠄼󠄿󠅆󠄵󠄐󠅀󠄼󠄹󠄾󠅉󠅭

36,379 Aufrufe • vor 1 Jahr

1/3 🤖 Meet AgentOS: A Token-efficient, Microkernel AI agent with on-device model routing across CLI, Web UI, and chat. A local router reads every message on your device and sends it to the cheapest model that can still do the job well. You stop overpaying for AI. ⚡ What makes it stand out: ■ Smart on-device model routing across 20+ providers ( bankrbot LLM Gateway, OpenRouter, OpenAI, Anthropic, Ollama, and more). ■ Persistent local memory that survives restarts. ■ A layered security sandbox (Standard, Strict, Locked). ■ 37 built-in skills plus MCP, loaded only when a task needs them, and more ■ One unified gateway for CLI, Web UI, Slack, Telegram, Discord, and more Remember this: AgentOS has been integrated with the Bankr LLM Gateway since day one. That means any Bankr user with Bankr API key can start using AgentOS in minutes. Let the router cook.

1/3 🤖 Meet AgentOS: A Token-efficient, Microkernel AI agent with on-device model routing across CLI, Web UI, and chat. A local router reads every message on your device and sends it to the cheapest model that can still do the job well. You stop overpaying for AI. ⚡ What makes it stand out: ■ Smart on-device model routing across 20+ providers ( bankrbot LLM Gateway, OpenRouter, OpenAI, Anthropic, Ollama, and more). ■ Persistent local memory that survives restarts. ■ A layered security sandbox (Standard, Strict, Locked). ■ 37 built-in skills plus MCP, loaded only when a task needs them, and more ■ One unified gateway for CLI, Web UI, Slack, Telegram, Discord, and more Remember this: AgentOS has been integrated with the Bankr LLM Gateway since day one. That means any Bankr user with Bankr API key can start using AgentOS in minutes. Let the router cook.

AgentOS

205,389 Aufrufe • vor 2 Monaten

HOLY MOLY running a 35B model locally on a MacBook shouldn’t be THIS FAST 🤯 Spent my weekend in atomic.chat testing Qwen 35B vs. Qwen 27B on my local machine. I had them generate a fully animated HTML/Canvas car mini-game (demo below), ... and both models breezed through the physics and parallax scrolling without a hitch! The secret sauce here is the Atomic Chat app. Because it's perfectly optimized for Mac and uses Google's new TurboQuant under the hood, you can run heavy open-source models flawlessly while keeping top-tier output quality 👊 Other perks: → ZERO setup required → Access 1,000+ models completely free → 100% offline and private → Zero API limits ... and MUCH more! I dropped the prompt I used in the 🧵↓ Spin it up locally and let me know what you get!

HOLY MOLY running a 35B model locally on a MacBook shouldn’t be THIS FAST 🤯 Spent my weekend in atomic.chat testing Qwen 35B vs. Qwen 27B on my local machine. I had them generate a fully animated HTML/Canvas car mini-game (demo below), ... and both models breezed through the physics and parallax scrolling without a hitch! The secret sauce here is the Atomic Chat app. Because it's perfectly optimized for Mac and uses Google's new TurboQuant under the hood, you can run heavy open-source models flawlessly while keeping top-tier output quality 👊 Other perks: → ZERO setup required → Access 1,000+ models completely free → 100% offline and private → Zero API limits ... and MUCH more! I dropped the prompt I used in the 🧵↓ Spin it up locally and let me know what you get!

Charly Wargnier

100,041 Aufrufe • vor 5 Monaten

One of the best formats for promoting your app for organic and ads👇 A talking person in the corner + a screen recording of your app It works because it feels personal while showing the product in action, which helps drive conversions Best part? It works for any app and you can either record yourself or use an AI avatar like I did here with Arcads

César Álvarez

19,101 Aufrufe • vor 3 Monaten

Vellum has launched Ambient Assistants, adding vellum assistant as a floating pill on top of any Mac app, where it sees the screen in real time and can draw on top of it to point at what matters. Context that used to be taken from screenshots, pasted links, and long prompts now comes straight from whatever is open on screen. > Users can hand off a task by voice without leaving the app they use, while Vellum assistant works on it in the background. > In unfamiliar tools, Vellum assistant can circle the exact button, setting, or metric to use, directly on screen. > Users can show a routine on screen and talk it through, so the assistant can run it later after its plan is approved.

Vellum has launched Ambient Assistants, adding vellum assistant as a floating pill on top of any Mac app, where it sees the screen in real time and can draw on top of it to point at what matters. Context that used to be taken from screenshots, pasted links, and long prompts now comes straight from whatever is open on screen. > Users can hand off a task by voice without leaving the app they use, while Vellum assistant works on it in the background. > In unfamiliar tools, Vellum assistant can circle the exact button, setting, or metric to use, directly on screen. > Users can show a routine on screen and talk it through, so the assistant can run it later after its plan is approved.

🚨 AI News | TestingCatalog

13,458 Aufrufe • vor 6 Tagen

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!

Akshay 🚀

126,273 Aufrufe • vor 10 Monaten

🎬 $PALM Presents: the long-awaited Creator Studio. A token holdings based usage system to use the latest generative AI for animations and graphics. Forget about downloadable tools or paying high subscription fees for no usage for mediocre results. Creator Studio allows you to access the tools our developers use for high-quality animated video making with the latest Generative AI tools. Creator Studio is part of the Parrot Framework that assigns tasks to AI agents when possible. You can navigate in a seamless Web UI, making the quality, three-dimensional, non-trippy AI videos and sequences you've ever wanted. We support up to 100 images per user stored in the cloud for you to make video sequences of up to 5 minutes with. Most importantly, we don't charge you a fee - your usage depends on your amount of $PALM tokens! The usage is reset monthly, so if you suddenly run out and need more points to complete your creation, you know what to do - buy some $PALM. This and more is being deployed live at where you can see a preview.

🎬 $PALM Presents: the long-awaited Creator Studio. A token holdings based usage system to use the latest generative AI for animations and graphics. Forget about downloadable tools or paying high subscription fees for no usage for mediocre results. Creator Studio allows you to access the tools our developers use for high-quality animated video making with the latest Generative AI tools. Creator Studio is part of the Parrot Framework that assigns tasks to AI agents when possible. You can navigate in a seamless Web UI, making the quality, three-dimensional, non-trippy AI videos and sequences you've ever wanted. We support up to 100 images per user stored in the cloud for you to make video sequences of up to 5 minutes with. Most importantly, we don't charge you a fee - your usage depends on your amount of $PALM tokens! The usage is reset monthly, so if you suddenly run out and need more points to complete your creation, you know what to do - buy some $PALM. This and more is being deployed live at where you can see a preview.

PaLM AI - $PALM

15,750 Aufrufe • vor 1 Jahr

Hi everyone, my name is Aderinola Agbaje Shakirah, and I own Shaire Laundry Detergent Sheets. Shaire is a modern, eco-friendly detergent sheet that’s powerful on stains, gentle on fabrics, dissolves completely in water, and is perfect for both hand and machine washing. It’s lightweight, travel-friendly, mess-free, and eliminates the need for bulky detergent containers. I’m using this opportunity to ask for your support. 🙏🏾 If you ever come across Shaire Laundry Detergent Sheets in any supermarket or store, please give it a try and patronize my brand. Every purchase means more than you can imagine. Thank you so much for your support. ❤️

Derin.

56,676 Aufrufe • vor 3 Monaten

Today we’re open-sourcing Stable Audio Open Small, a 341M-parameter text-to-audio model optimized to run entirely on Arm CPUs. This means 99% of smartphones can now generate music-production samples in seconds, right on-device with no internet required. Built for fast, on-the-go creation, it turns your next quick idea into up to 11 seconds of audio. Generate drum loops, foley, riffs, and textures right where you are. No cords 🔌 just chords 🎹 You can learn more here:

Today we’re open-sourcing Stable Audio Open Small, a 341M-parameter text-to-audio model optimized to run entirely on Arm CPUs. This means 99% of smartphones can now generate music-production samples in seconds, right on-device with no internet required. Built for fast, on-the-go creation, it turns your next quick idea into up to 11 seconds of audio. Generate drum loops, foley, riffs, and textures right where you are. No cords 🔌 just chords 🎹 You can learn more here:

Stability AI

95,336 Aufrufe • vor 1 Jahr

someone just open-sourced their own neuro-sama. and it might be better than the original. it's called airi. a fully autonomous ai companion that speaks with you in real time, joins you in minecraft and factorio, chats through discord and telegram, and comes with a live2d/vrm avatar. runs entirely on your machine. → real-time voice chat and speech recognition → animated avatar with automatic blinking, eye tracking, and idle movements → persistent memory between sessions → local inference through webgpu, no api calls required supports 30+ llm providers, including openai, claude, gemini, deepseek, ollama, groq, mistral, xai, and local models. switch the brain with a config change. uses native cuda and apple metal for real gpu acceleration. 17.5k stars. 101 contributors. 46 releases. completely free. open source.

Simplifying AI

188,298 Aufrufe • vor 3 Tagen