Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU....

mudler_it's profile picture

Ettore Di Giacinto

3,449 subscribers

55,603 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Depth Anything 3 now runs as pure C++/ggml (ggml) . No Python, no PyTorch, no CUDA toolkit at inference, just one self-contained GGUF. It's faster than PyTorch on CPU! and ties speed on GPU. The CPU win came from the last place..I'd have looked. Quantized GGUF on Hugging Face🤗 Shout out to Georgi Gerganov for ggml (we are building a ggml-world!❤️) and to ByteDance Open Source and Depth Anything 3 authors Bingyi Kang Jun Hao Liew Donny Y. Chen !
0:11

Depth Anything 3 now runs as pure C++/ggml (ggml) . No Python, no PyTorch, no CUDA toolkit at inference, just one self-contained GGUF. It's faster than PyTorch on CPU! and ties speed on GPU. The CPU win came from the last place..I'd have looked. Quantized GGUF on Hugging Face🤗 Shout out to Georgi Gerganov for ggml (we are building a ggml-world!❤️) and to ByteDance Open Source and Depth Anything 3 authors Bingyi Kang Jun Hao Liew Donny Y. Chen !

Ettore Di Giacinto

34,443 Aufrufe • vor 14 Tagen

I switched from a quantized Whisper Large v3 Turbo to Parakeet V3 in VoiceInk and the latency is much better.
0:11

I switched from a quantized Whisper Large v3 Turbo to Parakeet V3 in VoiceInk and the latency is much better.

Armin Ronacher ⇌

18,497 Aufrufe • vor 4 Monaten

We are open-sourcing TTSKit! Run state-of-the-art text-to-speech models on your Mac and iPhone. The launch version supports Qwen Qwen3-TTS and generates audio faster than real-time playback with sub-200 ms time-to-first-byte. Voice cloning and advanced speed optimizations will be in the next version. Link to the GitHub repo and models on Hugging Face in comments.
0:16

We are open-sourcing TTSKit! Run state-of-the-art text-to-speech models on your Mac and iPhone. The launch version supports Qwen Qwen3-TTS and generates audio faster than real-time playback with sub-200 ms time-to-first-byte. Voice cloning and advanced speed optimizations will be in the next version. Link to the GitHub repo and models on Hugging Face in comments.

argmax

61,998 Aufrufe • vor 4 Monaten

AI Tip: Turn on the NVIDIA Broadcast app when live streaming for AI greenscreen + to filter out noise 📺 Tell us your fave tips & tricks for taking advantage of AI apps on your GPU below + comment #AIonRTX to win a AORUS GIGABYTE GeForce RTX 4080 16GB GAMING OC GPU!
0:10

AI Tip: Turn on the NVIDIA Broadcast app when live streaming for AI greenscreen + to filter out noise 📺 Tell us your fave tips & tricks for taking advantage of AI apps on your GPU below + comment #AIonRTX to win a AORUS GIGABYTE GeForce RTX 4080 16GB GAMING OC GPU!

NVIDIA GeForce

409,879 Aufrufe • vor 2 Jahren

I finally got NVIDIA AI Developer's 3D Gaussian Unscented Transforms up and running natively on Windows via gsplat. Just in time for me to make a tutorial so people can enter NVIDIA's 3DGUT sweepstakes!!! Huge thanks to Ruilong Li for responding to my Github issues and solving my roadblocks this evening. #3D #Computervision
0:19

I finally got NVIDIA AI Developer's 3D Gaussian Unscented Transforms up and running natively on Windows via gsplat. Just in time for me to make a tutorial so people can enter NVIDIA's 3DGUT sweepstakes!!! Huge thanks to Ruilong Li for responding to my Github issues and solving my roadblocks this evening. #3D #Computervision

Jonathan Stephens

16,901 Aufrufe • vor 1 Jahr

How to run AI models locally? -> Go to 🤗 Hugging Face -> Grab the GGUF model link -> Drop it into 👋 Jan Hub That's all there is to it.
0:12

How to run AI models locally? -> Go to 🤗 Hugging Face -> Grab the GGUF model link -> Drop it into 👋 Jan Hub That's all there is to it.

👋 Jan

44,685 Aufrufe • vor 1 Jahr

We are continuing to advance open-source AI. Just announced -- new tools for speech, safety, and autonomous driving. Learn about the open models, datasets, and research we’re releasing at #NeurIPS2025:
0:10

We are continuing to advance open-source AI. Just announced -- new tools for speech, safety, and autonomous driving. Learn about the open models, datasets, and research we’re releasing at #NeurIPS2025:

NVIDIA

68,556 Aufrufe • vor 7 Monaten

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.
0:12

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.

AI at Meta

195,546 Aufrufe • vor 1 Jahr

Announcing our latest open medical AI models for developers: MedGemma 1.5, which is small enough to run offline & improves performance on 3D imaging (CT & MRI), & MedASR, a speech-to-text model for medical dictation. Both available on Hugging Face + Vertex AI. #MedGemma #HealthAI #GenerativeAI
0:18

Announcing our latest open medical AI models for developers: MedGemma 1.5, which is small enough to run offline & improves performance on 3D imaging (CT & MRI), & MedASR, a speech-to-text model for medical dictation. Both available on Hugging Face + Vertex AI. #MedGemma #HealthAI #GenerativeAI

Google Research

394,926 Aufrufe • vor 5 Monaten

Qwen3.5-35B-A3B is now in Jan 🔥 It surpasses previous Qwen3 models more than 6× its size. Get the latest Jan at Thanks to Qwen for the base model and Georgi Gerganov for llama.cpp 💛
0:13

Qwen3.5-35B-A3B is now in Jan 🔥 It surpasses previous Qwen3 models more than 6× its size. Get the latest Jan at Thanks to Qwen for the base model and Georgi Gerganov for llama.cpp 💛

👋 Jan

34,433 Aufrufe • vor 4 Monaten

It’s live. AxonDAO’s GPU fleet is installed and will soon be rentable on the open market via vast.ai. Premium GPU capacity - 8x NVIDIA B200 and 8x RTX Pro 6000 - built for large-scale AI training, inference, rendering, and research workloads. 🧵
0:14

It’s live. AxonDAO’s GPU fleet is installed and will soon be rentable on the open market via vast.ai. Premium GPU capacity - 8x NVIDIA B200 and 8x RTX Pro 6000 - built for large-scale AI training, inference, rendering, and research workloads. 🧵

AxonDAO

17,583 Aufrufe • vor 4 Monaten

A Sun Parakeet shakes its head to the beat
0:16

A Sun Parakeet shakes its head to the beat

Science girl

41,270 Aufrufe • vor 1 Jahr

Hey @NVIDIA, how do you make the perfect byte? From working with us to tech CEO, do breakfast like Jensen Huang with new NVIDIA Breakfast Bytes—only available for order online at now through May 13 NVIDIA GTC #GTC2025
0:14

Hey @NVIDIA, how do you make the perfect byte? From working with us to tech CEO, do breakfast like Jensen Huang with new NVIDIA Breakfast Bytes—only available for order online at now through May 13 NVIDIA GTC #GTC2025

Denny’s

55,197 Aufrufe • vor 1 Jahr

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖
0:17

Want to bring open-source vision language models to the edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖

NVIDIA Robotics

51,639 Aufrufe • vor 4 Monaten

WE DELIVER 24/7, DAY BY DAY! 03.06.2025! On Tuesday, ByteWallet will be launched and available to all ByteBlockchain miners. That is the day every $BYTE miner has been waiting for. Are you ready to transfer your $BYTE to ByteWallet? How much $BYTE are you holding now? Start mining $BYTE now:
0:18

WE DELIVER 24/7, DAY BY DAY! 03.06.2025! On Tuesday, ByteWallet will be launched and available to all ByteBlockchain miners. That is the day every $BYTE miner has been waiting for. Are you ready to transfer your $BYTE to ByteWallet? How much $BYTE are you holding now? Start mining $BYTE now:

ByteBlockchain.org

33,083 Aufrufe • vor 1 Jahr

We’re proud to share that $vMINT is now a member of the NVIDIA Developer Program 🌟 This will provide us with the following things (among others): Access to over 150 SDKs for advanced software development Comprehensive training resources through the Deep Learning Institute and NVIDIA On-Demand for skill enhancement Early access programs Stay tuned for more exciting updates 👀 #Volumint $vMINT #nvidia $nvda #nvda #AI #Marketmaking
0:11

We’re proud to share that $vMINT is now a member of the NVIDIA Developer Program 🌟 This will provide us with the following things (among others): Access to over 150 SDKs for advanced software development Comprehensive training resources through the Deep Learning Institute and NVIDIA On-Demand for skill enhancement Early access programs Stay tuned for more exciting updates 👀 #Volumint $vMINT #nvidia $nvda #nvda #AI #Marketmaking

VoluMint Labs.

146,072 Aufrufe • vor 2 Jahren

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.
0:16

Today, Nesa is excited to announce cross-chain support with Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.

Nesa

79,639 Aufrufe • vor 2 Jahren

Meigen MultiTalk @gradio demo is available on Hugging Face 🤗 Duplicate on L40S for personal and unlimited inference, enjoy ! *Compatible with multi-GPU too 😉
0:08

Meigen MultiTalk @gradio demo is available on Hugging Face 🤗 Duplicate on L40S for personal and unlimited inference, enjoy ! *Compatible with multi-GPU too 😉

Sylvain Filoni

18,055 Aufrufe • vor 1 Jahr

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.
0:14

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.

SemiAnalysis

51,021 Aufrufe • vor 7 Monaten