parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's... Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵show more

Depth Anything 3 now runs as pure C++/ggml (ggml)... . No Python, no PyTorch, no CUDA toolkit at inference, just one self-contained GGUF. It's faster than PyTorch on CPU! and ties speed on GPU. The CPU win came from the last place..I'd have looked. Quantized GGUF on Hugging Face🤗 Shout out to Georgi Gerganov for ggml (we are building a ggml-world!❤️) and to ByteDance Open Source and Depth Anything 3 authors Bingyi Kang Jun Hao Liew Donny Y. Chen !show more

I switched from a quantized Whisper Large v3 Turbo... to Parakeet V3 in VoiceInk and the latency is much better.show more

We are open-sourcing TTSKit! Run state-of-the-art text-to-speech models on... your Mac and iPhone. The launch version supports Qwen Qwen3-TTS and generates audio faster than real-time playback with sub-200 ms time-to-first-byte. Voice cloning and advanced speed optimizations will be in the next version. Link to the GitHub repo and models on Hugging Face in comments.show more

AI Tip: Turn on the NVIDIA Broadcast app when... live streaming for AI greenscreen + to filter out noise 📺 Tell us your fave tips & tricks for taking advantage of AI apps on your GPU below + comment #AIonRTX to win a AORUS GIGABYTE GeForce RTX 4080 16GB GAMING OC GPU!show more

I finally got NVIDIA AI Developer's 3D Gaussian Unscented... Transforms up and running natively on Windows via gsplat. Just in time for me to make a tutorial so people can enter NVIDIA's 3DGUT sweepstakes!!! Huge thanks to Ruilong Li for responding to my Github issues and solving my roadblocks this evening. #3D #Computervisionshow more

How to run AI models locally? -> Go to... 🤗 Hugging Face -> Grab the GGUF model link -> Drop it into 👋 Jan Hub That's all there is to it.show more

We are continuing to advance open-source AI. Just announced... -- new tools for speech, safety, and autonomous driving. Learn about the open models, datasets, and research we’re releasing at #NeurIPS2025:show more

We’re releasing model weights for our 8B- parameter Dynamic... Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.show more

Announcing our latest open medical AI models for developers:... MedGemma 1.5, which is small enough to run offline & improves performance on 3D imaging (CT & MRI), & MedASR, a speech-to-text model for medical dictation. Both available on Hugging Face + Vertex AI. #MedGemma #HealthAI #GenerativeAIshow more

Qwen3.5-35B-A3B is now in Jan 🔥 It surpasses previous... Qwen3 models more than 6× its size. Get the latest Jan at Thanks to Qwen for the base model and Georgi Gerganov for llama.cpp 💛show more

A Sun Parakeet shakes its head to the beat

It’s live. AxonDAO’s GPU fleet is installed and will... soon be rentable on the open market via vast.ai. Premium GPU capacity - 8x NVIDIA B200 and 8x RTX Pro 6000 - built for large-scale AI training, inference, rendering, and research workloads. 🧵show more

Hey @NVIDIA, how do you make the perfect byte?... From working with us to tech CEO, do breakfast like Jensen Huang with new NVIDIA Breakfast Bytes—only available for order online at now through May 13 NVIDIA GTC #GTC2025show more

Want to bring open-source vision language models to the... edge? 💻 Check out our Hugging Face article on deploying NVIDIA Cosmos Reasoning 2B across the NVIDIA Jetson family with vLLM and a Live VLM WebUI. 📖show more

WE DELIVER 24/7, DAY BY DAY! 03.06.2025! On Tuesday,... ByteWallet will be launched and available to all ByteBlockchain miners. That is the day every $BYTE miner has been waiting for. Are you ready to transfer your $BYTE to ByteWallet? How much $BYTE are you holding now? Start mining $BYTE now:show more

We’re proud to share that $vMINT is now a... member of the NVIDIA Developer Program 🌟 This will provide us with the following things (among others): Access to over 150 SDKs for advanced software development Comprehensive training resources through the Deep Learning Institute and NVIDIA On-Demand for skill enhancement Early access programs Stay tuned for more exciting updates 👀 #Volumint $vMINT #nvidia $nvda #nvda #AI #Marketmakingshow more

Today, Nesa is excited to announce cross-chain support with... Sei. As part of this new development, Nesa will be featuring a dedicated ramp for Sei’s rich ecosystem of applications to seamlessly integrate with AI. Now any Sei dapp can run AI inference on hundreds of models supported by Nesa, including the largest LLMs and most popular models across Vision, Language, and Generative AI. For developers, we’ll have information soon on how to access AI inference on Nesa via smart contracts from the Sei blockchain. Stay tuned for more details on this ground breaking development for decentralized AI.show more

Meigen MultiTalk @gradio demo is available on Hugging Face... 🤗 Duplicate on L40S for personal and unlimited inference, enjoy ! *Compatible with multi-GPU too 😉show more

🎉 Congratulations Google DeepMind on the launch of Gemma... 3 🎊 Introducing lightweight, multimodal, multilingual models streamlined for optimal performance on all your NVIDIA hardware – from your #datacenter GPUs to Jetson and RTX AI PCs for Windows. ➡️show more