Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with... test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.show more

Llama 2: Now on Hugging Chat 🤗🦙 Try out... the 70B Chat model for free with super fast inference, web search, and powered by open-source tools! 👉show more

`transformers` + `torchao` quantization + `torch.compile` for faster inference... speed and less memory usage 🔥 Demo of "meta-llama/Meta-Llama-3.1-8B-Instruct" quantized in 4-bit weight-only :show more

starting the week with a true groundbreaking work 💥... Large Language Diffusion Models the first billion-parameter scale diffusion model competitive with its pairs (8B model comparable to LLaMA 3 8B) it gets rid of the michael scott syndrome on existing LLMsshow more

First came pre-training scaling; then came inference-time scaling. Now... comes judge-time scaling. Despite progress in AI through scaled inference-time compute, AI remains unreliable in open-ended, non-verifiable domains. The key limitation is not generation—it is evaluation. Therefore, the next big leap for AI comes from better judging. In service of this future, today we release Verdict, a library for scaling judge-time compute.show more

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency... structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇show more

Introducing ✨ Aya Vision ✨ - an open-weights model... to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿show more

You can now run inference directly on the Llama... 4 Hugging Face model page – powered by Together AI!show more

Laika AI x Inference Labs Excited to announce our... partnership with Inference Labs We're providing our real-time RAG & AI model API to Inference Labs, powering their verification infrastructure with live blockchain data. Inference Labs delivers open-source, trustless verification for AI agent outputs, so you can trust what you see—without relying on centralized gatekeepers.show more

NVIDIA Nemotron 3 Nano Omni, a new multimodal reasoning... model, is now live on Jetson AI Lab and unifies vision, audio, and language into a single reasoning loop. 🙌 Power your NemoClaws by running this model with Ollama, vLLM and other inference frameworks on NVIDIA Jetson hardware. Try it ➡️show more

Llama 3.1 Nemotron 70B is the latest model from... NVIDIA, released only a few hours ago. Initial testing shows the model outperforms GPT-4o and Sonnet 3.5 on several benchmarks. Try it on Akash Chat for free:show more

The easiest way to use this new model is... through HuggingChat with the link below. Just create a free account and select the model “nvidia/Llama-3.1-Nemotron-70B-Instruct-HF”. And you're ready to start chatting!show more

pip install spectralquant ✂️ Up to 6.62x KV cache... compression for LLMs and transformers. Same model. Faster outputs. Smaller KV cache. Try now (2 mins): - KV cache integration via Hugging Face's DynamicCache - Three presets: 5.95x (paper), 6.55x (validated), 6.68x (edge) - Mistral 7B / Qwen 2.5 7B / Llama 3.1 8B verified - Pure PyTorch + future CUDA kernel support - Auto-calibration from a bundled corpus 📰 Paper: 💻 Code, quickstart, and benchmarks: #LLM #Inference #PyTorch #OpenSource #MachineLearning #LLM #KVCache #Inferenceshow more

Introducing Alpamayo 1.5. Based on community feedback, we’ve updated... our 10B-parameter chain-of-thought reasoning VLA model to be a more interactive and steerable engine for autonomous vehicle development. Built on the Cosmos-Reason2 VLM backbone, this release adds support for navigation guidance and flexible camera configurations while providing new post-training scripts for model adaptation. 🤗 Learn more:show more

MolmoAct2 is landing in LeRobot! Ai2's open Action Reasoning... Model combines a Molmo2-ER vision-language backbone with a flow-matching continuous action expert to predict robot action chunks from images, language instructions, and proprioceptive state. An open robot foundation model built for real-world control, with strong out-of-the-box performance and easy fine-tuning in LeRobot. Pick-and-place inference running on NVIDIA DGX Spark! Blog: Paper: Thanks to Ai2 Jiafei Duan Haoquan Fangshow more

PRIMA.CPP Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday... Home Clustersshow more

🤖 ExoBrain is a compute device built for large-scale... AI collaboration, supporting model training, inference, and long-running Agents With a standardized architecture and continuous execution capability, it delivers efficient, reliable compute for AI systems ⚡ From one-time calls to continuous operation, ExoBrain enables AI to execute persistently, produce ongoing outputs, and generate long-term value #ExoBrain #AICompute #AIAgents #AGIshow more

We just shipped support for tool use and JSON... mode for DeepSeek R1 Distil-Llama 70B on Groq Inc. 🛠️ The coolest part is that our API now has a `reasoning_format` parameter that lets you control how the model outputs its thought process.show more

🔥🔥🔥We’ve been listening to your feedback! Our latest world... model HY-World 1.5 just got a major upgrade to make world generation more accessible than ever: 🛠️ Open Training Code: Fully customizable code for building and training your own models. ⚡ Accelerated Inference: Turbocharged speed and optimized VRAM for real-time interaction. 📉 Lite 5B Model: A new lightweight model that fits into small-VRAM GPUs. 🙌 Zero Waitlist: Our online app is now fully open to everyone—no application required. This is just the beginning. HY-World is building the future of spatial intelligence—open, accessible, and community-driven. 🕹️ Play now: ⭐ GitHub:show more

Llama 3.3 70B is live on AkashChat. The latest... state-of-the-art multilingual AI model released by Meta is as performant as Llama 3.1 405B at a fraction of the size. Try it today:show more

Enterprise wants privacy. Builders want flexibility. Users want speed.... Nesa gives all three in one place. Encrypted inference. Low hardware requirements. Instant model routing. Test the new models in an environment that protects you. ⬟show more