software @huggingface | co-maintainer of 🤗/huggingface_hub | ⵣ
Shorts
You can now route each request to the "fastest" ⚡ or "cheapest" 💸 provider with Hugging Face Inference Providers in Copilot Chat on Visual Studio Code!🤗 For each model, you can explicitly choose "cheapest" when price matters - or "fastest" when throughput is the priority. thanks to Simon Brandeis for shipping this!
