Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing Batchwork ⚡️ Unified batch API for AI providers. Process LLM requests in bulk with a single call for lower costs. Processing, uploading, polling, and result parsing handled for you. → 7 providers → JSONL handled → ▲ AI SDK support → Server + Next.js helpers

78,899 görüntüleme • 4 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

38,137 görüntüleme • 10 gün önce

HOLY SH*T! The person who leaked this online is a real freaking madman! Now everyone can get 800 million tokens for AI agents for free The OmniRoute repository is blowing up GitHub. It is a local high-performance AI gateway that combines free limits from dozens of providers into a single continuous API stream Project architecture and key technical specifications: Interface and Integration: Provides a single OpenAI-compatible API endpoint. Natively connects to Cursor, VS Code (via Copilot / Cline / Aider) Claude Code, and custom scripts Connection Scale: Supports 350+ providers and 90+ services with free limits (Google AI Studio, Groq, Cerebras, SambaNova, OpenRouter, GitHub Models, Mistral AI, etc.) 18 Routing Strategies & Auto-Fallback: Custom switching system. On a ⁠429 Too Many Requests⁠ error or quota depletion, the gateway seamlessly redirects the request to the next model in the chain within milliseconds Dual Context Compression (RTK + Caveman): Built-in engines cut unnecessary logs, syntax, and message history by 15–95% saving token volume before sending the request Security (Local-first & 0 Telemetry): All API keys are locally encrypted using the AES-256-GCM algorithm. Data goes directly to providers, bypassing third-party clouds Agent Protocols (MCP & A2A): Full support for Model Context Protocol (MCP) and Agent-to-Agent architecture for automated model pool management Launch Options: CLI (⁠npm⁠), Docker container, Electron desktop app, and PWA

Bober_smart

21,427 görüntüleme • 9 gün önce