Together AI's banner

Together AI

@togethercompute • 61,344 subscribers

Accelerate inference, model shaping, and pre-training on a research-optimized platform.

Shorts

Access Mixtral with the fastest inference performance anywhere! Up to 100 token/s for $0.0006/1K tokens — to our knowledge the fastest performance at the lowest price! Mixtral-8x7b-32kseqlen Mistral AI & DiscoLM-mixtral-8x7b-v2 are live on Together API!

Access Mixtral with the fastest inference performance anywhere! Up to 100 token/s for $0.0006/1K tokens — to our knowledge the fastest performance at the lowest price! Mixtral-8x7b-32kseqlen Mistral AI & DiscoLM-mixtral-8x7b-v2 are live on Together API!

924,940 просмотров

Shadow traffic proves a candidate is operationally sound. It can't tell you if users like it better. A/B testing belongs at the endpoint, not in your app code. Same endpoint name, API, and keys for your clients. No feature flags, no hash-mod-100 in client code, no spreadsheet explaining what group A vs B means. Split a live endpoint's traffic into one control and up to 20 variants, each with a fixed percentage. Ramp with a single call. Delete the experiment and 100% of traffic returns to the control, with nothing left to unwind. Read the full walkthrough:

Shadow traffic proves a candidate is operationally sound. It can't tell you if users like it better. A/B testing belongs at the endpoint, not in your app code. Same endpoint name, API, and keys for your clients. No feature flags, no hash-mod-100 in client code, no spreadsheet explaining what group A vs B means. Split a live endpoint's traffic into one control and up to 20 variants, each with a fixed percentage. Ramp with a single call. Delete the experiment and 100% of traffic returns to the control, with nothing left to unwind. Read the full walkthrough:

15,317 просмотров

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

88,229 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:

143,646 просмотров • 10 месяцев назад

Introducing Together Chat! Use DeepSeek R1 (hosted in North America) & other top open source models to do web search, coding, image generation, & image analysis. Available today for free!

Introducing Together Chat! Use DeepSeek R1 (hosted in North America) & other top open source models to do web search, coding, image generation, & image analysis. Available today for free!

101,495 просмотров • 1 год назад

The Together AI kernels team pushes performance to the next level. An investigation into how left more questions than answers, but VP of Kernels Dan Fu seemed proud. If you want the full picture, read on:

The Together AI kernels team pushes performance to the next level. An investigation into how left more questions than answers, but VP of Kernels Dan Fu seemed proud. If you want the full picture, read on:

36,525 просмотров • 5 месяцев назад

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

21,814 просмотров • 3 месяцев назад

Introducing Open Deep Research! A fully open-source Deep Research tool that: • writes comprehensive reports • does multi-hop search and reasoning • generates cover images & pod-casts! We’re releasing everything: evaluation dataset, code and blog.🔥 Example output report👇

Introducing Open Deep Research! A fully open-source Deep Research tool that: • writes comprehensive reports • does multi-hop search and reasoning • generates cover images & pod-casts! We’re releasing everything: evaluation dataset, code and blog.🔥 Example output report👇

66,680 просмотров • 1 год назад

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:

81,769 просмотров • 3 лет назад

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥

28,338 просмотров • 1 год назад

Huge thanks to the attendees, guest speakers, and sponsors who joined #AINativeConf at such a defining moment. As builders, researchers, and founders ship new AI-Native products and shape what’s possible – we’re excited for the future of AI and its applications. Thank you for coming along with us.

Huge thanks to the attendees, guest speakers, and sponsors who joined #AINativeConf at such a defining moment. As builders, researchers, and founders ship new AI-Native products and shape what’s possible – we’re excited for the future of AI and its applications. Thank you for coming along with us.

15,027 просмотров • 5 месяцев назад

Learn how Decagon partnered with Together AI, the AI Native Cloud, to meet growing demands and strict latency budgets – ensuring best-in-class AI customer support solutions. Details:

Learn how Decagon partnered with Together AI, the AI Native Cloud, to meet growing demands and strict latency budgets – ensuring best-in-class AI customer support solutions. Details:

16,266 просмотров • 6 месяцев назад

1/ We're excited to launch Together Talks, a series of conversations with researchers and industry leaders on generative AI, brought to you by Together AI. 🎙️ In this series, you’ll hear from Vipul Ved Prakash, Percy Liang, Ce Zhang, Tri Dao, and Shuaiwen Leon Song from Together AI; Scott Wu, CEO of @cognition; and Chip Huyen, VP of AI at Voltron Data, as they explore the ever-changing landscape of AI. 🧵👇

1/ We're excited to launch Together Talks, a series of conversations with researchers and industry leaders on generative AI, brought to you by Together AI. 🎙️ In this series, you’ll hear from Vipul Ved Prakash, Percy Liang, Ce Zhang, Tri Dao, and Shuaiwen Leon Song from Together AI; Scott Wu, CEO of @cognition; and Chip Huyen, VP of AI at Voltron Data, as they explore the ever-changing landscape of AI. 🧵👇

14,320 просмотров • 1 год назад

Больше нет контента для загрузки