Together AI's banner
Together AI's profile picture

Together AI

@togethercompute • 64,255 subscribers

Accelerate inference, model shaping, and pre-training on a research-optimized platform.

Shorts

Access Mixtral with the fastest inference performance anywhere! Up to 100 token/s for $0.0006/1K tokens — to our knowledge the fastest performance at the lowest price! Mixtral-8x7b-32kseqlen Mistral AI & DiscoLM-mixtral-8x7b-v2 are live on Together API!

Access Mixtral with the fastest inference performance anywhere! Up to 100 token/s for $0.0006/1K tokens — to our knowledge the fastest performance at the lowest price! Mixtral-8x7b-32kseqlen Mistral AI & DiscoLM-mixtral-8x7b-v2 are live on Together API!

924,940 views

TogetherLink, coming soon.

TogetherLink, coming soon.

18,396 views

Shadow traffic proves a candidate is operationally sound. It can't tell you if users like it better. A/B testing belongs at the endpoint, not in your app code. Same endpoint name, API, and keys for your clients. No feature flags, no hash-mod-100 in client code, no spreadsheet explaining what group A vs B means. Split a live endpoint's traffic into one control and up to 20 variants, each with a fixed percentage. Ramp with a single call. Delete the experiment and 100% of traffic returns to the control, with nothing left to unwind. Read the full walkthrough:

Shadow traffic proves a candidate is operationally sound. It can't tell you if users like it better. A/B testing belongs at the endpoint, not in your app code. Same endpoint name, API, and keys for your clients. No feature flags, no hash-mod-100 in client code, no spreadsheet explaining what group A vs B means. Split a live endpoint's traffic into one control and up to 20 variants, each with a fixed percentage. Ramp with a single call. Delete the experiment and 100% of traffic returns to the control, with nothing left to unwind. Read the full walkthrough:

16,101 views

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

88,229 views

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Announcing Together Link! Run frontier open models in your favorite coding harness. Track your spending and let our Auto router pick the model for you: low-cost models for quick fixes, more capable models for harder tasks.
0:57
togethercompute's profile picture

Announcing Together Link! Run frontier open models in your favorite coding harness. Track your spending and let our Auto router pick the model for you: low-cost models for quick fixes, more capable models for harder tasks.

Together AI

31,397 views • 13 days ago

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:
1:12
togethercompute's profile picture

What if your LLM inference automatically got faster the more you used it? Introducing ATLAS from the Together AI Turbo research team. Read more: Here’s Together AI Founder and Chief Scientist Tri Dao introducing ATLAS:

Together AI

143,861 views • 1 year ago

Compute has always been core to the Verne Robotics story. Getting there meant negotiating long, expensive contracts with big neoclouds, and projecting compute needs years into the future. Verne wasn't ready for that. Then came the Y Combinator cluster, built on Together AI. Verne trained a model 3x larger, on almost 100x more data. More data in, bigger foundation models out.
1:10
togethercompute's profile picture

Compute has always been core to the Verne Robotics story. Getting there meant negotiating long, expensive contracts with big neoclouds, and projecting compute needs years into the future. Verne wasn't ready for that. Then came the Y Combinator cluster, built on Together AI. Verne trained a model 3x larger, on almost 100x more data. More data in, bigger foundation models out.

Together AI

21,649 views • 1 month ago

Introducing Together Chat! Use DeepSeek R1 (hosted in North America) & other top open source models to do web search, coding, image generation, & image analysis. Available today for free!
1:19
togethercompute's profile picture

Introducing Together Chat! Use DeepSeek R1 (hosted in North America) & other top open source models to do web search, coding, image generation, & image analysis. Available today for free!

Together AI

101,618 views • 1 year ago

The Together AI kernels team pushes performance to the next level. An investigation into how left more questions than answers, but VP of Kernels Dan Fu seemed proud. If you want the full picture, read on:
1:49
togethercompute's profile picture

The Together AI kernels team pushes performance to the next level. An investigation into how left more questions than answers, but VP of Kernels Dan Fu seemed proud. If you want the full picture, read on:

Together AI

36,575 views • 6 months ago

Introducing Open Deep Research! A fully open-source Deep Research tool that: • writes comprehensive reports • does multi-hop search and reasoning • generates cover images & pod-casts! We’re releasing everything: evaluation dataset, code and blog.🔥 Example output report👇
0:34
togethercompute's profile picture

Introducing Open Deep Research! A fully open-source Deep Research tool that: • writes comprehensive reports • does multi-hop search and reasoning • generates cover images & pod-casts! We’re releasing everything: evaluation dataset, code and blog.🔥 Example output report👇

Together AI

66,680 views • 1 year ago

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.
0:37
togethercompute's profile picture

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

Together AI

21,814 views • 5 months ago

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:
1:20
togethercompute's profile picture

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:

Together AI

81,769 views • 3 years ago

Together AI and Y Combinator are launching the first dedicated YC GPU cluster. Startups in the YC portfolio can now access compute on a few weeks' commitment, instead of a 24-month contract.
1:59
togethercompute's profile picture

Together AI and Y Combinator are launching the first dedicated YC GPU cluster. Startups in the YC portfolio can now access compute on a few weeks' commitment, instead of a 24-month contract.

Together AI

11,453 views • 3 months ago

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥
0:21
togethercompute's profile picture

Introducing the Open Deep Research app! Generate detailed reports on any topic with open source LLMs. Free & fully open source. We’re releasing everything: evaluation dataset, code, app, and blog.🔥

Together AI

28,338 views • 1 year ago

Learn how Decagon partnered with Together AI, the AI Native Cloud, to meet growing demands and strict latency budgets – ensuring best-in-class AI customer support solutions. Details:
2:26
togethercompute's profile picture

Learn how Decagon partnered with Together AI, the AI Native Cloud, to meet growing demands and strict latency budgets – ensuring best-in-class AI customer support solutions. Details:

Together AI

16,385 views • 8 months ago

Huge thanks to the attendees, guest speakers, and sponsors who joined #AINativeConf at such a defining moment. As builders, researchers, and founders ship new AI-Native products and shape what’s possible – we’re excited for the future of AI and its applications. Thank you for coming along with us.
1:41
togethercompute's profile picture

Huge thanks to the attendees, guest speakers, and sponsors who joined #AINativeConf at such a defining moment. As builders, researchers, and founders ship new AI-Native products and shape what’s possible – we’re excited for the future of AI and its applications. Thank you for coming along with us.

Together AI

15,027 views • 7 months ago

1/ We're excited to launch Together Talks, a series of conversations with researchers and industry leaders on generative AI, brought to you by Together AI. 🎙️ In this series, you’ll hear from Vipul Ved Prakash, Percy Liang, Ce Zhang, Tri Dao, and Shuaiwen Leon Song from Together AI; Scott Wu, CEO of @cognition; and Chip Huyen, VP of AI at Voltron Data, as they explore the ever-changing landscape of AI. 🧵👇
1:29
togethercompute's profile picture

1/ We're excited to launch Together Talks, a series of conversations with researchers and industry leaders on generative AI, brought to you by Together AI. 🎙️ In this series, you’ll hear from Vipul Ved Prakash, Percy Liang, Ce Zhang, Tri Dao, and Shuaiwen Leon Song from Together AI; Scott Wu, CEO of @cognition; and Chip Huyen, VP of AI at Voltron Data, as they explore the ever-changing landscape of AI. 🧵👇

Together AI

14,320 views • 2 years ago

No more content to load