Loading video...

Video Failed to Load

Go Home

Introducing OpenChatKit 🚀 - The first open-source alternative to ChatGPT! A team of ex-OpenAI fellows at Together have released a 20B chat-GPT model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B, with over 43 million instructions under the Apache-2.0 license. >>>

555,517 views • 3 years ago •via X (Twitter)

10 Comments

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

This instruction-tuned large language model has been optimized for chat on 100% carbon-negative compute. OpenChatKit includes four essential components: >>>

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

- An instruction-tuned large language model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B with over 43 million instructions on carbon-negative compute. - Customization recipes that help fine-tune the model to deliver high accuracy results for specific tasks.

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

- An extensible retrieval system that allows you to add information from a document repository, API or other live-updating information sources at inference time. - A moderation model, fine-tuned from GPT-JT-6B, that filters which questions the bot responds to. Holy cow!!! 🐄

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

Github - Demo -

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

Follow on Patreon for Unique & Daily AI content-

we are here because we are here because we are -'s profile picture
we are here because we are here because we are -3 years ago

How is it different from ChatGPT? Please explain to me like I'm 5.

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

You have access to the model's weights and training data.

Djamé..'s profile picture
Djamé..3 years ago

things are going way too fast these days...

Itamar Golan 🤓's profile picture
Itamar Golan 🤓3 years ago

Enjoy the ride 😎

AgenticApp.com's profile picture
AgenticApp.com3 years ago

Congrats to the team at Together for releasing OpenChatKit, Keep up the great work!

Related Videos

Sam Altman on the Paul Graham advice that saved Open AI: “Always make an API” Four years into OpenAI, Sam Altman and the team realized that they would have to build a really big company to fund the development of their increasingly capital-intensive foundation models. “We had this model called GPT-3,” Sam recalls. “I was turning up the urgency on the company to try and figure out a product, and we just couldn’t. It was cool, but it wasn’t good enough to make something that worked.” Then Sam remembered a piece of advice from Y Combinator founder Paul Graham that stuck with him: “You should always make an API. No matter what, you should make an API. Good stuff will happen.” Out of ideas for a product, the OpenAI team decided to make GPT-3 available as an API. “Maybe somebody will figure out something to do with it,” Sam thought. A few copywriting applications like Jasper and Copy AI did take off using the GPT-3 API, but OpenAI also noticed interesting behavior that eventually became a sleeper hit: “Some people — not a lot — would just chat with that thing all day,” Sam explains. “It wasn’t very good but there was clear user signal that people wanted to talk to the models. And given that that was the only thing besides copywriting that had real traction, we said, ‘Maybe this is just he product we should build.’” On November 30, 2022, ChatGPT was released to the public as a “research preview” using a model from the GPT-3.5 series. It reached over a million users in five days. Video source: Khosla Ventures (2025)

Startup Archive

219,278 views • 10 months ago