Loading video...
Video Failed to Load
Exciting update to Copilot on Perplexity with OpenAI's GPT-3.5 fine-tuning API! We've improved speed, reduced cost, and matched GPT-4 performance. Copilot now engages faster without losing quality. Here's what you need to know: 🧵
574,254 views • 2 years ago •via X (Twitter)
10 Comments

Our fine-tuned GPT-3.5 model ties with the GPT-4-based model in human ranking on our task. This isn’t just about speed; it’s about delivering precise and accurate responses to your complex queries. Now you get the best of Perplexity at your finger tips.

We’ve reduced the model latency by 4-5x, serving results on average in 0.65 seconds instead of 3.15 seconds (FT-GPT-3.5 compared to GPT-4). You may notice the speedup when Copilot prompts you for user input. Every second counts, and we’re here to make them all productive.

The transition to the fine-tuned GPT-3.5 model also reduces inference costs. This efficiency enables us to continue investing in enhancements, making your Perplexity experience even better. Try Perplexity Copilot now and see the difference for yourself!

@OpenAI Awesome addition. Speed is king. You guys should put a CopilotTextarea in the input form to make the entire experience even quicker

@OpenAI We found that fine tuning inference took longer is yours faster because you have dedicated hosting

@OpenAI Wow! It truly works much faster! I hope we’ll receive more free uses of Copilot, or at least less expensive subscriptions, through this development. 😄

@OpenAI @bradleybernard

@OpenAI Should we cancel the Perplexity pro subscription and revert from GPT-4 to GPT-3.5? 😎

@OpenAI Wow! This is amazing

@OpenAI When does this ship!? Would love to try it. Just tried on the iOS app with this question and it’s still just a standard response



