Загрузка видео...

Не удалось загрузить видео

На главную

By the way, you can extract JUST the reasoning from deepseek-reasoner, which means you can send that thinking process to any model you want before they answer you. Like here where I turn gpt-3.5 turbo into an absolute genius!

1,325,059 просмотров • 1 год назад •via X (Twitter)

Комментарии: 11

Фото профиля Pietro Schirano
Pietro Schirano1 год назад

What's even crazier is that this is done with a max tokens of 1, meaning I am not even paying for any output here.

Фото профиля PDF GPT
PDF GPT2 лет назад

Everyone is getting ahead with AI. You should be too. Summarize documents, craft emails, and generate custom content instantly with this powerful tool. It's like having ChatGPT tailored for your job. Try it for free.

Фото профиля Pietro Schirano
Pietro Schirano1 год назад

This is really interesting because: Sometimes a faster, cheaper model may not know how to answer a question correctly or imagine when you need to fix code. As long as the thinking process is correct, even a dumber, cheaper model may get the answer correctly.

Фото профиля Seth Rose
Seth Rose1 год назад

So in theory.... 1️⃣ Use DeepSeek for reasoning to break down a prompt into steps. 2️⃣ Store and track progress using long-context models (Gemini/MiniMax-01). 3️⃣ Research individual steps using tools like Perplexity. 4️⃣ Combine everything for a genius-level final response! 🔥 Sounds like agentic reasoning?

Фото профиля ⚡️Dylan White
⚡️Dylan White1 год назад

🤯 So you're basically channeling deepseek’s brain into GPT-3.

Фото профиля Pietro Schirano
Pietro Schirano1 год назад

Or any model you want, since I am using @OpenRouterAI

Фото профиля Ryan Christophe
Ryan Christophe1 год назад

Deepseek + Claude Sonnet might produce some great results then?

Фото профиля Atlas3D
Atlas3D1 год назад

this is like a form of speculative decoding isnt it?

Фото профиля Rudy Baddha-Mouradi
Rudy Baddha-Mouradi1 год назад

It's fascinating how efficiency can come at a low cost. Who knows what other breakthroughs lie ahead? #Innovation

Фото профиля daniel inderos
daniel inderos1 год назад

I need to try this. Can you please upload it to your GitHub?

Фото профиля Whirli
Whirli1 год назад

After seeing several posts about watching R1’s reasoning process, I was just thinking about the use cases for watching it think through problems. Just had to keep scrolling to find your useful post.

Похожие видео

How can you solve complex tasks using a Large Language Model? Here is a 2-minute introduction to everything you need to know to 10x the quality of your results. Let's talk about three techniques, in order of complexity, starting with the easiest one: • In-Context Learning • Indexing + In-Context Learning • Fine-tuning In-Context Learning The team that trained GPT-3 found something they couldn't explain: You can condition a model using examples of how you want it to behave. I included an example prompt in the attached video. You can "teach" the model how you want it to interpret questions, select the correct answers, and format the results by giving a few examples. You can also give specific knowledge to the model that will be helpful when formulating answers. We call this approach "grounding the model." There's another example in the video. Indexing + In-Context Learning Unfortunately, there is a limit to how much data you can include in a prompt. We call this the "context size." One version of GPT-4 supports a context of approximately 6,000 words, while the other supports 25,000 words. Although this sounds like a lot, many applications need more than that. Imagine you wrote a book and want to build an application to answer any questions about your story. What happens if your book is longer than the context? That's where Indexing comes in. Using a model, you can turn every book passage into an embedding. These are vectors, numbers that "encode" the passage's text. You can then store these embeddings in a particular database that supports fast retrieval of these vectors. You can then turn any question into an embedding and search the database for the list of passages that are similar to that query. Instead of using the entire book to ask the model, you can now use the relevant passages as in-context information, effectively working around the context size limitation. Fine-tuning Fine-tuning can give you an extra boost to get reliable outputs from your LLM. It is, however, the most complex approach on the list. There are different approaches to fine-tuning a model with your data. A popular technique is to process your data with your LLM and use the outputs to train a new classifier that solves your specific task. Notice that here you aren't modifying the LLM. Instead, you are chaining it with your trained classifier. Another approach is to modify the parameters of the LLM using your data. Think of this as "rewiring" the model in a way that solves your particular task. The results and costs will vary depending on how many layers you want to fine-tune from the original model. Many companies think that fine-tuning is the solution to their problems. In my experience, many will benefit from exploring the other two approaches. I love explaining Machine Learning and Artificial Intelligence ideas. If you enjoy in-depth content like this, follow me Santiago so you don't miss what comes next.

Santiago

384,510 просмотров • 3 лет назад