Загрузка видео...

Не удалось загрузить видео

На главную

The @GitHub Research folks released a "Rubber Duck" agent for the Copilot CLI. Automatically get a review from a model from a different AI family. And their data shows that yes, this does in fact help. Quite a bit.

244,322 просмотров • 7 месяцев назад •via X (Twitter)

Комментарии: 31

Фото профиля Burke Holland
Burke Holland7 месяцев назад

Check their receipts on SWE Bench. Rubber duck closes 75% of the gap between Sonnet and Opus.

Фото профиля StratoLens
StratoLens7 месяцев назад

@gregor_suttie @github This has kind of been my workflow for a while now. Claude writes the code. A fresh Claude context reviews the code. Codex reviews the code too. Then copilot does its reviews during pull request. So 3 sets of eyes basically. Anecdotally codex finds more logic errors than Claude

Фото профиля Dinesh Pandiyan
Dinesh Pandiyan7 месяцев назад

@github how is this different from just an agent skill that could be invoked whenever needed?

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@dpandiyan @github It's invoked automatically and is part of the harness, which means it's gonna be way more reliable than a skill. That said, you could approximate this with a skill. A lot of people already do I think.

Фото профиля Julia Muiruri
Julia Muiruri7 месяцев назад

@github Can I argue that introducing the rubber-duck agent pushes the primary model to apply some self-evaluation That feeling when you are trying so hard to find what could be wrong WHILE being assessed, hoping to spot and fix something before it is pointed out

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@github Oh that's super interesting! Just calling the rubber duck caused the model to reevaluate itself? I think the idea is that GPT 5.4 has strengths over Claude family and vice versa. But I'm not clear on what those strengths are exactly.

Фото профиля Alan Gorton
Alan Gorton7 месяцев назад

@_Evan_Boyle @github Codex for code, Copilot for PR review has been my workflow (small ball, side projects) for a few months now. I really like the adversarial approach to reviews. Don’t have time to evaluate all the models, had to pick two. Copilot is very thorough in my experience, has good taste.

Фото профиля Christof Salis
Christof Salis7 месяцев назад

@github First of all: very cool! love seeing copilot innovating Second of all: thats not a rubber duck :(

Фото профиля Mãdālin VP
Mãdālin VP7 месяцев назад

@github That’s a why I created a claude code plugin for @Github Copilot

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@github Wait - this calls Copilot from CC?

Фото профиля Mãdālin VP
Mãdālin VP7 месяцев назад

@github Yes, the main idea is that Gpt5.4 for review and adversarial review of code or plan file

Фото профиля Mãdālin VP
Mãdālin VP7 месяцев назад

@github But you can also delegate tasks because Premium Requests is better than current CC pricing and usage

Фото профиля Alex Schantz
Alex Schantz7 месяцев назад

@github Have you done any comparisons yet to Anvil and its adversarial review?

Фото профиля Bowen Wang
Bowen Wang7 месяцев назад

@github Your boss @satyanadella retweeted

Фото профиля Sebastian Buzdugan
Sebastian Buzdugan7 месяцев назад

@github rubber ducking helps, but pairing it with property-based tests multiplies the impact

Фото профиля Coding is in a FLUX | AIコーディング
Coding is in a FLUX | AIコーディング7 месяцев назад

@github Rubber Duck agent for cross-model review is brilliant — different model families catch different blind spots.

Фото профиля Alex Rogov
Alex Rogov7 месяцев назад

The 74.7% gap closure is wild. We've been doing something similar manually — running Claude Code output through a GPT review step before committing. Cross-model validation catches a completely different class of errors than self-review. The key insight: models from the same family share the same blind spots. A second opinion from a different architecture is like getting a code review from someone with a different tech stack background.

Фото профиля Giuliano Lemes
Giuliano Lemes7 месяцев назад

@github Great, it's my workflow since we can ask for copilot some like this: "use gpt 5.x to build, Gemini and opus to review the code. In the end make a debate to validate the findings."

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@github Love the "debate" word there. That probably does a lot of heavy lifting on the semantics of the prompt.

Фото профиля Bryan Goode
Bryan Goode7 месяцев назад

@amandaksilver @github Fascinating

Фото профиля Joseph Mills
Joseph Mills7 месяцев назад

@github Seems like this naturally offloads complex reasoning to higher model and leaves straightforward execution to cheaper model. So you could rubber duck Sonnet with Opus and still get more efficiency.

Фото профиля Göran Halvarsson
Göran Halvarsson7 месяцев назад

@martinwoodward @github Do we have this in vs code too?

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@martinwoodward @github Not quite yet!

Фото профиля MindMentors
MindMentors7 месяцев назад

@github They should now plan for a graceful shut down of GitHub Copilot. They kind of fucked up the advantage - typical Microsoft.

Фото профиля PsudoMike 🇨🇦
PsudoMike 🇨🇦7 месяцев назад

Cross model review is such a good idea. Different training data means different blind spots. The principle that two sets of eyes catch more bugs applies to AI too. Running critical payment logic through multiple models for review is something teams should start building into their workflows.

Фото профиля Tobias Haar
Tobias Haar7 месяцев назад

@github The rubber-duck feature is really useful but it seems incredibly slow. Any idea what the reason for that is? How can we debug this? @_Evan_Boyle

Фото профиля 黄月英
黄月英7 месяцев назад

@github

Фото профиля Stefanescu Liviu
Stefanescu Liviu7 месяцев назад

@github Smart

Фото профиля Dimitar Radenkov
Dimitar Radenkov7 месяцев назад

@github Is this available for copilot chat?

Фото профиля Burke Holland
Burke Holland7 месяцев назад

@github Just the CLI atm

Фото профиля 独立开发者_屿风
独立开发者_屿风7 месяцев назад

This is such a powerful validation of multi-model cross-checking. Using a different AI family effectively breaks the "echo chamber" effect of a single LLM, catching the logical blind spots that one specific architecture might overlook. It feels like we’re moving toward a future where the gold standard for production code will be "consensus-driven" validation across diverse model architectures.

Похожие видео