Loading video...

Video Failed to Load

Go Home

Used the @GitHub Copilot SDK to let the Copilot CLI call me when it needs my opinion on something.

108,449 views • 9 months ago •via X (Twitter)

41 Comments

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

Just out here working hard to get my colleagues @davidfowl and @shanselman to repost me.

Yuval Avidani (יובל אבידני)'s profile picture
Yuval Avidani (יובל אבידני)9 months ago

@github That’s insane! How does this work technically? (If you don’t mind sharing)

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Never mind sharing - Eleven Labs + Electron tray app + enhanced ask tool that calls and prompts at the same time to take the first response. Voice agent is configured to seek clarity on some context passed so it can return a structured answer and allow the CLI to continue.

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Also made me realize we need to improve our preToolUse hook so others can plug in extensions like this easily.

Yuval Avidani (יובל אבידני)'s profile picture
Yuval Avidani (יובל אבידני)9 months ago

@github So cool! Haven’t tried electron yet. Not sure why I should use it over bun usually. Web is easiest for me. I find myself battling with running MCP servers / skills from WhatsApp. There are bugs I’m solving all the time and easy MCP import / deployment could be a game changer

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github I personally like to keep things as bare bones as possible so the agent can work with the most standard setup possible. The gains are good enough to find the experience way more enjoyable than the status quo. Fav motto is "do less". 🙂

Simon C's profile picture
Simon C9 months ago

@github My god. That's mad (in a good way)...! I can definitely see the future when we basically just start talking to our agents vocally the entire time... What a crazy glimpse into the future! Nice work!

Rob Williford's profile picture
Rob Williford9 months ago

@github This is sick - gimme now plz

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Will ship as soon as I can get a new mechanism put into the CLI for handling the "prompt, but also see if you can get an answer some other way from the user" scenario. Was magical and can be scaled to sets of people.

Rob Williford's profile picture
Rob Williford9 months ago

@github Saw some of your comments and think I have more than enough to cook something up on my end - keep it up!

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Get at it! We'll make it better so you can just hook into the ask tool directly for more deterministic behavior. Fewer great tools for agents the better.

Rob Williford's profile picture
Rob Williford9 months ago

@github your team hiring?

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Not currently but things are always changing quick!

Bilal's profile picture
Bilal9 months ago

@github Ok, this is truly next level

nathfavour's profile picture
nathfavour9 months ago

@github So many amazing things being built 🔥

Ditectrev's profile picture
Ditectrev8 months ago

@github this is actually cool!😎

Robs's profile picture
Robs9 months ago

@github That's cool.... could see that being useful in a variety of systems

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Super excited to turn the tools from reactive to proactive this year. Going to be the real unlock along with deep personalization.

ravi singh's profile picture
ravi singh8 months ago

@github altruistic

Kodax's profile picture
Kodax9 months ago

@github Co-pilot looking at my code… “Do you have time for a quick 5 min touch base call about your code”

Ohad Gertel's profile picture
Ohad Gertel9 months ago

@github I barely answer phone calls from my own mother

Joseph Musenge's profile picture
Joseph Musenge9 months ago

@github this is super cool

𝕯𝖆𝖋𝖞𝖉𝖉 𝕹𝖆𝖕𝖎𝖊𝖗's profile picture
𝕯𝖆𝖋𝖞𝖉𝖉 𝕹𝖆𝖕𝖎𝖊𝖗9 months ago

@github I’m asking my AI for its opinion.👾

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Trained it on my voice soooo technically I am asking myself for my opinion, kinda?

gelado's profile picture
gelado9 months ago

@github I really need this

This is Dmitry Zhomir's profile picture
This is Dmitry Zhomir9 months ago

@github cool shit, this needs to go viral

Ohad Gertel's profile picture
Ohad Gertel9 months ago

@github This is the exact opposite of automation

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Prefer to experiment over automate all the time. Sometimes things end up helping with automation but this was about laying the groundwork to be able to interact with the CLI on my home machine using modalities available on different devices for convenience.

Ofer'Ke (عوفر) 🇮🇱🎗️'s profile picture
Ofer'Ke (عوفر) 🇮🇱🎗️9 months ago

@github So you have a whatsapp account dedicated for your pc?

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github No WhatsApp account though I built the tray app so that I could use it to connect to other external services if desired. WhatsApp has been something I plan to play with.

Hamed's profile picture
Hamed8 months ago

@github open source it plz

Patrick Nikoletich's profile picture
Patrick Nikoletich8 months ago

@superham @github Will soon

Brijesh Wawdhane's profile picture
Brijesh Wawdhane9 months ago

@github Don’t get me wrong this is very cool but after the excitement goes away I don’t think it’s a decent long term solution

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Just a working prototype on the journey to the long range solution. So many pieces had to come together to make this possible within a few hours.

Igder Koman 👾's profile picture
Igder Koman 👾9 months ago

@github Lol

Rob Williford's profile picture
Rob Williford9 months ago

@github what about on hold mode/q for multiple sub agents who may need input on their various scopes?

Patrick Nikoletich's profile picture
Patrick Nikoletich9 months ago

@github Has a queue built in 😀

Rob Williford's profile picture
Rob Williford9 months ago

@github AH perf :)

WTF.ai's profile picture
WTF.ai8 months ago

@shanselman @github Can we use the underlying github copilot cli to integrate with agents in M365 using agents sdk/teams toolkit

Patrick Nikoletich's profile picture
Patrick Nikoletich8 months ago

@shanselman @github I don't know but will try and prob circle back around.

WTF.ai's profile picture
WTF.ai8 months ago

@shanselman @github Any luck with this?

Related Videos