We need to talk about AI video editing.

excellent video. last 10 minutes are a must watch. insane you are doing all this from your phone lol. what i'm trying to understand is, why was opus 5.5 an unlock for video editing? in theory i don't see anything new that previous models couldn't have done? (aside from better graphics/animations)

Cheers! They just trained hard for it on Opus 5.5 adding in the `/motion` command in CC (currently in beta). I'm guessing the harness they used to train this feature also conferred a lot of general editing skills. As I mentioned in the video, from Fable onwards, it was a bit of a game changer for general macro editing, but end-to-end editing since Opus 5.5 (meaning no intermediate post-production software) has been transformed. Remarkably, it even works without a harness, which can only mean they've specifically trained it to do so. It even uses NumPy to generate (crappy) sound design effects, which is likely something they've specifically trained it to do too.

when you say without a harness, you mean using claude API directly?

I mean using the Claude Code harness without a dedicated video editing harness. A video editing harness, for example, would have a timeline and clips as first-class concepts.

ah gotcha

This is amazing, well done love your approach to this, currently, only at timestamp 6:36 and I do this a lot natively in Claude Code

Finished this video, man such truth! Great work, more of this please

You're awesome! Thanks for doing this man!

This is turning into one of the more collaborative and genuinely useful story arcs in a long time Smart pragmatic people doing things pragmatically

thank you for taking the time to make this.

28:20 I'm definitely feeling it right now. I have published 1% of the content I've wanted to and now I finally feel like I can go fast. AI can extrapolate btw. It can automate things that are not known. It can create new knowledge.

21:50 It will be automated. Judgment and exploration are both fundamental components of intelligence. As AI gets better, it just moves up levels of abstraction.

Do agent edits land in your timeline, or come back as a finished clip?

is the web app you are showing available somewhere?

No sorry, it's just the review app component of ReScript. It's super simple though - you could vibe something similar in no time.

yup, agreed, but wanted to support if you had it available feel bad just to rip it after getting the value of the video lol, appreciate it

the part that gets skipped in these talks is review time. if fixing the AI's cut takes longer than cutting it yourself, nothing was saved

Review is a massive burden with normal video editing. I'm sure you've had the pain of using frame io before. With agentic editing, you can actually add metadata to the review tool, honing in on exactly where the changes were made. It's a good observation, though, that with AI, pretty much the majority of work becomes review and iteration. The colour coding in the timeline is showing me: 1) Which sections have changed? 2) Which sections have I watched? 3) Which speaker?

Tech bros will do games, reiterate Software/kernel/OS and sell inference. And that's ok.