r/ffmpeg • • Nov 17 '24

AI powered FFMPEG prototype.

After fighting with ffmpeg commands and testing the output, I finally got around today to prototyping an idea I've had.

I hooked up an AI (Anthropic) to the program so you can just describe what you want ffmpeg to do and it creates the command. Just press play to see the output.

You can also add partial commands that will be completed or just get any ffmpeg info without reading the documentation, the AI will do that for you and give you a summary and the command to run.

I just put it together today but I've tested trimming, slow motion, joining folders of videos, joining individually selected videos, image with use selected audio, captions, watermarks and video filters.

If anyone is interested I could use some testers in 3-4 days, no charge or anything, just need feedback and feature ideas.

When I'm done the UI will be much nicer, I just started today so was glad to get it working.

Let me know and I'll send you a link after get everything together. Thanks

0 Upvotes

10 comments sorted by

2

u/vamonosgeek Nov 18 '24

Looks neat. I’d like to play with it.

2

u/SpamNightChampion Nov 18 '24

Needs a lot of work but I'm trying to get to it this week. I'll respond back here when ready.

1

u/vamonosgeek Nov 18 '24

Sure! No problem.

5

u/[deleted] Nov 17 '24 edited Nov 17 '24

Interesting. You asked it to remove the last 3 seconds, and it looks like it removed everything but the last 3 seconds instead? Also, assuming keeping only the last 3 seconds was the goal, the -t 3 is superfluous; -ss 15 would have sufficed since the input video ends three seconds after the 00:15 mark anyway. Also, the font the AI chose to use is not the one selected in the dropdown menu.

Neat concept but I sure do understand the need for testers. šŸ˜…

But yeah, I'd definitely like to see this project pan out. I use ChatGPT a lot for brainstorming and figuring out FFMPEG commands where there isn't a lot of documentation or solid answers in the first few search results on Google. Your app could be a lot more convenient once the functionality and accuracy are up there.

3

u/vegansgetsick Nov 17 '24

there is this -sseof option to seek from the end, so it could be -sseof -3

https://ffmpeg.org/ffmpeg.html#Main-options

1

u/Nuvotion May 01 '25

Any updates on this project? Seems like a good and pretty much inevitable idea. I've heard talk about MCP servers, maybe that could help facilitate it.

1

u/SpamNightChampion May 01 '25

I actually got back to it a few days ago after not touching it since the original post.

I was busy with work and doing some other things more pressing but got back to it.

I've learned a lot more about AI and especially with keeping AI conversations going so the user can make a series of small tweaks as they go. I've add voice commands via AI too so the user can just use their mic and it will edit the video. I've add drag and drop images, folder selections etc so they can build a video with a mix of photos and videos with different durations, transitions and such.

I added a bunch of features that I'd want plus just a standard FFMPEG based chat window that can help with command line issues, just a bunch of features in general. Right now I'm hooking up the main user interface (using this UI kit for it https://www.syncfusion.com/wpf-controls ) thankfully that's the last thing. I'll post back here when I finally get it all together. Thanks for the message, good to know someone is interested. Take care

1

u/Empty_Living1167 Mar 23 '25

I wsnt the lynk pls