I am looking for an automated method to identify duplicated video files from my large collection of videos.

I have used fslint to do this in the past, but I started fixing the EXIF tags on my videos, which makes fslint identify them as different files. The only difference between the original file and the modified files are the EXIF tags, which in most cases have simply been time-shifted to correct for timezone or camera offset. The videos have not had any encoding or conversion of any type.

Is there a tool something that I can use to identify duplicate videos based only on the AV streams, i.e. ignoring the tags? I'm essentially looking to duplicate fslint-like functionality, but ignoring the EXIF tags. Does such a tool exist?

I have a suspicion that ffmpeg can be used to do this, but all I've been able to find so far is this answer, which shows how to blend two video streams together and display the difference. Doing so "works" in the sense that I get a solid green screen with my duplicate files (indicating no pixel differences), but I can't use that in a script to handle hundreds of comparisons because I still have to visually inspect the result.

Is there a way to get ffmpeg to give a yes/no answer?

I've seen this answer, but found the answer to be entirely too manual. I need an automated process that can go through large filesets in one run.


I had the same question and I managed to answer it by creating an open source program around ffmpeg and findimagedupes. Feel free to try it : https://github.com/PierreCrette/VideoDedup/blob/master/README.md

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.