I have a lot of video files but also a lot of duplicate with different encoding differences (eg 720p and 4K versions). I wasn't able to find an open source solutions. I tried a Windows paid program who did half the job.

  • 1
    That looks really useful. You might want to edit your question to take out the answer and then answer your own question. – stib Nov 27 '18 at 3:03
  • I managed to answer it by creating an open source program around ffmpeg and findimagedupes. Feel free to try it : github.com/PierreCrette/VideoDedup/blob/master/README.md – Pierre Nov 27 '18 at 19:02

You could check out https://theophanemayaud.github.io/video-simili-duplicate-cleaner/ (macOS binaries available) It's open source, I created it based on vidupe and QT : https://github.com/kristiankoskimaki/vidupe (windows binaries available but no "auto deletion based on specific criterion")

The idea is to extract a few (eg 2, the first and the last) frames, and compare them. If the duration is close, and the frames look similar : you've got a duplicate.

It uses opencv for frame comparison, and ffmpeg for frame extraction (ffmpeg is also for video metadata which is very useful when trying to tell which video to keep !). Since it's open source, you can improve it to fit your needs !

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.