I have an image-based processing module that takes photos for some computer vision processing. I have many videos, but I need to sample representative frames as its inputs, preferably those frames with higher attention.

What are some good and effective algorithms or approaches to take K sample frames in a video? Interesting feature is that usually camera doesn't move much in successive frames with higher attention. So basically we have more stable scenes when a person is focusing on something important. Is there any ways to take this into account for our samlping?

  • 3
    ffmpeg has a thumbnail filter whose purpose is to "Select the most representative frame in a given sequence of consecutive frames". What it does is calculate the avg histogram of an interval of frames and select the frame whose histogram is nearest to the avg. one. – Gyan Jul 3 '18 at 19:43
  • @Gyan Do you have a reference for how thumbnail really work? Those histogram and such? – Tina J Jul 5 '18 at 21:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.