Frame duplication detection based on BoW model


ULUTAŞ G. , ÜSTÜBİOĞLU B. , ULUTAŞ M. , NABIYEV V.

MULTIMEDIA SYSTEMS, cilt.24, ss.549-567, 2018 (SCI İndekslerine Giren Dergi) identifier identifier

  • Cilt numarası: 24 Konu: 5
  • Basım Tarihi: 2018
  • Doi Numarası: 10.1007/s00530-017-0581-6
  • Dergi Adı: MULTIMEDIA SYSTEMS
  • Sayfa Sayıları: ss.549-567

Özet

Duplicated sequence of frames in a video to cover up or replicate a scene is a video forgery. There are methods to authenticate video files, but embedding authentication information into videos requires extra hardware or software. It is possible to detect frame duplication forgery by carefully inspecting the content to discover high correlation among group of frames. A new frame duplication detection method based on Bag-of-Words (BoW) model is proposed in this paper. BoW is a model used in textual analysis first and image and video retrieval later by researchers. We used BoW to create visual words and build a dictionary from Scale Independent Feature Transform (SIFT) keypoints of frames in video. Frame features, i.e., visual word representations at keypoints, are used to detect sequence of duplicated parts in the video. The method computes thresholds depending on the content to improve both robustness and performance. The proposed method is tested on 31 test videos selected from Surrey University Library for Forensic Analysis (SULFA) and from various movies. Experimental results show a better detection performance and reduced run time compared to similar methods reported in the literature.