Efficient motion weighted spatio-temporal video SSIM index

Anush K. Moorthy, Alan C. Bovik, Bernice E. Rogowitz, Thrasyvoulos N. Pappas
<span title="2010-02-04">2010</span> <i title="SPIE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/65pgs7wxtvg7npmapw4eoo6dzy" style="color: black;">Human Vision and Electronic Imaging XV</a> </i> &nbsp;
Recently, Seshadrinathan and Bovik proposed the Motion-based Video Integrity Evaluation (MOVIE) index for VQA. 1, 2 MOVIE utilized a multi-scale spatio-temporal Gabor filter bank to decompose the videos and to compute motion vectors. Apart from its psychovisual inspiration, MOVIE is an interesting option for VQA owing to its performance. However, the use of MOVIE in a practical setting may prove to be difficult owing to the presence of the multi-scale optical flow computation. In order to
more &raquo; ... the gap between the conceptual elegance of MOVIE and a practical VQA algorithm, we propose a new VQA algorithm -the spatio-temporal video SSIM based on the essence of MOVIE. Spatio-temporal video SSIM utilizes motion information computed from a block-based motion-estimation algorithm and quality measures using a localized set of oriented spatio-temporal filters. In this paper we explain the algorithm and demonstrate its conceptual similarity to MOVIE; we explore its computational complexity and evaluate its performance on the popular VQEG dataset. We show that the proposed algorithm allows for efficient FR VQA without compromising on the performance while retaining the conceptual elegance of MOVIE.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1117/12.844198">doi:10.1117/12.844198</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/hvei/MoorthyB10.html">dblp:conf/hvei/MoorthyB10</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/dksiomvzdrdgbjfk3r5h7wmxlm">fatcat:dksiomvzdrdgbjfk3r5h7wmxlm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20110331214253/http://live.ece.utexas.edu/publications/2010/moorthy_spie_jan10.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/3c/e2/3ce2cb16d3104ac693b6547531c7df91537333a9.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1117/12.844198"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>