CVD2014 - A database for evaluating no-reference video quality assessment algorithms [article]

Mikko Nuutinen, Toni Virtanen, Mikko Vaahteranoksa, Tero Vuori, Pirkko Oittinen, Jukka Häkkinen
2016 Zenodo  
The CVD video database is developed to provide an useful tool for researchers in the validation and developing processes of no-reference (NR) objective video quality assessment (VQA) algorithms. It consists of 234 videos from five different scenes captured by 78 different cameras (mobile phones, compact camera, video camera, SLR). The subjective experiments are conducted following the Single-Stimulus (SS) procedure to collect ratings of video quality. Setup We implement our experiments
more » ... to the Single Stimulus methodology using VQone MATLAB toolboxon high quality monitors (Eizo ColorEdge CG241W) with 1920x1200 pixel resolution in a dark room (ambient light < 20 lux). Video stimuli were displayed at their original size of VGA (640 x 480) or HD (1280 x 720). The subjects viewing distance (80 cm) was controlled by a string hanging from a ceiling and they were instructed to keep their head steady next to it. The monitors were calibrated to according to sRGB (target values were: 6500 K, 80 lux, and gamma 2.2) using EyeOne Pro calibrator (X-rite co.). The laboratory setup is showed in the figure below. Subjects Subjects (n = 30, 30, 28, 33, 30, 32 and 27 for Tests 1 - 7 respectively) were naïve in a sense that they did not study or work with image quality or related fields. They were recruited through student mailing lists consisting mainly humanities and behavioral science students. Subjects' vision was controlled for the near visual acuity, near contrast vision (near F.A.C.T.) and color vision (Farnsworth D15) before the participation. They received movie tickets as a reward. Procedure Subjects evaluated one video sample at a time and all video samples of one scene were presented in a row. The order of video samples and scenes was randomized. Subjects had the option to view video samples again as many times as they wanted. Data The results are processed and reported in the form of Mean Opinion Score (MOS) for the tested video sampl [...]
doi:10.5281/zenodo.2646314 fatcat:r4qf2kfkgnf7hozy2hbu5ahyke