VIAN: A Visual Annotation Tool for Film Analysis

Gaudenz Halter, Rafael Ballester‐Ripoll, Barbara Flueckiger, Renato Pajarola
2019 Computer graphics forum (Print)  
Color plays a fundamental role in film design and production. Unfortunately, existing solutions for film analysis in the digital humanities address perceptual and spatial color information only tangentially. We introduce VIAN, a visual film annotation system centered on the semantic aspects of color film analysis. The tool enables expert-assessed labeling, curation, visualization, and classification of film color features based on their perceived context and aesthetic quality. Crucially, it is
more » ... lso the first of its kind that incorporates foreground-background information as it is made possible by modern deep learning segmentation methods. The proposed visual front-end is seamlessly integrated with a multimedia data management system, so that films can undergo a full color-oriented analysis pipeline by scholars and practitioners. Figure 1: Left: Single segment analysis in VIAN showing its timeline and perceptual color widgets. Right: Global view showing a vocabulary navigator for interactive semantic analysis and annotation, keyword-filtered ensemble of screenshots, and visualization of the film's frames over time according to their chromatic qualities. Abstract While color plays a fundamental role in film design and production, existing solutions for film analysis in the digital humanities address perceptual and spatial color information only tangentially. We introduce VIAN, a visual film annotation system centered on the semantic aspects of film color analysis. The tool enables expert-assessed labeling, curation, visualization and classification of color features based on their perceived context and aesthetic quality. It is the first of its kind that incorporates foreground-background information made possible by modern deep learning segmentation methods. The proposed tool seamlessly integrates a multimedia data management system, so that films can undergo a full color-oriented analysis pipeline.
doi:10.1111/cgf.13676 fatcat:xkv37sffkbdczgzpmpqzncojhm