Ano-Graph: Learning Normal Scene Contextual Graphs to Detect Video Anomalies [article]

Masoud Pourreza, Mohammadreza Salehi, Mohammad Sabokrou
<span title="2021-04-24">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Video anomaly detection has proved to be a challenging task owing to its unsupervised training procedure and high spatio-temporal complexity existing in real-world scenarios. In the absence of anomalous training samples, state-of-the-art methods try to extract features that fully grasp normal behaviors in both space and time domains using different approaches such as autoencoders, or generative adversarial networks. However, these approaches completely ignore or, by using the ability of deep
more &raquo; ... works in the hierarchical modeling, poorly model the spatio-temporal interactions that exist between objects. To address this issue, we propose a novel yet efficient method named Ano-Graph for learning and modeling the interaction of normal objects. Towards this end, a Spatio-Temporal Graph (STG) is made by considering each node as an object's feature extracted from a real-time off-the-shelf object detector, and edges are made based on their interactions. After that, a self-supervised learning method is employed on the STG in such a way that encapsulates interactions in a semantic space. Our method is data-efficient, significantly more robust against common real-world variations such as illumination, and passes SOTA by a large margin on the challenging datasets ADOC and Street Scene while stays competitive on Avenue, ShanghaiTech, and UCSD.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2103.10502v2">arXiv:2103.10502v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/g3uhxx7kgbgabdsyj5b76be6fm">fatcat:g3uhxx7kgbgabdsyj5b76be6fm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210429145929/https://arxiv.org/pdf/2103.10502v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/94/c2/94c2a07b0285de0470c19e7b42ba138bd2028a09.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2103.10502v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>