DOD-CNN: Doubly-injecting Object Information for Event Recognition [article]

Hyungtae Lee, Sungmin Eum, Heesung Kwon
<span title="2019-02-11">2019</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Recognizing an event in an image can be enhanced by detecting relevant objects in two ways: 1) indirectly utilizing object detection information within the unified architecture or 2) directly making use of the object detection output results. We introduce a novel approach, referred to as Doubly-injected Object Detection CNN (DOD-CNN), exploiting the object information in both ways for the task of event recognition. The structure of this network is inspired by the Integrated Object Detection CNN
more &raquo; ... (IOD-CNN) where object information is indirectly exploited by the event recognition module through the shared portion of the network. In the DOD-CNN architecture, the intermediate object detection outputs are directly injected into the event recognition network while keeping the indirect sharing structure inherited from the IOD-CNN, thus being 'doubly-injected'. We also introduce a batch pooling layer which constructs one representative feature map from multiple object hypotheses. We have demonstrated the effectiveness of injecting the object detection information in two different ways in the task of malicious event recognition.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1811.02910v2">arXiv:1811.02910v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/cto6nzicqja5xpjvxt467lhuze">fatcat:cto6nzicqja5xpjvxt467lhuze</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200831011717/https://arxiv.org/pdf/1811.02910v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/a8/b0/a8b0b9ec344923ef93799f940ad4a20c5eebce9e.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1811.02910v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>