Multimodal Sequential Fashion Attribute Prediction

Hasan Sait Arslan, Kairit Sirts, Mark Fishel, Gholamreza Anbarjafari
<span title="2019-10-03">2019</span> <i title="MDPI AG"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/dmr4kpn2yreovpdxpdiqtjcrnu" style="color: black;">Information</a> </i> &nbsp;
We address multimodal product attribute prediction of fashion items based on product images and titles. The product attributes, such as type, sub-type, cut or fit, are in a chain format, with previous attribute values constraining the values of the next attributes. We propose to address this task with a sequential prediction model that can learn to capture the dependencies between the different attribute values in the chain. Our experiments on three product datasets show that the sequential
more &raquo; ... l outperforms two non-sequential baselines on all experimental datasets. Compared to other models, the sequential model is also better able to generate sequences of attribute chains not seen during training. We also measure the contributions of both image and textual input and show that while text-only models always outperform image-only models, only the multimodal sequential model combining both image and text improves over the text-only model on all experimental datasets.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3390/info10100308">doi:10.3390/info10100308</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/435kwdcbpbdepnwqt2ewyzpqay">fatcat:435kwdcbpbdepnwqt2ewyzpqay</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200211234301/https://res.mdpi.com/d_attachment/information/information-10-00308/article_deploy/information-10-00308-v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/1d/22/1d2265be105e929aad025c428ae14e1aacdcc42e.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3390/info10100308"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> mdpi.com </button> </a>