Locality and compositionality in zero-shot learning [article]

Tristan Sylvain, Linda Petrini, Devon Hjelm
2019 arXiv   pre-print
In this work we study locality and compositionality in the context of learning representations for Zero Shot Learning (ZSL). In order to well-isolate the importance of these properties in learned representations, we impose the additional constraint that, differently from most recent work in ZSL, no pre-training on different datasets (e.g. ImageNet) is performed. The results of our experiments show how locality, in terms of small parts of the input, and compositionality, i.e. how well can the
more » ... rned representations be expressed as a function of a smaller vocabulary, are both deeply related to generalization and motivate the focus on more local-aware models in future research directions for representation learning.
arXiv:1912.12179v1 fatcat:ewkdisldxrgupb2grshj4ucncm