Deconstructing Word Embeddings [article]

Koushik Varma Kalidindi
2019 arXiv   pre-print
A review of Word Embedding Models through a deconstructive approach reveals their several shortcomings and inconsistencies. These include instability of the vector representations, a distorted analogical reasoning, geometric incompatibility with linguistic features, and the inconsistencies in the corpus data. A new theoretical embedding model, Derridian Embedding, is proposed in this paper. Contemporary embedding models are evaluated qualitatively in terms of how adequate they are in relation to the capabilities of a Derridian Embedding.
arXiv:1902.00551v1 fatcat:lykupezb3vfxxlngrbl4n7e3y4