Deep Learning the EEG Manifold for Phonological Categorization from Active Thoughts [article]

Pramit Saha, Muhammad Abdul-Mageed, Sidney Fels
<span title="2019-04-08">2019</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a BCI system for subject-independent classification of phonological categories exploiting a novel deep learning based hierarchical feature extraction scheme. To better capture the complex representation of high-dimensional electroencephalography (EEG) data, we
more &raquo; ... ompute the joint variability of EEG electrodes into a channel cross-covariance matrix. We then extract the spatio-temporal information encoded within the matrix using a mixed deep neural network strategy. Our model framework is composed of a convolutional neural network (CNN), a long-short term network (LSTM), and a deep autoencoder. We train the individual networks hierarchically, feeding their combined outputs in a final gradient boosting classification step. Our best models achieve an average accuracy of 77.9% across five different binary classification tasks, providing a significant 22.5% improvement over previous methods. As we also show visually, our work demonstrates that the speech imagery EEG possesses significant discriminative information about the intended articulatory movements responsible for natural speech synthesis.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1904.04358v1">arXiv:1904.04358v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/yss6glhdpbfdlp7jvvhelwtfmy">fatcat:yss6glhdpbfdlp7jvvhelwtfmy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200914003006/https://arxiv.org/pdf/1904.04358v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/8b/8f/8b8fea285c384d5a364c2afd4aa5df77d57f3f7f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1904.04358v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>