Adversarial Auto-Encoding for Packet Loss Concealment [article]

Santiago Pascual, Joan Serrà, Jordi Pons
<span title="2021-07-08">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Communication technologies like voice over IP operate under constrained real-time conditions, with voice packets being subject to delays and losses from the network. In such cases, the packet loss concealment (PLC) algorithm reconstructs missing frames until a new real packet is received. Recently, autoregressive deep neural networks have been shown to surpass the quality of signal processing methods for PLC, specially for long-term predictions beyond 60 ms. In this work, we propose a
more &raquo; ... gressive adversarial auto-encoder, named PLAAE, to perform real-time PLC in the waveform domain. PLAAE has a causal convolutional structure, and it learns in an auto-encoder fashion to reconstruct signals with gaps, with the help of an adversarial loss. During inference, it is able to predict smooth and coherent continuations of such gaps in a single feed-forward step, as opposed to autoregressive models. Our evaluation highlights the superiority of PLAAE over two classic PLCs and two deep autoregressive models in terms of spectral and intonation reconstruction, perceptual quality, and intelligibility.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2107.03100v2">arXiv:2107.03100v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/b5ny3ubjdzcbpk43zlpoidskhm">fatcat:b5ny3ubjdzcbpk43zlpoidskhm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210715190811/https://arxiv.org/pdf/2107.03100v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/93/5c/935c9e7a6d974707330fd40a3bdb279f4c0863a9.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2107.03100v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>