104 Hits in 3.0 sec

The Piano Inpainting Application [article]

Gaëtan Hadjeres, Léopold Crestel
2021 arXiv   pre-print
In this work, we present the Piano Inpainting Application (PIA), a generative model focused on inpainting piano performances, as we believe that this elementary operation (restoring missing parts of a  ...  By uncovering an interesting synergy between Linear Transformers and our inpainting task, we are able to efficiently inpaint contiguous regions of a piano performance, which makes our model suitable for  ...  In this paper, we propose the Piano Inpainting Application (PIA), a complete system for inpainting a piano performance.  ... 
arXiv:2107.05944v1 fatcat:mpej54s3inahxpqr3up5y7htfu

Audio inpainting with generative adversarial network [article]

P. P. Ebner, A. Eltelt
2020 arXiv   pre-print
The performance was compared with two different audio instruments (piano and guitar) and on virtuoso pianists together with a string orchestra.  ...  We deal with the challenge of audio inpainting long range gaps (500 ms) using WGAN models.  ...  The authors would like to thank SDSC for their support and in particularly Nathanal Perraudin for his constructive and insightful inputs and for helping to manage the project.  ... 
arXiv:2003.07704v1 fatcat:mkfmyfildjcxzhzsosibshbtgm

Sparse Non-Local Similarity Modeling for Audio Inpainting

Ichrak Toumi, Valentin Emiya
2018 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)  
and one must deal with missing data in the frames.  ...  While joint sparse models and related algorithms have been widely studied, one important challenge is to locate such similar frames : the search must be adapted to the jointsparse model and should be fast  ...  More recently, application to audio inpainting in the clipping case have been presented in [13] where the authors use dependencies between neighboring coefficients to improve the declipping algorithm  ... 
doi:10.1109/icassp.2018.8462187 dblp:conf/icassp/ToumiE18 fatcat:re2lyjvb6rfxlmoxihbbdtnoam

Image Inpainting: A Review

Omar Elharrouss, Noor Almaadeed, Somaya Al-Maadeed, Younes Akbari
2019 Neural Processing Letters  
With the improvement of image processing tools and the flexibility of digital image editing, automatic image inpainting has found important applications in computer vision and has also become an important  ...  This paper is a brief review of the existing image inpainting approaches we first present a global vision on the existing methods for image inpainting.  ...  The statements made herein are solely the responsibility of the authors.  ... 
doi:10.1007/s11063-019-10163-0 fatcat:b4n4h4ts7bchfl5s5kjikq4npy

Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamics [article]

Vivek Jayaram, John Thickstun
2021 arXiv   pre-print
We apply these techniques to autoregressive models in the visual and audio domains, with competitive results for audio source separation, super-resolution, and inpainting.  ...  Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model.  ...  Select qualitative results for image inpainting Piano Voice are presented in Figure 4.  ... 
arXiv:2105.08164v2 fatcat:sed6pvnne5gmpcev57isqbkpcm

Audio–visual object removal in 360-degree videos

Ryo Shimamura, Qi Feng, Yuki Koyama, Takayuki Nakatsuka, Satoru Fukayama, Masahiro Hamasaki, Masataka Goto, Shigeo Morishima
2020 The Visual Computer  
We propose a solution which incorporates direction acquired during the video inpainting process into the audio removal process.  ...  Previous methods have solely focused on the visual aspect of object removal using video inpainting techniques, resulting in videos with unreasonable remaining sounds corresponding to the removed objects  ...  ) 2 Piano/maracas/violin Piano Static Dynamic Indoor Off 3 Speaker/speaker Speaker Dynamic Almost static Outdoor On (mainly birdsong) Fig. 6 Video processing results of a certain frame  ... 
doi:10.1007/s00371-020-01918-1 fatcat:lb3epp5ucfgxln55xrdptjzrba

Gaussian modeling of mixtures of non-stationary signals in the Time-Frequency domain (HR-NMF)

Roland Badeau
2011 2011 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)  
This model is estimated with a recursive implementation of the EM algorithm, that is successfully applied to source separation and audio inpainting.  ...  However, unlike the High Resolution (HR) methods dedicated to mixtures of exponentials, its spectral resolution is limited by that of the underlying TF representation.  ...  Other letters denote temporary variables used in the computations. APPLICATIONS In order to illustrate the capabilities of HR-NMF, we consider two examples of straightforward applications.  ... 
doi:10.1109/aspaa.2011.6082264 dblp:conf/waspaa/Badeau11 fatcat:4hzen7slinhejmkvfoceutdeey

Depth Image Inpainting: Improving Low Rank Matrix Completion With Low Gradient Regularization

Hongyang Xue, Shengming Zhang, Deng Cai
2017 IEEE Transactions on Image Processing  
We consider the case of inpainting single depth images. Without corresponding color images, previous or next frames, depth image inpainting is quite challenging.  ...  One natural solution is to regard the image as a matrix and adopt the low rank regularization just as inpainting color images.  ...  The fast development of the RGB-D sensors, such as Microsoft Kinect, ASUS Xtion Pro and Intel Leap Motion, enables a variety of applications based on the depth information by providing depth images of  ... 
doi:10.1109/tip.2017.2718183 pmid:28644807 fatcat:7gn5cv5p7verbg6sfit5aj2zb4

Generation of Stereo Images Based on a View Synthesis Network

Yuan-Mau Lo, Chin-Chen Chang, Der-Lor Way, Zen-Chung Shih
2020 Applied Sciences  
We modified the appearance flow network to make it more general and suitable for our model. We also used a reference image to improve the inpainting method.  ...  In addition, our model does not limit the size of the input image.  ...  Figure 9 presents the results of piano. We eroded the objects to eliminate the noises along the edges caused by modified AFN and bicubic sampling.  ... 
doi:10.3390/app10093101 fatcat:ljmuv56s6bf2fapvbiftwjchf4

A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions [article]

Shulei Ji, Jing Luo, Xinyu Yang
2020 arXiv   pre-print
In addition, we summarize the datasets suitable for diverse tasks, discuss the music representations, the evaluation methods as well as the challenges under different levels, and finally point out several  ...  However, the development history, the model evolution, as well as the pros and cons of same music generation task have not been clearly illustrated.  ...  The application of t-SNE is more extensive.  ... 
arXiv:2011.06801v1 fatcat:cixou3d2jzertlcpb7kb5x5ery

Multichannel High-Resolution NMF for Modeling Convolutive Mixtures of Non-Stationary Signals in the Time-Frequency Domain

Roland Badeau, Mark D. Plumbley
2014 IEEE/ACM Transactions on Audio Speech and Language Processing  
such as source separation and audio inpainting.  ...  Among them, the recent high-resolution NMF (HR-NMF) model is able to take both phases and local correlations in each frequency band into account, and its potential has been illustrated in applications  ...  ACKNOWLEDGMENT The authors would like to thank the anonymous reviewers for their very helpful suggestions.  ... 
doi:10.1109/taslp.2014.2341920 fatcat:htnpgtl3tbgapmqbhxbyy4vn5m

Convex nonnegative matrix factorization with missing data

Ronan Hamon, Valentin Emiya, Cedric Fevotte
2016 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP)  
The performance gap is particularly significant when the task of reconstruction becomes arduous, e.g. when the ratio of missing data is high, the noise is steep, or the complexity of data is high.  ...  In this contribution, we propose to extend CNMF to the case where the data matrix and the dictionary have missing entries.  ...  APPLICATION TO SPECTROGRAM INPAINTING In order to illustrate the performance of the proposed algorithm on real data, we consider spectrograms of piano music signals, which are known to be well modeled  ... 
doi:10.1109/mlsp.2016.7738910 dblp:conf/mlsp/HamonEF16 fatcat:s7w7oojf3raxvjb2v7lr25jtca

ARMAS: Active Reconstruction of Missing Audio Segments [article]

Zohra Cheddad, Abbas Cheddad
2022 arXiv   pre-print
for audio inpainting) steganography provides.  ...  Compared to existing methods, we show improvement in the inpainting performance in terms of signal-to-noise (SNR), the objective difference grade (ODG) and the Hansen's audio quality metric.  ...  ACKNOWLEDGMENT We thank the reviewers for their neutrality in assessing this manuscript and for the constructive feedback.  ... 
arXiv:2111.10891v3 fatcat:7qvzsrzmozgzll3tqsm4pkdhri

Live Orchestral Piano, a system for real-time orchestral music generation [article]

Léopold Crestel, Philippe Esling
2017 arXiv   pre-print
This paper introduces the first system for performing automatic orchestration based on a real-time piano input.  ...  We believe that it is possible to learn the underlying regularities existing between piano scores and their orchestrations by notorious composers, in order to automatically perform this task on novel piano  ...  Then, the piano-roll representation used to process the scores is detailed. Finally, the application of the previously introduced models in this particular context is defined.  ... 
arXiv:1609.01203v2 fatcat:nsgjhcd44jcnrcdibdoax7riy4

Live Orchestral Piano, A System For Real-Time Orchestral Music Generation

Léopold Crestel, Philippe Esling
2017 Proceedings of the SMC Conferences  
Then, the piano-roll representation used to process the scores is detailed. Finally, the application of the previously introduced models in this particular context is defined.  ...  Thus, it is possible to infer the approximationÔ(t) by clamping O (t − N ) , ..., O(t − 1) and P (t) to their known values and using the CD algorithm. This technique is known as inpainting [26] .  ... 
doi:10.5281/zenodo.1401985 fatcat:bo5xwdjlcbh5zd4fqjfk55zgpy
« Previous Showing results 1 — 15 out of 104 results