Filters








14,431 Hits in 4.4 sec

Real-Time Neural Style Transfer for Videos

Haozhi Huang, Hao Wang, Wenhan Luo, Lin Ma, Wenhao Jiang, Xiaolong Zhu, Zhifeng Li, Wei Liu
2017 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
In contrast to the prior video style transfer method which relies on time-consuming optimization on the fly, our method runs in real time while generating competitive visual results.  ...  Recent research endeavors have shown the potential of using feed-forward convolutional neural networks to accomplish fast style transfer for images.  ...  Moreover, both solutions need to compute optical flows for new input video sequences, which prevents their usage for real-time video style transfer.  ... 
doi:10.1109/cvpr.2017.745 dblp:conf/cvpr/HuangWLMJZLL17 fatcat:sqhs3mbhyfdcrou3tweuvw2jsy

Characterizing and Improving Stability in Neural Style Transfer

Agrim Gupta, Justin Johnson, Alexandre Alahi, Li Fei-Fei
2017 2017 IEEE International Conference on Computer Vision (ICCV)  
Then, we present a recurrent convolutional network for real-time video style transfer which incorporates a temporal consistency loss and overcomes the instability of prior methods.  ...  However, real-time methods are highly unstable resulting in visible flickering when applied to videos.  ...  We thank Jayanth Koushik for helpful comments and discussions. This work is partially supported by an ONR MURI grant.  ... 
doi:10.1109/iccv.2017.438 dblp:conf/iccv/GuptaJAF17 fatcat:7pmasd3upbe5lcqcpaxcurf6pi

DeepStyleCam: A Real-Time Style Transfer App on iOS [chapter]

Ryosuke Tanno, Shin Matsuo, Wataru Shimoda, Keiji Yanai
2016 Lecture Notes in Computer Science  
We extended the network proposed as a real-time neural style transfer network by Johnson et al. [1] so that the network can learn multiple styles at the same time.  ...  "Neural style transfer" which creates a novel image by mixing the content and the style of two given images.  ...  We extended the network proposed as a real-time neural style transfer network by Johnson et al. [1] so that the network can learn multiple styles at the same time.  ... 
doi:10.1007/978-3-319-51814-5_39 fatcat:wnbuwvv5rfd2rd6vwr3z23jyoe

Class-Based Styling: Real-time Localized Style Transfer with Semantic Segmentation [article]

Lironne Kurzman, David Vazquez, Issam Laradji
2019 arXiv   pre-print
For the style transfer step, we use a popular real-time method proposed by Johnson et al. [7].  ...  We evaluated CBS on a video of the CityScapes dataset and observed high-quality localized style transfer results for different object classes and real-time performance.  ...  Localized Real-time Style Transfer Neural Style Transfer (NST) has been applied to specific regions of still images 1 through masking the objects of the target image, and modifying the original loss function  ... 
arXiv:1908.11525v1 fatcat:j6tqrj3w45gsljgn2oyqjklc4q

Class-Based Styling: Real-Time Localized Style Transfer with Semantic Segmentation

Lironne Kurzman, David Vazquez, Issam Laradji
2019 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)  
For the style transfer step, we use the popular real-time method proposed by Johnson et al. [7].  ...  We evaluated CBS on a video of the CityScapes dataset and observed high-quality localized style transfer results for different object classes and real-time performance.  ...  Localized Real-time Style Transfer Neural Style Transfer (NST) has been applied to specific regions of still images 1 through masking the objects of the target image, and modifying the original loss function  ... 
doi:10.1109/iccvw.2019.00396 dblp:conf/iccvw/KurzmanVL19 fatcat:vtsoppd36bfn3l7n3rixrkcmum

Neural Style Transfer: A Critical Review

Akhil Singh, Vaibhav Jaiswal, Gaurav Joshi, Adith Sanjeeve, Dr. Shilpa Gite, Dr. Ketan Kotecha
2021 IEEE Access  
Real-time Neural Style Transfer for Video The work looks at the possibility of making video-style transfers using a feed-forward network.  ...  The papers selected for review were found using Scopus and Web of Science databases with the search terms such as "video neural style transfer," "real-time video neural style transfer," "generative adversarial  ... 
doi:10.1109/access.2021.3112996 fatcat:zj3gt4hgazejtgcplyqc67dyfe

Kunster – AR Art Video Maker – Real time video neural style transfer on mobile devices [article]

Wojciech Dudzik, Damian Kosowski
2020 arXiv   pre-print
We have applied neural style transfer to real-time video (over 25 frames per second), which is capable of running on mobile devices.  ...  Neural style transfer is a well-known branch of deep learning research, with many interesting works and two major drawbacks.  ...  In this paper, we presented a feed-forward neural network based on ReCoNet [12] for real-time video style transfer on mobile devices.  ... 
arXiv:2005.03415v1 fatcat:upb6xcdu7reu5fi4px3etv74ai

Towards Real-Time DNN Inference on Mobile Platforms with Model Pruning and Compiler Optimization

Wei Niu, Pu Zhao, Zheng Zhan, Xue Lin, Yanzhi Wang, Bin Ren
2020 Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence  
This demo shows that these optimizations can enable real-time mobile execution of multiple DNN applications, including style transfer, DNN coloring and super resolution.  ...  However, the constrained computation and storage resources on these devices still pose significant challenges for real-time DNN inference executions.  ...  The style transfer style transfer coloring super resolution original image application output Figure 1: Examples of style transfer, coloring, and super resolution implemented on our mobile  ... 
doi:10.24963/ijcai.2020/778 dblp:conf/ijcai/NiuZ0LWR20 fatcat:fdpqpr4gmrdgxgijnu6weqnlfe

Towards Real-Time DNN Inference on Mobile Platforms with Model Pruning and Compiler Optimization [article]

Wei Niu, Pu Zhao, Zheng Zhan, Xue Lin, Yanzhi Wang, Bin Ren
2020 arXiv   pre-print
This demo shows that these optimizations can enable real-time mobile execution of multiple DNN applications, including style transfer, DNN coloring and super resolution.  ...  However, the constrained computation and storage resources on these devices still pose significant challenges for real-time DNN inference executions.  ...  We apply column pruning for style transfer and kernel pruning for coloring and super resolution.  ... 
arXiv:2004.11250v1 fatcat:lcll73pmjraalfz3a5qklpm4ty

Comixify: Transform video into a comics [article]

Maciej Pęśko, Adam Svystun, Paweł Andruszkiewicz, Przemysław Rokita, Tomasz Trzciński
2018 arXiv   pre-print
Several recent works in the field of Neural Style Transfer showed that producing an image in the style of another image is feasible.  ...  In this paper, we propose a solution to transform a video into a comics. We approach this task using a neural style algorithm based on Generative Adversarial Networks (GANs).  ...  For instance Coherent Online Video Style Transfer [40] which describes end-to-end network that generates consistent stylized video sequences in near real time, StyleBank [41] which uses multiple convolution  ... 
arXiv:1812.03473v1 fatcat:whsi2kzia5dhri4kg66nrfszki

Coherent Online Video Style Transfer [article]

Dongdong Chen and Jing Liao and Lu Yuan and Nenghai Yu and Gang Hua
2017 arXiv   pre-print
We propose the first end-to-end network for online video style transfer, which generates temporally coherent stylized video sequences in near real-time.  ...  Training a feed-forward network for fast neural style transfer of images is proven to be successful.  ...  optimization-based video style transfer ( [1, 35] ) by thousands of times, and achieve near real-time speed on modern GPUs.  ... 
arXiv:1703.09211v2 fatcat:jjmqeuruenfmhmu55krjcrs7ie

ReCoNet: Real-time Coherent Video Style Transfer Network [article]

Chang Gao, Derun Gu, Fangjun Zhang, Yizhou Yu
2018 arXiv   pre-print
In this paper, we propose a novel real-time video style transfer model, ReCoNet, which can generate temporally coherent style transfer videos while maintaining favorable perceptual styles.  ...  Image style transfer models based on convolutional neural networks usually suffer from high temporal inconsistency when applied to videos.  ...  To obtain a consistent and fast video style transfer method, some real-time or near real-time models have recently been developed.  ... 
arXiv:1807.01197v2 fatcat:52uyh3r2jjgkhgmvhrb4yfcboq

STALP: Style Transfer with Auxiliary Limited Pairing [article]

David Futschik, Michal Kučera, Michal Lukáč, Zhaowen Wang, Eli Shechtman, Daniel Sýkora
2021 arXiv   pre-print
We demonstrate how to train an image translation network that can perform real-time semantically meaningful style transfer to a set of target images with similar content as the source image.  ...  We demonstrate its practical utility on various applications including video stylization, style transfer to panoramas, faces, and 3D models.  ...  We are also grateful to Zuzana Studená, Štěpánka Sýkorová, Jolana Sýkorová, Graciela Bombalova-Bogra, Adrian Morgan, and Muchalogy for providing style exemplars and input video sequences.  ... 
arXiv:2110.10501v1 fatcat:vlh62lwzwrelremlzjzmcrbsiy

MVStylizer: An Efficient Edge-Assisted Video Photorealistic Style Transfer System for Mobile Phones [article]

Ang Li, Chunpeng Wu, Yiran Chen, Bin Ni
2020 arXiv   pre-print
To address this challenge, we propose MVStylizer, an efficient edge-assisted photorealistic video style transfer system for mobile phones.  ...  Recent research has made great progress in realizing neural style transfer of images, which denotes transforming an image to a desired style.  ...  Even though those algorithms can achieve real-time style transfer, they require separate generative networks to be trained for each specific style, which is quite inflexible.  ... 
arXiv:2005.11630v2 fatcat:ft5bvkzzbfhbhb524yv75n6plq

Consistent Video Style Transfer via Compound Regularization

Wenjing Wang, Jizheng Xu, Li Zhang, Yue Wang, Jiaying Liu
2020 PROCEEDINGS OF THE THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE AND THE TWENTY-EIGHTH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE  
Recently, neural style transfer has drawn many attentions and significant progresses have been made, especially for image style transfer.  ...  However, flexible and consistent style transfer for videos remains a challenging problem.  ...  Gatys et al. (2016) first proposed to use Convolutional Neural Networks (CNNs) for rendering content images, which is referred as Neural Style Transfer.  ... 
doi:10.1609/aaai.v34i07.6905 fatcat:zqascdgmrfhtzb4cmjtbj5lvce
« Previous Showing results 1 — 15 out of 14,431 results