81 Hits in 3.6 sec

Quantum-inspired Multimodal Fusion for Video Sentiment Analysis [article]

Qiuchi Li, Dimitris Gkoumas, Christina Lioma, Massimo Melucci
2021 arXiv   pre-print
We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis.  ...  We address this limitation with inspirations from quantum theory, which contains principled methods for modeling complicated interactions and correlations.  ...  Jakob Simenson for his valuable feedback.  ... 
arXiv:2103.10572v2 fatcat:hldyp5i35jhwrdtc7gvneb353m

Quantum Cognitively Motivated Decision Fusion for Video Sentiment Analysis [article]

Dimitris Gkoumas, Qiuchi Li, Shahram Dehdashti, Massimo Melucci, Yijun Yu, Dawei Song
2021 arXiv   pre-print
Video sentiment analysis as a decision-making process is inherently complex, involving the fusion of decisions from multiple modalities and the so-caused cognitive biases.  ...  Accordingly, we propose a fundamentally new, quantum cognitively motivated fusion strategy for predicting sentiment judgments.  ...  Acknowledgements This study is supported by the Quantum Information Access and Retrieval Theory (QUARTZ) project, which has received funding from the European Union's Horizon 2020 research and innovation  ... 
arXiv:2101.04406v2 fatcat:unnemhca2vf3nk3f3twbydjema

A quantum-inspired multimodal sentiment analysis framework

Yazhou Zhang, Dawei Song, Peng Zhang, Panpan Wang, Jingfei Li, Xiang Li, Benyou Wang
2018 Theoretical Computer Science  
., A Quantum-Inspired Multimodal Sentiment Analysis Framework, Theoret. Comput. Sci. (2018), https://doi.  ...  To address the problem, in this paper, we propose a Quantum-inspired Multimodal Sentiment Analysis (QMSA) framework.  ...  doubleslit experiment, and propose a Quantum Interference inspired Multimodal decision Fusion (QIMF) strategy. • We propose an integrated Quantum-inspired Multimodal Sentiment Analysis (QMSA) 90 framework  ... 
doi:10.1016/j.tcs.2018.04.029 fatcat:rpnlxnvps5fklcqozncurg3tyq

An Efficient Fusion Mechanism for Multimodal Low-resource Setting

Dushyant Singh Chauhan, Asif Ekbal, Pushpak Bhattacharyya
2022 Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval  
We evaluate our proposed approach on three low-resource multimodal sentiment analysis datasets, i.e., YouTube, MOUD, and ICT-MMMO.  ...  The fusion of different modalities could even be more challenging under the low-resource setting, where we have fewer samples for training.  ...  [12] proposed a quantum-inspired framework for sentiment analysis.  ... 
doi:10.1145/3477495.3531900 fatcat:tayvpdakvjce7cyfhdotcfpv3e

Which is Making the Contribution: Modulating Unimodal and Cross-modal Dynamics for Multimodal Sentiment Analysis [article]

Ying Zeng, Sijie Mai, Haifeng Hu
2021 arXiv   pre-print
Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems.  ...  To address the above-mentioned problems, we propose a novel MSA framework Modulation Model for Multimodal Sentiment Analysis (M^3SA) to identify the contribution of modalities and reduce the impact of  ...  ., 2016a ) are adopted to perform MSA in our experiments: 1) CMU-MOSI is a widely-used dataset for multimodal sentiment analysis, which is a collection of 2199 opinion video clips.  ... 
arXiv:2111.08451v1 fatcat:yntxyipgsndo5biphjrdbyfnie

Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis [article]

Sijie Mai, Ying Zeng, Shuangjia Zheng, Haifeng Hu
2021 arXiv   pre-print
In the field of multimodal sentiment analysis (MSA), most previous works focus on exploring intra- and inter-modal interactions.  ...  The wide application of smart devices enables the availability of multimodal data, which can be utilized in many tasks.  ...  RELATED WORK Multimodal Sentiment Analysis In recent years, multimodal sentiment analysis (MSA) has attracted significant research interest with the availability of multimodal data [1] , [21] .  ... 
arXiv:2109.01797v1 fatcat:oqw3edzt7fha5pmzokp36crvwe

A Comprehensive Review of Visual-Textual Sentiment Analysis from Social Media Networks [article]

Israa Khalaf Salman Al-Tameemi, Mohammad-Reza Feizi-Derakhshi, Saeed Pashazadeh, Mohammad Asadpour
2022 arXiv   pre-print
Consequently, automated sentiment analysis (SA) is critical for recognising people's feelings in ways that other information sources cannot.  ...  By including such characteristics from various material sources, these multimodal data streams provide new opportunities for optimising the expected results beyond text-based SA.  ...  [190] proposed a quantum-inspired multimodal SA (QMSA) system. The system contains a quantuminspired multimodal representation model.  ... 
arXiv:2207.02160v1 fatcat:l3vxpjnqkrfthkvhdldwonpoe4

A Survey of Quantum Theory Inspired Approaches to Information Retrieval [article]

Sagar Uprety and Dimitris Gkoumas and Dawei Song
2020 arXiv   pre-print
Although Quantum-inspired IR is still a growing area, a wide array of work in different aspects of IR has been done and produced promising results.  ...  Since 2004, researchers have been using the mathematical framework of Quantum Theory (QT) in Information Retrieval (IR). QT offers a generalized probability and logic framework.  ...  The authors are hopeful that this literature survey is able to provide a clear picture of the quantum-inspired IR field and set a road-map for researchers to take this field forward.  ... 
arXiv:2007.04357v1 fatcat:uc6mi6mlizfivk2v3reb474s4q

Modern Views of Machine Learning for Precision Psychiatry [article]

Zhe Sage Chen, Prathamesh Kulkarni, Isaac R. Galatzer-Levy, Benedetta Bigio, Carla Nasca, Yu Zhang
2022 arXiv   pre-print
We further discuss explainable AI (XAI) and causality testing in a closed-human-in-the-loop manner, and highlight the ML potential in multimedia information extraction and multimodal data fusion.  ...  Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health.  ...  We thank Robert MacKay for English proofreading. Declaration of interests The authors declare no competing financial interests. References  ... 
arXiv:2204.01607v2 fatcat:coo557v2jzh6debycy3mhccfze

Recent Advances in Information Technology

Fei Yu, Chin-Chen Chang, Yiqin Lu, Jian Shu, Yan Gao, Guangxue Yue, Zuo Chen
2014 The Scientific World Journal  
In the paper entitled "A generalized quantum-inspired decision making model for intelligent agent" by Y. Hu and C. K. Loo, a generalized quantum-inspired decision making model (QDM) is proposed.  ...  In the paper entitled "Comparative study of multimodal biometric recognition by fusion of iris and fingerprint" by H. Benaliouche and M.  ...  We wish to express our deepest thanks to the program committee members for their help in selecting papers for this issue and especially the referees of the extended versions of the selected papers for  ... 
doi:10.1155/2014/746479 pmid:25110742 pmcid:PMC4119702 fatcat:f3yq2agpevcvdbxe44umitvxa4

Quantum Cognitively Motivated Context-Aware Multimodal Representation Learning for Human Language Analysis

Dimitris Gkoumas
First, we present a comprehensive empirical comparison of state-of-the-art (SOTA) modality fusion strategies for video sentiment analysis.  ...  Second, we introduce an end-to-end complex-valued neural model for video sentiment analysis, simulating quantum procedural steps, outside of physics, into the neural network modelling paradigm.  ...  In line with this, in Chapter 4, we have proposed a quantum-inspired multimodal fusion model for video sentiment analysis.  ... 
doi:10.21954/ fatcat:55lw7adiezgbrcgo3qgj5i6tda

An Entanglement-driven Fusion Neural Network for Video Sentiment Analysis

Dimitris Gkoumas, Qiuchi Li, Yijun Yu, Dawei Song
2021 Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence   unpublished
Therefore, a key challenge for video sentiment analysis is how to combine different modalities for sentiment recognition effectively.  ...  Comprehensive evaluation on two benchmarking datasets for video sentiment analysis shows that the model achieves significant performance improvement.  ...  Recently, a quantum-inspired network for videos sentiment analysis exploits an early fusion of tri-modals via the tensor product of modalities [Li et al., 2021] .  ... 
doi:10.24963/ijcai.2021/239 fatcat:hgh3jljwxjdghc5ugpuyy2k6km

Final Program

2021 2021 18th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE)  
State observers have proved to be very efficient tools for information reconstruction in dynamical systems since R. E. Kalman introduced them at the end of 1950's.  ...  Rohrer, and which has been attracting an increasing attention even in the control community for the past two decades, within the challenging context of submicronic research.  ...  This indicates that multimodallate fused architecture and multimodal imaging systems have great potential for agricultural and other industrial applications.  ... 
doi:10.1109/cce53527.2021.9632879 fatcat:tklvuqrhajagxf4cfcmufbcveu

Front Matter

2020 2020 International Joint Conference on Neural Networks (IJCNN)  
[#20628] Tadeusz Szuba and Danuta Sztuba UPJP2 University, Poland P5919 Multimodal Emotion Recognition Using Deep Generalized Canonical Correlation Analysis with an Attention Mechanism [#20729] Yu-ting  ...  Healthcare and Bio-signals Analysis Tuesday, July 21, 4:45PM-6:45PM, Room: IJCNN Room 3, Chair: Francesco Carlo Morabito 4:45PM A comparative analysis of multi-backbone Mask R-CNN for surgical tools  ... 
doi:10.1109/ijcnn48605.2020.9207579 fatcat:hptkppolhbfn7nz3yangesetpi

Data science and AI in FinTech: an overview

Longbing Cao, Qiang Yang, Philip S. Yu
2021 International Journal of Data Science and Analytics  
Smart FinTech is the new-generation FinTech, largely inspired and empowered by data science and artificial intelligence (DSAI) techniques.  ...  The research on data science and AI in FinTech involves many latest progress made in smart FinTech for BankingTech, Trade-Tech, LendTech, InsurTech, WealthTech, PayTech, RiskTech, cryptocurrencies, and  ...  DSAI-enabled smart marketing involves many opportunities, such as conducting consumer sentiment and public emotion analysis; understanding consumer/client opinion and intention; quantifying, characterizing  ... 
doi:10.1007/s41060-021-00278-w fatcat:4qo3swacjbaaxh56p5bvhmjzqa
« Previous Showing results 1 — 15 out of 81 results