5,045 Hits in 6.1 sec

Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis [article]

Richard J. Chen, Ming Y. Lu, Jingwen Wang, Drew F. K. Williamson, Scott J. Rodig, Neal I. Lindeman, Faisal Mahmood
2020 arXiv   pre-print
In this work, we propose Pathomic Fusion, an interpretable strategy for end-to-end multimodal fusion of histology image and genomic (mutations, CNV, RNA-Seq) features for survival outcome prediction.  ...  Our approach models pairwise feature interactions across modalities by taking the Kronecker product of unimodal feature representations and controls the expressiveness of each representation via a gating-based  ...  In this section, we present our novel approach for integrating histology and genomic data, Pathomic Fusion, which fuses histology image, cell graph, and genomic features into a multimodal tensor that explicitly  ... 
arXiv:1912.08937v3 fatcat:uruvdqhve5fu3e3amoce5pykmy

Biometric Person Identification System: A Multimodal Approach Employing Spectral Graph Characteristics of Hand Geometry and Palmprint

Shanmukhappa A. Angadi, Sanjeevakumar M. Hatture
2016 International Journal of Intelligent Systems and Applications  
The topological characterization of the image moments, represented as the virtual nodes of the palmprint image graph is a novel feature of this work.  ...  The experimental results demonstrate, an appreciable performance giving identification rate of 99.19% for multimodal biometric after feature level fusion of hand geometry and palmprint modalities.  ...  A few state of the art approaches that have been proposed in the literature for multimodal biometrics with feature level fusion are summarized here.  ... 
doi:10.5815/ijisa.2016.03.06 fatcat:p75oopfqxngynj47ulexskhkz4

A Multimodal Scheme for Program Segmentation and Representation in Broadcast Video Streams

Jinqiao Wang, Lingyu Duan, Qingshan Liu, Hanqing Lu, J.S. Jin
2008 IEEE transactions on multimedia  
In this paper, we propose a multimodal scheme to segment and represent TV video streams.  ...  Index Terms-Broadcast video, latent semantic analysis, multimodal fusion, TV program segmentation.  ...  A weighted graph is constructed for the shots of a given program.  ... 
doi:10.1109/tmm.2008.917362 fatcat:olc7ct3eyrftviv4a6ervidxx4

Segmentation of cells in electron microscopy images through multimodal label transfer

Renuka Shenoy, Min-Chi Shih, Kenneth Rose
2015 2015 IEEE International Conference on Image Processing (ICIP)  
Automated segmentation of electron microcope (EM) images is a challenging problem, but the presence of related images of a different modality can be a valuable resource.  ...  The performance of the proposed approach is demonstrated on a challenging dataset, and significant improvement is observed over related techniques.  ...  Further, due to background clutter and variation of cell characteristics through the image, traditional region-based segmentation approaches such as graph cuts [10, 11, 12] require careful initialization  ... 
doi:10.1109/icip.2015.7350768 dblp:conf/icip/ShenoySR15 fatcat:agly66mfmngfvblq2q2u6v3lf4

Multimodal kernel learning for image retrieval

Yen-Yu Lin, Chiou-Shann Fuh
2010 2010 International Conference on System Science and Engineering  
We propose a semi-supervised learning technique to address the problem of fusing multimodal information sources for CBIR.  ...  via boosting; 2) The base kernel matrices are derived from eigendecomposing the graph Laplacian, and further refined to satisfy a pivotal monotone property that ensures intrinsic structure will be reasonably  ...  All in all, our kernel-based multimodal learning method appears to be promising, and is general enough for handling multimedia data other than images.  ... 
doi:10.1109/icsse.2010.5551790 fatcat:mxoes5xy75fulnt6mh77dqgus4

Multimodal Biometric Identification System Based On Iris & Fingerprint

Ms. Priyanka S. Patil Ms. Priyanka S. Patil
2013 IOSR Journal of VLSI and Signal processing  
In greater detail, a Multimodal Biometric Identification System Based On Iris & Fingerprint.  ...  The multimodal system is fused using match level fusion at the verification stage on obtained matching score of iris and fingerprint.  ...  A. S. Abhyankar for his relevant help, encouragement and providing the necessary guidance. I am also proud to thank our HOD (E&TC Department) Prof. P. D. Khandekar and our Principal Prof. Dr. B. S.  ... 
doi:10.9790/4200-0167683 fatcat:u77gvqrhurdlxhanigowg2epra

Efficient Iris and Fingerprint Fusion for Person Identification

P. U.Lahane, S. R. Ganorkar
2012 International Journal of Computer Applications  
Successively, the comparison of data base template and the input data is done with the help of hammingdistance matching algorithm.  ...  So systems need strong procedures to protect data and resources access from unauthorized users.Biometric-based authentication systems represent a valid alternative to conventional approaches.  ...  Multimodal biometric identification system is a new approach. Biometric fusion is generally classified in terms of both categories and levels.  ... 
doi:10.5120/7860-0914 fatcat:kzvy4heanrhw7lef5zqwoocroi

Guest Editors' Introduction to the Special Issue on Multimodal Human Pose Recovery and Behavior Analysis

Sergio Escalera, Jordi Gonzalez, Xavier Baro, Jamie Shotton
2016 IEEE Transactions on Pattern Analysis and Machine Intelligence  
coming from different sensors, data fusion, and temporal series analysis.  ...  , including new methods considering still images, image sequences, depth data, stereo vision, 3D vision, audio, and IMUs, among others, while presenting new multimodal datasets, in addition to those proposed  ...  For information on obtaining reprints of this article, please send e-mail to:, and reference the Digital Object Identifier below.  ... 
doi:10.1109/tpami.2016.2557878 fatcat:ee3j7nre4fgdtjrozavgexvhi4

A Review on Explainability in Multimodal Deep Neural Nets

Gargi Joshi, Rahee Walambe, Ketan Kotecha
2021 IEEE Access  
A summary of recent multimodal data fusion approaches is presented in Table V .  ...  GRAPH BASED APPROACHES Reasoning out the question-answering task is carried out with learning question-specific graph-based interactions in the image scene graph [200] .  ... 
doi:10.1109/access.2021.3070212 fatcat:5wtxr4nf7rbshk5zx7lzbtcram

Linguistic Structure Guided Context Modeling for Referring Image Segmentation [article]

Tianrui Hui, Si Liu, Shaofei Huang, Guanbin Li, Sansi Yu, Faxi Zhang, Jizhong Han
2020 arXiv   pre-print
Referring image segmentation aims to predict the foreground mask of the object referred by a natural language sentence.  ...  Our LSCM module builds a Dependency Parsing Tree suppressed Word Graph (DPT-WG) which guides all the words to include valid multimodal context of the sentence while excluding disturbing ones through three  ...  Chen et al [9] proposes a latent graph with a small number of nodes to capture context from visual features for recognition and segmentation.  ... 
arXiv:2010.00515v3 fatcat:srty5inkzfehxicu6kwd3ojo4i

Multimodal Biometrics Recognition by using Modified Unconstrained Cohort Normalisation under Unconstrained Setting

G. Angeline Prasanna, K. Anandakumar
2015 Indian Journal of Science and Technology  
Score normalization of multimodal biometric is enhanced and investigated for improving the accuracy performance of the multimodal biometric in an unconstraint setting.  ...  , the proposed MUCN based Score level fusion achieves 89.2 % of overall recognition rate and out-performs existing state-of-art techniques.  ...  The comparative graph can be drawn for differentiating the recognition rate achieved for MUCN-SLF based multimodal and SMBR based recognition.  ... 
doi:10.17485/ijst/2015/v8i34/70767 fatcat:xszszprtqrbenmpqew232a667m

Color and Depth-Based Superpixels for Background and Object Segmentation

Islem Jebari, David Filliat
2012 Procedia Engineering  
We present an approach to multimodal semantic segmentation based on both color and depth information.  ...  Our method is based on a structured output prediction strategy to detect the various elements of the environment, using both color and depth images from the Kinect camera.  ...  [19] addresses the problem of segmenting 3D scan data into objects. The applied segmentation framework is based on a subclass of MRF which supports efficient graph-cut inference.  ... 
doi:10.1016/j.proeng.2012.07.315 fatcat:bpqwhy36lvgixdr3xd3s7kp2w4

A novel fusion method for integrating multiple modalities and knowledge for multimodal location estimation

Pascal Kelm, Sebastian Schmiedeke, Jaeyoung Choi, Gerald Friedland, Venkatesan Nallampatti Ekambaram, Kannan Ramchandran, Thomas Sikora
2013 Proceedings of the 2nd ACM international workshop on Geotagging and its applications in multimedia - GeoMM '13  
This article describes a novel fusion approach using multiple modalities and knowledge sources that improves the accuracy of multimodal location estimation algorithms.  ...  Our algorithm effectively integrates data from the visual and textual modalities with external geographical knowledge bases by building a hierarchical model that combines data-driven and semantic methods  ...  In the following section, we describe a centroid-based candidate fusion to solve the problem of data sparsity and to enhance the distributions of single candidates in a multimodal manner.  ... 
doi:10.1145/2509230.2509238 dblp:conf/mm/KelmSCFERS13 fatcat:rbjyo4xkonauxjtirvuxor5xgm

Geodesic Information Flows: Spatially-Variant Graphs and Their Application to Segmentation and Fusion

M. Jorge Cardoso, Marc Modat, Robin Wolz, Andrew Melbourne, David Cash, Daniel Rueckert, Sebastien Ourselin
2015 IEEE Transactions on Medical Imaging  
A spatially-variant graph structure connecting morphologically similar subjects is introduced over a database of images, enabling the gradual diffusion of information to all the subjects, even in the presence  ...  Significant improvements were also observed when applying the proposed framework to probabilistic tissue segmentation of both synthetic and real data, mainly in the presence of large morphological variability  ...  Section V-D extends the validation of label fusion to multimodal data and demonstrates that multimodal information can be exploited to improve the process of label fusion.  ... 
doi:10.1109/tmi.2015.2418298 pmid:25879909 fatcat:ipq3uexopjdpnhrx2ylttxlqyq

Video search re-ranking via multi-graph propagation

Jingjing Liu, Wei Lai, Xian-Sheng Hua, Yalou Huang, Shipeng Li
2007 Proceedings of the 15th international conference on Multimedia - MULTIMEDIA '07  
Then, we propose a PageRank-like graph-based approach to text-based search result re-ranking.  ...  This paper 1 is concerned with the problem of multimodal fusion in video search.  ...  On the other hand, as the baseline of the multimodal fusion, the text-based video search dominates the performance of the reranking approach.  ... 
doi:10.1145/1291233.1291279 dblp:conf/mm/LiuLHHL07 fatcat:sp47lkrnmzegzpcfxootw7whxm
« Previous Showing results 1 — 15 out of 5,045 results