9 Hits in 4.8 sec

Text-to-image retrieval based on incremental association via multimodal hypernetworks

Jung-Woo Ha, Beom-Jin Lee, Byoung-Tak Zhang
2012 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC)  
Here we propose an incremental text-to-image retrieval method using a multimodal association model.  ...  Using the HN incrementally learned by a sequential Bayesian sampling, in the multimodal hypernetwork-based text-to-image retrieval, a given text query is crossmodally expanded to the visual query and then  ...  Figure 1 . 1 Overall flow of text-to-image retrieval using incrementally learned multimodal hypernetworks.  ... 
doi:10.1109/icsmc.2012.6378291 dblp:conf/smc/HaLZ12 fatcat:a6bxtihwnncarfinib6e3hgpne

Visual Query Expansion via Incremental Hypernetwork Models of Image and Text [chapter]

Min-Oh Heo, Myunggu Kang, Byoung-Tak Zhang
2010 Lecture Notes in Computer Science  
HNs learn the higher-order cross-modal associative relationships incrementally on a set of image-text pairs in sequence.  ...  An incremental HN generates images by assembling visual words based on linguistic cues. And we retrieve similar images with the generated visual query.  ...  In [4] , Ha et al. studied the image-text cross-modal retrieval task with multimodal queries based on pixels of the gray scale on the fixed dataset.  ... 
doi:10.1007/978-3-642-15246-7_11 fatcat:3dlagta7ijd3tkrhu7yuyszdrm

Evolutionary concept learning from cartoon videos by multimodal hypernetworks

Beom-Jin Lee, Jung-Wo Ha, Kyung-Min Kim, Byoung-Tak Zhang
2013 2013 IEEE Congress on Evolutionary Computation  
Two key ideas on evolutionary concept learning are representing concepts in a large collection (population) of hyperedges or a hypergraph and to incrementally learning from video streams based on an evolutionary  ...  Concept learning from multimodal stream data, such as videos, remains a challenge due to their dynamic change and high-dimensionality.  ...  Although there are several research on multimodal data analysis [7] [8] [9] [10] , they focus on problem-solving including image auto-tagging, text-based image retrieval, and video search rather than  ... 
doi:10.1109/cec.2013.6557700 dblp:conf/cec/LeeHKZ13 fatcat:q4trwieypnctzebnojfde7bfcq

Posterior Meta-Replay for Continual Learning [article]

Christian Henning, Maria R. Cervera, Francesco D'Angelo, Johannes von Oswald, Regina Traber, Benjamin Ehret, Seijin Kobayashi, Benjamin F. Grewe, João Sacramento
2021 arXiv   pre-print
We offer a practical deep learning implementation of our framework based on probabilistic task-conditioned hypernetworks, an approach we term posterior meta-replay.  ...  Experiments on standard benchmarks show that our probabilistic hypernetworks compress sequences of posterior parameter distributions with virtually no forgetting.  ...  We also would like to thank Sebastian Farquhar for discussions on Radial posteriors and for proofreading our implementation of this method.  ... 
arXiv:2103.01133v3 fatcat:4tjj74x74vew7gqif4atmg5qjm

Opportunities and obstacles for deep learning in biology and medicine

Travers Ching, Daniel S. Himmelstein, Brett K. Beaulieu-Jones, Alexandr A. Kalinin, Brian T. Do, Gregory P. Way, Enrico Ferrero, Paul-Michael Agapow, Michael Zietz, Michael M. Hoffman, Wei Xie, Gail L. Rosen (+24 others)
2018 Journal of the Royal Society Interface  
have been made on the prior state of the art.  ...  Furthermore, the limited amount of labelled data for training presents problems in some domains, as do legal and privacy constraints on work with sensitive health records.  ...  for clarifying edits to the abstract and introduction and Robert Gieseke, Ruibang Luo, Stephen Ra, Sourav Singh and GitHub user snikumbh for correcting typos, formatting and references.  ... 
doi:10.1098/rsif.2017.0387 pmid:29618526 pmcid:PMC5938574 fatcat:65o4xmp53nc6zmj37srzuht6tq

Opportunities And Obstacles For Deep Learning In Biology And Medicine [article]

Travers Ching, Daniel S. Himmelstein, Brett K. Beaulieu-Jones, Alexandr A. Kalinin, Brian T. Do, Gregory P. Way, Enrico Ferrero, Paul-Michael Agapow, Michael Zietz, Michael M Hoffman, Wei Xie, Gail L. Rosen (+24 others)
2017 bioRxiv   pre-print
We find that deep learning has yet to revolutionize or definitively resolve any of these problems, but promising advances have been made on the prior state of the art.  ...  More work is needed to address concerns related to interpretability and how to best model each problem.  ...  We would like to thank Aaron Sheldon, who contributed text but did not formally approve the manuscript.  ... 
doi:10.1101/142760 fatcat:l7zvbtbgxjamtd735vir2trw6q

A Survey on Knowledge Graphs: Representation, Acquisition and Applications [article]

Shaoxiong Ji and Shirui Pan and Erik Cambria and Pekka Marttinen and Philip S. Yu
2021 IEEE Transactions on Neural Networks and Learning Systems   accepted
To facilitate future research on knowledge graphs, we also provide a curated collection of datasets and open-source libraries on different tasks.  ...  We propose a full-view categorization and new taxonomies on these topics.  ...  [228] formulated the task of medical image report generation with three steps of encoding, retrieval, and paraphrasing, where the medical image is encoded by the abnormality graph. D.  ... 
doi:10.1109/tnnls.2021.3070843 pmid:33900922 arXiv:2002.00388v4 fatcat:4l2yxnf3wbg4zpzdumduvyr4he

Beyond AlphaGo 2016 International Symposium on Perception, Action, and Cognitive Systems PACS2016

Date & Location
Grand Hall(5F), aT Center   unpublished
DCL enables the multimodal sensory data sources to send data directly via REST service.  ...  Concepts represented with multimodal variable are incrementally learned from continuously increasing data.  ...  However, irregularities and ambiguities make text difficult to analyze, and the support of (semi) automatic analysis methods are yet unsatisfactory, especially in terms of discovering new knowledge.  ... 

The structure and dynamics of multilayer networks

S. Boccaletti, G. Bianconi, R. Criado, C.I. del Genio, J. Gómez-Gardeñes, M. Romance, I. Sendiña-Nadal, Z. Wang, M. Zanin
2014 Physics reports  
However, up until recently, attention was almost exclusively given to networks in which all components were treated on equivalent footing, while neglecting all the extra information about the temporal-  ...  We offer here a comprehensive review on both structural and dynamical organization of graphs made of diverse relationships (layers) between its constituents, and cover several relevant issues, from a full  ...  Furthermore, a part of the material quoted in our presentation was taken from the ArXiv public repository, and we warn the reader that it is very likely that those Manuscripts could have appeared meanwhile on  ... 
doi:10.1016/j.physrep.2014.07.001 pmid:32834429 pmcid:PMC7332224 fatcat:5y6wdkop2nd75kwnla4by2icqy