4,789 Hits in 8.3 sec

Compression, information theory, and grammars: a unified approach

Abraham Bookstein, Shmuel T. Klein
1990 ACM Transactions on Information Systems  
A number of theoretical consequences of this approach to compression are explored, and a detailed example is given.  ...  Assuming a general model of text generation, a derivation is given of the well known Shannon entropy f o r m ula, making possible a theory of information based upon text representation rather than on communication  ...  Much of the theory of data compression relies heavily on Shannon's theory of information 2], 24], a body of mathematics intended for analyzing the encoding and transmission of messages across a possibly  ... 
doi:10.1145/78915.78917 fatcat:xyh4u47kkjhgxeafyhgedklqne

Faster Approximate Pattern Matching: A Unified Approach [article]

Panagiotis Charalampopoulos, Tomasz Kociumaka, Philip Wellnitz
2020 arXiv   pre-print
Our proofs are constructive and let us obtain a unified framework for approximate pattern matching for both considered distances.  ...  We showcase the generality of our framework with results for the fully-compressed setting (where T and P are given as a straight-line program) and for the dynamic setting (where we extend a data structure  ...  Consider Algorithm 18 for a visualization of the whole algorithm as pseudo-code. If there is an approximate period Q of P we call PeriodicMatches (from Lemma 6.11).  ... 
arXiv:2004.08350v2 fatcat:zfgicxdvgjadribq3ep4knuqhu

Faster Approximate Pattern Matching: A Unified Approach

Panagiotis Charalampopoulos, Tomasz Kociumaka, Philip Wellnitz
2020 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS)  
In this work, we consider grammar compression, where a string T is represented using a context-free grammar that generates the singleton language {T }; without loss of generality, such a grammar is a straight-line  ...  While one approach to solve pattern matching in the fully compressed setting is to first decompress the strings and then run an algorithm for the standard setting, this voids most benefits of compression  ...  Consider Algorithm 18 for a visualization of the whole algorithm as pseudo-code. If there is an approximate period Q of P we call PeriodicMatches (from Lemma 6.11).  ... 
doi:10.1109/focs46700.2020.00095 fatcat:sm62sj3eizhybdegrr3gjz2o6a

Toward a computational framework for cognitive biology: Unifying approaches from cognitive neuroscience and comparative cognition

W. Tecumseh Fitch
2014 Physics of Life Reviews  
Toward a computational framework for cognitive biology: Unifying approaches from cognitive neuroscience and comparative cognition. Phys Life Rev (2014), http://dx.  ...  I then turn to predictive systems theory (predictive coding and prediction-based learning) which provides a powerful formal framework for understanding brain function at a more global level.  ...  Acknowledgements I acknowledge the financial support of ERC Advanced Grant SOMACCA, and thank Daniel Bowling and an anonymous reviewer for detailed comments on an earlier version of the manuscript.  ... 
doi:10.1016/j.plrev.2014.04.005 pmid:24969660 fatcat:5q72wz4vizathb4mi45zslkinu

Learning, Probability and Logic: Toward a Unified Approach for Content-Based Music Information Retrieval

Helene-Camille Crayencour, Carmine-Emanuele Cella
2019 Frontiers in Digital Humanities  
approaches: expressiveness and flexibility are obtained to the expense of robustness and vice versa; available multimodal sources of information are little exploited; modeling multi-faceted and strongly  ...  way to represent knowledge and complex relational information.  ...  The benefits of using approaches that unify logic, learning and probability are manifold.  ... 
doi:10.3389/fdigh.2019.00006 fatcat:nsphz2frebgy5bhcybvpfcyfey

Deep Learning and Knowledge-Based Methods for Computer Aided Molecular Design – Toward a Unified Approach: State-of-the-Art and Future Directions [article]

Abdulelah S. Alshehri, Rafiqul Gani, Fengqi You
2020 arXiv   pre-print
In view of the computational challenges plaguing knowledge-based methods and techniques, we survey the current state-of-the-art applications of deep learning to molecular design as a fertile approach towards  ...  A brief review of knowledge-driven property estimation methods and solution techniques, as well as corresponding CAMD tools and applications, are first presented.  ...  and descriptive information of the representation [167] .  ... 
arXiv:2005.08968v2 fatcat:p2mfdbkqsjekxa6qwoz5xpfzuu

Generative Grammar: A Meaning First Approach

Uli Sauerland, Artemis Alexiadou
2020 Frontiers in Psychology  
We specify a formal sketch of compression as a choice between multiple possible pronounciations balancing the desire to transmit information against the effort of pronounciation.  ...  At the same time, our view differs from early transformational grammar and generative semantics: We view the relationship between the thought structure and the corresponding signal as one of compression  ...  our two reviewers for their many helpful comments, and to Elisabeth Backes, Daniil Bondarenko, Maite Seidel, and Renata Shamsutdinova for technical assistance.  ... 
doi:10.3389/fpsyg.2020.571295 pmid:33329210 pmcid:PMC7719672 fatcat:5kaar2cnivebnairfkurnpdj7a

Unification Strategies in Cognitive Science

Marcin Miłkowski
2016 Studies in Logic, Grammar and Rhetoric  
Cognitive science is an interdisciplinary conglomerate of various research fields and disciplines, which increases the risk of fragmentation of cognitive theories.  ...  In this paper, I distinguish theoretical integration from theoretical unification, and propose some analyses of theoretical unification dimensions.  ...  The oppositions were becoming less and less clear, and no unity in explanations was to be found. Instead, Newell proposed that one should focus on what he called a unified theory of cognition.  ... 
doi:10.1515/slgr-2016-0053 fatcat:a63pnmdrfbd2lo46co2pdxem2i

Formal grammar and information theory: together again?

F. Pereira
2000 Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences  
between information theory and linguistics.  ...  Zellig Harris had advocated a close alliance between grammatical and information-theoretic principles in the analysis of natural language, and early formal-language theory provided another strong link  ...  , Amit Singhal, and Tali Tishby, for the joint research that helped shape these ideas; Yoav Freund, Michael Kearns, and Rob Schapire, for guidance on learning theory; and Steve Abney, Hiyan Alshawi, Michael  ... 
doi:10.1098/rsta.2000.0583 fatcat:pfm2cu4eargphjxrdieln5auti

Bimorphisms and synchronous grammars

Stuart M. Shieber
2014 Journal of Language Modelling  
In this paper, we provide a synthesis and extension of work that unifies two approaches to such language relations: the automatatheoretic approach based on tree transducers that transform trees to their  ...  counterparts in the relation, and the grammatical approach based on synchronous grammars that derive pairs of trees in the relation.  ...  A reconciliation of these two approaches was initiated in two pieces of earlier work (Shieber 2004 , which the present paper unifies, simplifies, and extends.  ... 
doi:10.15398/jlm.v2i1.84 fatcat:xxizreeihnhi7kwmuln5tschyu

Geometric Representations for Minimalist Grammars

Peter beim Graben, Sabrina Gerth
2012 Journal of Logic, Language and Information  
We reformulate minimalist grammars as partial functions on term algebras for strings and trees.  ...  We also propose harmony, i.e. the distance of an intermediate processing step from the final well-formed state in representation space, as a measure of processing complexity.  ...  Acknowledgments This research was supported by a DFG Heisenberg grant awarded to PbG (GR 3711/1-1).  ... 
doi:10.1007/s10849-012-9164-2 fatcat:qiehpnjtwzcuflofhpt4pvr7ky

Grammars of action in human behavior and evolution [article]

Dietrich Stout, Thierry Chaminade, Andreas Thomik, Jan Apel, A Aldo Faisal
2018 bioRxiv   pre-print
Here we present a data-driven approach for quantifying hierarchical structure by extracting action grammars from basic ethograms.  ...  Beyond its specific evolutionary implications, this finding illustrates the broader applicability of our method to investigate the structure of naturalistic human behaviors and cognition.  ...  We thank Francois Belletti for software development support, and James Steele and Daniel Wolpert for support and encouragement that made this project possible.  ... 
doi:10.1101/281543 fatcat:acnlp7adrfbj7gbh7zgme3m23q

Semantic RL with Action Grammars: Data-Efficient Learning of Hierarchical Task Abstractions [article]

Robert Tjarko Lange, Aldo Faisal
2019 arXiv   pre-print
The resulting set of temporal abstractions is called action grammar (Pastra & Aloimonos, 2012) and unifies symbolic and connectionist approaches to Reinforcement Learning.  ...  Therefore, we propose a cognitive-inspired Reinforcement Learning architecture which uses grammar induction to identify sub-goal policies.  ...  Therefore, we need to define our grammar-based approach formally: Formal grammars (formal language theory [5] ) study generating (grammar) and accepting systems (automatons) that underlie a language.  ... 
arXiv:1907.12477v2 fatcat:s2fd5uo645g6ne7fliswe6mjju

An Abstract Machine for Unification Grammars [article]

Shuly Wintner (Department of Computer Science, the Technion, Haifa, Israel)
1997 arXiv   pre-print
This formalism is one of the most widely accepted in computational linguistics and has been used for designing grammars in various linguistic theories, most notably HPSG.  ...  Amalia is composed of data structures and a set of instructions, augmented by a compiler from the grammatical formalism to the abstract instructions, and a (portable) interpreter of the abstract instructions  ...  Being very much like first-order term unification, this operation combines the information that is encoded by two feature structures and produces a result that contains the unified information, provided  ... 
arXiv:cmp-lg/9709013v1 fatcat:bhldgs7h7rfd3dsldhc4nxt53i

ULTRA: Universal Grammar as a Universal Parser

David P. Medeiros
2018 Frontiers in Psychology  
A growing number of approaches explore grammars with different directionalities, often with more direct connections to performance mechanisms.  ...  Traditional approaches posit process-neutral grammars, embodying knowledge of language, put to use with infinite facility both for production and comprehension.  ...  ACKNOWLEDGMENTS Portions of this work were first developed in a graduate seminar at the University of Arizona (2015), and presented at the POL Symposium in Tokyo (2016) Of course, all errors and misunderstandings  ... 
doi:10.3389/fpsyg.2018.00155 pmid:29497394 pmcid:PMC5818723 fatcat:2el3rxbafzhu5jlvbaqhvob2um
« Previous Showing results 1 — 15 out of 4,789 results