Filters








4 Hits in 5.8 sec

AI2D-RST: a multimodal corpus of 1000 primary school science diagrams

Tuomo Hiippala, Malihe Alikhani, Jonas Haverinen, Timo Kalliokoski, Evanfiya Logacheva, Serafina Orekhova, Aino Tuomainen, Matthew Stone, John A. Bateman
<span title="2020-12-05">2020</span> <i title="Springer Science and Business Media LLC"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/qiptgj2ubngu3hrrsrkbdvpchi" style="color: black;">Language Resources and Evaluation</a> </i> &nbsp;
AbstractThis article introduces AI2D-RST, a multimodal corpus of 1000 English-language diagrams that represent topics in primary school natural sciences, such as food webs, life cycles, moon phases and  ...  Building on the segmentation of diagram layouts in AI2D, the AI2D-RST corpus presents a new multi-layer annotation schema that provides a rich description of their multimodal structure.  ...  corpus of 1000 primary school science diagrams 2.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s10579-020-09517-1">doi:10.1007/s10579-020-09517-1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/el3xk2art5f3fjcmvkg3prwtce">fatcat:el3xk2art5f3fjcmvkg3prwtce</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210429070129/https://link.springer.com/content/pdf/10.1007/s10579-020-09517-1.pdf?error=cookies_not_supported&amp;code=3a2d8baa-a4e1-4cac-b531-35cd9d524b3e" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/aa/54/aa54e672995713e0643d56c9ee731d81881af228.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s10579-020-09517-1"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> springer.com </button> </a>

AI2D-RST: A multimodal corpus of 1000 primary school science diagrams [article]

Tuomo Hiippala and Malihe Alikhani and Jonas Haverinen and Timo Kalliokoski and Evanfiya Logacheva and Serafina Orekhova and Aino Tuomainen and Matthew Stone and John A. Bateman
<span title="2020-03-20">2020</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
This article introduces AI2D-RST, a multimodal corpus of 1000 English-language diagrams that represent topics in primary school natural sciences, such as food webs, life cycles, moon phases and human physiology  ...  Building on the segmentation of diagram layouts in AI2D, the AI2D-RST corpus presents a new multi-layer annotation schema that provides a rich description of their multimodal structure.  ...  In this article, we make a novel contribution to the study of diagrams by presenting AI2D-RST, a corpus of 1000 English-language diagrams that represent topics in primary school natural sciences.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.03879v2">arXiv:1912.03879v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/bzorpln4enhmzct3jhjabkoxie">fatcat:bzorpln4enhmzct3jhjabkoxie</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200325233012/https://arxiv.org/pdf/1912.03879v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.03879v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>

Classifying Diagrams and Their Parts using Graph Neural Networks: A Comparison of Crowd-Sourced and Expert Annotations [article]

Tuomo Hiippala
<span title="2019-12-05">2019</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
This article compares two multimodal resources that consist of diagrams which describe topics in elementary school natural sciences.  ...  This article reports on two experiments that evaluate how effectively crowd-sourced and expert-annotated graphs can represent the multimodal structure of diagrams for representation learning using various  ...  Here the aim is to evaluate to what extent graph neural networks can learn about the generic structure of primary school science diagrams from the graph-based representations in AI2D and AI2D-RST.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.02866v1">arXiv:1912.02866v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/u4snprup2jhkvazmoew5rhibf4">fatcat:u4snprup2jhkvazmoew5rhibf4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200904204021/https://arxiv.org/pdf/1912.02866v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/7f/ef/7fef7e08ed03ed00a700e122e7e9da6d459071ed.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1912.02866v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>

Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora [article]

Tuomo Hiippala, John A. Bateman
<span title="2021-03-08">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
In this article, we bring together theories of multimodal communication and computational methods to study how primary school science diagrams combine multiple expressive resources.  ...  diagrams as a mode of communication.  ...  The AI2D-RST corpus covers 1000 diagrams from AI2D.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2103.04692v1">arXiv:2103.04692v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/c4pv6vinmrbybcgg3gkxhcqdiu">fatcat:c4pv6vinmrbybcgg3gkxhcqdiu</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210310023604/https://arxiv.org/pdf/2103.04692v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/9a/65/9a655a211107453e9d1024af7ecda8cc3e14a32b.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2103.04692v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>