The BEL information extraction workflow (BELIEF): evaluation in the BioCreative V BEL and IAT track

Sumit Madan, Sven Hodapp, Philipp Senger, Sam Ansari, Justyna Szostak, Julia Hoeng, Manuel Peitsch, Juliane Fluck
<span title="">2016</span> <i title="Oxford University Press (OUP)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ejkvir3kzbdojf5kygupkidsca" style="color: black;">Database: The Journal of Biological Databases and Curation</a> </i> &nbsp;
Citation details: Madan,S., Hodapp,S., Senger,P. et al. The BEL information extraction workflow (BELIEF): evaluation in the Abstract Network-based approaches have become extremely important in systems biology to achieve a better understanding of biological mechanisms. For network representation, the Biological Expression Language (BEL) is well designed to collate findings from the scientific literature into biological network models. To facilitate encoding and biocuration of such findings in
more &raquo; ... , a BEL Information Extraction Workflow (BELIEF) was developed. BELIEF provides a webbased curation interface, the BELIEF Dashboard, that incorporates text mining techniques to support the biocurator in the generation of BEL networks. The underlying UIMA-based text mining pipeline (BELIEF Pipeline) uses several named entity recognition processes and relationship extraction methods to detect concepts and BEL relationships in literature. The BELIEF Dashboard allows easy curation of the automatically generated BEL statements and their context annotations. Resulting BEL statements and their context annotations can be syntactically and semantically verified to ensure consistency in the BEL network. In summary, the workflow supports experts in different stages of systems biology network building. Based on the BioCreative V BEL track evaluation, we show that the BELIEF Pipeline automatically extracts relationships with an F-score of 36.4% and fully correct statements can be obtained with an Fscore of 30.8%. Participation in the BioCreative V Interactive task (IAT) track with BELIEF revealed a systems usability scale (SUS) of 67. Considering the complexity of the task for new users-learning BEL, working with a completely new interface, and performing complex curation-a score so close to the overall SUS average highlights the usability of BELIEF. Database URL: BELIEF is available at
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/database/baw136">doi:10.1093/database/baw136</a> <a target="_blank" rel="external noopener" href="https://www.ncbi.nlm.nih.gov/pubmed/27694210">pmid:27694210</a> <a target="_blank" rel="external noopener" href="https://pubmed.ncbi.nlm.nih.gov/PMC5045868/">pmcid:PMC5045868</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/fkuoxt7j6ffnxoknhsqmqjvdrq">fatcat:fkuoxt7j6ffnxoknhsqmqjvdrq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180727134336/https://watermark.silverchair.com/baw136.pdf?token=AQECAHi208BE49Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAAb8wggG7BgkqhkiG9w0BBwagggGsMIIBqAIBADCCAaEGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMsijK_z04akUOqxZuAgEQgIIBcqhsTwFZC6f86QIzZeu_QZhH37kfMR6cb7y_RQqQg6yJqXnx6JKTwA93j2XlM375YFzZo6hFlWAB9oPMpzfSGd8aSjoo6n_k4Ahh1vj8ZhGPrVOMSVQvbnFbfL-Fbvhlbo0ShUTROfldljpTg1tcdBZOClSbMgn5QHSJUAgmPj_NSTWBUuxvJnu1ezr5Hwl_aNCV-8J291iIJWml9BDuFsZoFdlIvB1BCaxLInBWyxXNv9eZMGxm8QUuO0N0w_WbCkFKG43V0yQFhzK-TJ9vGO3rnFeNeY7z-7dqLc7CVK23Wdmw_8SHaa3-tClZYMA3bAxOJmAu4T2xxVNLC0Kyh6DI4JKImBcE0QUHIlya1rq-TIDL33fBQOpuKKZZ8wBs8PBiJwFAemqc2LeByJ17_KdYlCg2ZQAyCA4NAn7zl04Cf43qn67fhnziHzYmvhYjxjkNwr8juBGBmdVMbEcTR_iuAqedJQRPt4vs7iNlWcr0yvU" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/c7/0c/c70cce4e3a9b60a66168373ae162bda0a952e7d0.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/database/baw136"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> oup.com </button> </a> <a target="_blank" rel="external noopener" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5045868" title="pubmed link"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> pubmed.gov </button> </a>