Petabyte-scale innovations at the European Nucleotide Archive

G. Cochrane, R. Akhtar, J. Bonfield, L. Bower, F. Demiralp, N. Faruque, R. Gibson, G. Hoad, T. Hubbard, C. Hunter, M. Jang, S. Juhos (+15 others)
<span title="2009-01-01">2009</span> <i title="Oxford University Press (OUP)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/hfp6p6inqbdexbsu4r7usndpte" style="color: black;">Nucleic Acids Research</a> </i> &nbsp;
Dramatic increases in the throughput of nucleotide sequencing machines, and the promise of ever greater performance, have thrust bioinformatics into the era of petabyte-scale data sets. Sequence repositories, which provide the feed for these data sets into the worldwide computational infrastructure, are challenged by the impact of these data volumes. The European Nucleotide Archive (ENA; http://www.ebi.ac.uk/embl), comprising the EMBL Nucleotide Sequence Database and the Ensembl Trace Archive,
more &raquo; ... as identified challenges in the storage, movement, analysis, interpretation and visualization of petabyte-scale data sets. We present here our new repository for next generation sequence data, a brief summary of contents of the ENA and provide details of major developments to submission pipelines, high-throughput rule-based validation infrastructure and data integration approaches.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/nar/gkn765">doi:10.1093/nar/gkn765</a> <a target="_blank" rel="external noopener" href="https://www.ncbi.nlm.nih.gov/pubmed/18978013">pmid:18978013</a> <a target="_blank" rel="external noopener" href="https://pubmed.ncbi.nlm.nih.gov/PMC2686451/">pmcid:PMC2686451</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/xzwl3cvkjnarxbbbowzbnhazpi">fatcat:xzwl3cvkjnarxbbbowzbnhazpi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170717085823/https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/nar/37/suppl_1/10.1093/nar/gkn765/2/gkn765.pdf?Expires=1500375503&amp;Signature=e0ZGgODu~6PCo71nYoclrZpqpH5tRJvzoBYGmfNkrXL~a5Ecyf9aGx1vXFux7sKFPjyRrLHXOy3miFGRJ6Hw-SWuNrziVdhIGi0j20rQ25r~PRizdpbyJS-~GUi88iZqB-W-o9-zLJJioq9PNJsBtIXOeOiztnlOJj8lUZwuItdbLl19QeIRiEWbXjDB8jg49dE8o~0bhBpMFaCotVWqS6crFbbC-SIjkDXvPaSyC4exAdcC4sfwTmp8kuUpuiKa4S~Xl6s243ASK2xjk-xIYTxE-3STuofYtnd4ms0FDj-4zyFrT2VjE7dnI6iptgpgG28VBsMSkKXBtJbH69-w5g__&amp;Key-Pair-Id=APKAIUCZBIA4LVPAVW3Q" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/0f/8c/0f8c062db9fbc815e404e8f5c65b2878aeb9402f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/nar/gkn765"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> oup.com </button> </a> <a target="_blank" rel="external noopener" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2686451" title="pubmed link"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> pubmed.gov </button> </a>