MHC researchers regularly need to compile databases of allele reference sequences, which involves sending a large number of HTTP requests to European Bioinformatics Institute (EBI) servers. The program here, written in Go, takes advantage of goroutines to download allele sequence files concurrently, which speeds up total download time considerably. The program spawns 100 worker threads at a time, and can ignore any records that come before a certain release date. This allows researchers not only to download IPD alleles efficiently, but also to download only new or updated alleles since the last IPD release.
nrminor / godownloadipd Goto Github PK
View Code? Open in Web Editor NEWGo program for concurrently downloading a large number of allele sequences from the Immuno-Polymorphism Database
License: GNU General Public License v3.0