Code Monkey home page Code Monkey logo

Comments (3)

JINSCOTT avatar JINSCOTT commented on June 2, 2024 1

I tried to use AzCopy" to download the files and it is way faster and much more reliable than wget and curl. No more timeouts and having to re-download the entire file from the start again.
Get AzCopy working and try something like this in the download file scripts:
azcopy copy "$URL" "$OUTPUT_PATH/$BLOB"

from dns-challenge.

thebarnable avatar thebarnable commented on June 2, 2024

I'm experiencing a very similar issue. In the download-dns-challenge-4.sh script, I used the curl "$URL" | tar -C "$OUTPUT_PATH" -f - -x -j line. Not for all tars, but for some (e.g. clean_fullband/datasets_fullband.clean_fullband.german_speech_035_NA_NA.tar.bz2):

curl: (56) OpenSSL SSL_read: Connection timed out, errno 110

bzip2: Compressed file ends unexpectedly;
	perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
	Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now

from dns-challenge.

seowwj avatar seowwj commented on June 2, 2024

I faced the same issue (but with different files), the way it was solved for me was by retrying the download.

from dns-challenge.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.