julienc91 / multidl Goto Github PK

View Code? Open in Web Editor NEW

17.0 4.0 8.0 83 KB

Download multiple files in parallel

License: MIT License

Python 100.00%

file-download file-downloader ftp sftp youtube-downloader hacktoberfest

multidl's Introduction

multidl

Download files from anywhere in parallel.

Author: Julien CHAUMONT (https://julienc.io)
Version: 0.1
Date: 2017-10-15
Licence: MIT
Url: http://github.com/julienc91/multidl

Demo

Description

With multidl, download multiple files in parallel from a single command line. multidl currently supports the following protocols:

local files
ftp
http
https

There is also a special treatment for the following platforms:

YouTube

Install

One simple command line:

python3 setup.py install

Usage

Gather the urls of the targeted files in a single configuration file:

http://example.com/file1.txt
https://megamovies.org/bestmovieever.mkv
ftp://me:[email protected]/dir/file2.txt

Then launch multidl:

multidl -c urls.txt -o downloads/

You can also give the targeted urls to multidl via stdin like so:

cat urls.txt | multidl -o downloads/

multidl's People

Contributors

Stargazers

Watchers

Forkers

nagora samlframework gazay dnaite telesoho hasanalanya taloeytoey ngc7292

multidl's Issues

Feature request: add optional renaming list

urls.txt:

example.com/a.jpg
example.com/aa.jpg
example.com/aaa.jpg

renaming.txt:

a1.jpg
a2.jpg
a3.jpg

multidl -c urls.txt -r renaming.txt -o downloads/

Add support for files larger that 32MB

It crashes when trying to download something bigger than 32MB.

I can upload some Luma3DS dumps if you need.

Add support for simple regex in urls

Add the possibility to add urls like:

https://example.com/[0-9].jpg

The expected result is for the download manager to convert this url into 10 urls:

https://example.com/0.jpg
https://example.com/1.jpg
https://example.com/2.jpg
https://example.com/3.jpg
https://example.com/4.jpg
https://example.com/5.jpg
https://example.com/6.jpg
https://example.com/7.jpg
https://example.com/8.jpg
https://example.com/9.jpg

Add support for popular file hosting services

Add support for popular file hosting services.

https://en.wikipedia.org/wiki/Comparison_of_file_hosting_services

SyntaxError: invalid syntax on running multidl

Hello. I get the following error on using multidl. Please let me know what changes need to be made.

Traceback (most recent call last):
  File "/usr/local/bin/multidl", line 9, in <module>
    load_entry_point('multidl==0.1', 'console_scripts', 'multidl')()
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 542, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2569, in load_entry_point
    return ep.load()
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2229, in load
    return self.resolve()
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2235, in resolve
    module = __import__(self.module_name, fromlist=['__name__'], level=0)
  File "build/bdist.linux-x86_64/egg/multidl/cli.py", line 7, in <module>
  File "/usr/local/lib/python2.7/dist-packages/multidl-0.1-py2.7.egg/multidl/download_manager.py", line 36
    print(*args, **kwargs)
          ^
SyntaxError: invalid syntax

Add SFTP support

Add a new download manager to handle sftp downloads.