The thu-cloud-downloader from chenyifanthu

chenyifanthu / thu-cloud-downloader Goto Github PK

View Code? Open in Web Editor NEW

清华大学云盘 (Tsinghua Cloud) 批量下载助手，适用于分享的文件 size 过大导致无法直接下载的情况，本脚本添加了更多实用的小功能

Python 100.00%

thu-cloud-downloader's People

Contributors

Stargazers

Watchers

thu-cloud-downloader's Issues

Enhancing download_single_file to Handle Non-Existent Files

THU-Cloud-Downloader/thu_cloud_download.py

Lines 89 to 95 in 8b610c4

    
           def download_single_file(url: str, fname: str, pbar: tqdm): 
        
               global sess 
        
               resp = sess.get(url, stream=True) 
        
               with open(fname, 'wb') as file: 
        
                   for data in resp.iter_content(chunk_size=1024): 
        
                       size = file.write(data) 
        
                       pbar.update(size)

When the download_single_file function encounters a URL that points to a non-existent file, it currently does not raise an error and proceeds as if downloading a regular file. As a result, the downloaded file is merely a webpage saying “文件不存在”.

A notable challenge is that the server still responds with a status code of 200 instead of 404 in such case. An ugly-but-effective way solution involves checking for redirection in resp: an exist file will undergo a redirection from files/?dl=1 to seafhttp/files/. In contrast, a Not Found response is served directly from files/?dl=1 without any redirection.

def download_single_file(url: str, fname: str, pbar: tqdm):
    global sess
    resp = sess.get(url, stream=True)
    if not resp.history:
        raise ValueError("File may non-exist!")
    with open(fname, 'wb') as file:
        for data in resp.iter_content(chunk_size=1024):
            size = file.write(data)
            pbar.update(size)

Wonder if there are more elegant solutions...

不支持加密文件的下载

不支持加密文件的下载，是否有办法添加对有密码分享链接的支持？

请问支持下个给定链接下的指定文件夹吗？

比如我只想下

给定链接（https://cloud.tsinghua.edu.cn/d/674208019e314311ab5c/）
下的chatglm2-6b-int4文件夹内的内容

Recommend Projects

chenyifanthu / thu-cloud-downloader Goto Github PK

thu-cloud-downloader's People

Contributors

Stargazers

Watchers

Forkers

thu-cloud-downloader's Issues

Enhancing download_single_file to Handle Non-Existent Files

不支持加密文件的下载

请问支持下个给定链接下的指定文件夹吗？

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

	def download_single_file(url: str, fname: str, pbar: tqdm):
	global sess
	resp = sess.get(url, stream=True)
	with open(fname, 'wb') as file:
	for data in resp.iter_content(chunk_size=1024):
	size = file.write(data)
	pbar.update(size)