python3webspider / douyin Goto Github PK
View Code? Open in Web Editor NEWAPI of DouYin for Humans used to Crawl Popular Videos and Musics
License: MIT License
API of DouYin for Humans used to Crawl Popular Videos and Musics
License: MIT License
Exception has occurred: ConnectionError
('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
http.client.RemoteDisconnected: Remote end closed connection without response
During handling of the above exception, another exception occurred:
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
During handling of the above exception, another exception occurred:
File "C:\Users\mcazm\OneDrive\Masaüstü\AstralBazaar Grup Yakalayıcı\main.py", line 11, in groupfinder
r = requests.get(f"https://www.roblox.com/groups/group.aspx?gid={id}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
i got an error if i use over 50 threads in my pc
`import os
import threading
import requests, random
from dhooks import Webhook
import ctypes
ctypes.windll.kernel32.SetConsoleTitleW("AstralBazaar Grup Yakalayici")
def groupfinder():
id = random.randint(31368199, 35368199)
r = requests.get(f"https://www.roblox.com/groups/group.aspx?gid={id}")
if 'owned' not in r.text:
re = requests.get(f"https://groups.roblox.com/v1/groups/{id}")
if 'isLocked' not in re.text and 'owner' in re.text:
if re.json()['publicEntryAllowed'] == True and re.json()['owner'] == None:
hook.send(f'Hit: https://www.roblox.com/groups/group.aspx?gid={id}')
print(f"[+] Hit: {id}")
else:
print(f"[-] Gruba giris yasak: {id}")
else:
print(f"[-] Grup Kilitli: {id}")
else:
print(f"[-] Grubun Sahibi Var: {id}")
#your webhook
hook = input("[-] Webhook Linkini girin: ")
#number of threads
threads = int(input("[-] Threads sayisi: "))
while True:
if threading.active_count() <= threads:
threading.Thread(target=groupfinder).start()
`
pip3 install douyin就是启动吗,执行完没有下载任何音视频啊?
跑完發現找不到資料存在哪
Python 3.7.2 has issue of "Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying..."?
D:\Program Files (x86)\Python\Python37-32\apps\DouYin-master\examples>python save_hot_videos_and_musics_to_file.py
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
0it [00:00, ?it/s]
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
这个方法已经失效了, 接口无法访问成功
wx:YY_yhzf
import douyin
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\site-packages\IPython\core\interactiveshell.py", line 2881, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "", line 1, in
import douyin
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self.system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\douyin_init.py", line 2, in
import douyin.handlers
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self.system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\douyin\handlers_init.py", line 2, in
from douyin.handlers.file import FileHandler
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self._system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\douyin\handlers\file.py", line 5, in
import aiohttp
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self.system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\aiohttp_init.py", line 6, in
from .client import * # noqa
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self._system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\aiohttp\client.py", line 18, in
from . import client_exceptions, client_reqrep
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self._system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\aiohttp\client_reqrep.py", line 17, in
from . import hdrs, helpers, http, multipart, payload
File "C:\Program Files\JetBrains\PyCharm Community Edition 181.3986.3\helpers\pydev_pydev_bundle\pydev_import_hook.py", line 20, in do_import
module = self._system_import(name, *args, **kwargs)
File "C:\ProgramData\Anaconda3\lib\site-packages\aiohttp\helpers.py", line 166, in
@attr.s(frozen=True, slots=True)
TypeError: attributes() got an unexpected keyword argument 'frozen'
如果只知道一个人的uid,怎么自动化的把她所有的视频都爬下来,谢谢
我看抓取不到数据了
下载的视屏有问题
哈喽,各位大佬,
请教下有没有实际能用 的?
可以
[email protected]
请问 hot_video_url 多久更新一次呀?另外 hot_trend_url 这个是失效了吗?没内容了
downloader.download(item.videos(max=2))
# downloaders/base.py
if isinstance(inputs, types.GeneratorType):
temps = []
for result in inputs:
print('Processing', result, '...')
temps.append(result)
if len(temps) == self.batch:
self.process_items(temps)
temps = []
Exception <class 'requests.exceptions.ConnectionError'> occurred, retrying...
爬不了了
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.