erisyoung / douyin_spider Goto Github PK

View Code? Open in Web Editor NEW

66.0 66.0 20.0 2.08 MB

🎨One simple and easy to use crawler for DouYin（一个简单易用的抖音爬虫,可下载指定用户,挑战,音乐的视频,音频和数据)

License: MIT License

Python 77.65% HTML 11.33% JavaScript 11.01%

douyin_spider's People

Contributors

Stargazers

Watchers

Forkers

jaleeli keji56 kuainiao asdlei99 kylin92 foxgeek36 zhouzhuofei xraycoder zszen zangz shangyou single430 realmyth gangren1024 kyxkbbs gcrocky a1198457636 buptbf visense

douyin_spider's Issues

爬取视频出错

macOS 10.15.1
python 3.6.5

在douyin_spider/douyin_spider中运行
python assign_share_url.py -u "https://v.douyin.com/QHt8K5/"

https://www.iesdouyin.com/share/user/76725372134?u_code=119ahghf6&sec_uid=MS4wLjABAAAA2jD45shuaphDnTULtCA3baR-xPXsD97pzSzgKAYwfss&timestamp=1573702412&utm_source=copy&utm_campaign=client_share&utm_medium=android&share_app_name=douyin
Parse share-url to user share url...
Downloading videos from user, count:10...
<User<default,76725372134>>
internal/modules/cjs/loader.js:797
    throw err;
    ^

Error: Cannot find module '/Users/macbook/anaconda3/lib/python3.6/site-packages/douyin_spider/utils/decryption/signture.js'
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:794:15)
    at Function.Module._load (internal/modules/cjs/loader.js:687:27)
    at Function.Module.runMain (internal/modules/cjs/loader.js:1025:10)
    at internal/main/run_main_module.js:17:11 {
  code: 'MODULE_NOT_FOUND',
  requireStack: []
}
Traceback (most recent call last):
  File "assign_share_url.py", line 161, in <module>
    run()
  File "assign_share_url.py", line 157, in run
    process_func(real_url, count)
  File "assign_share_url.py", line 130, in download_videos_from_user
    downloader.download(user.videos(max=count))
  File "/Users/macbook/anaconda3/lib/python3.6/site-packages/douyin_spider/downloaders/parent.py", line 92, in download
    for item in input_items:
  File "/Users/macbook/anaconda3/lib/python3.6/site-packages/douyin_spider/models/user.py", line 35, in videos
    '_signature': generate_signature(str(self.id)),
  File "/Users/macbook/anaconda3/lib/python3.6/site-packages/douyin_spider/utils/decryption/signture.py", line 20, in generate_signature
    return p.readlines()[0]
IndexError: list index out of range

怎么取的v1/feed/ 推荐列表的数据，那个签名不管用啊

怎么取的v1/feed/ 推荐列表的数据，那个签名不管用啊
比如：https://api.amemv.com/aweme/v1/feed/

使用的示例代码
`
from douyin_spider.downloaders.video import VideoDownloader
from douyin_spider.handler.video import VideoHandler
from douyin_spider.handler.music import MusicHandler
from douyin_spider.handler.mongodb import MongoHandler
from douyin_spider.enter.hot_top import hot_top20

video_handler = VideoHandler(folder='./videos')
music_handler = MusicHandler(folder='./musics')
mongo_handler = MongoHandler()
downloader = VideoDownloader([video_handler,music_handler,mongo_handler])

result = hot_top20()

for item in result.data:
downloader.download(item)

print("success")
`

执行命令结果报错
`A:douyin_spider mmm$ python douyin.py

Traceback (most recent call last):
File "douyin.py", line 2, in
from douyin_spider.handler.video import VideoHandler
File "/Users/mengqingyue/anaconda3/lib/python3.5/site-packages/douyin_spider/handler/video.py", line 1, in
from douyin_spider.handler.media import MediaHandler
File "/Users/mengqingyue/anaconda3/lib/python3.5/site-packages/douyin_spider/handler/media.py", line 54
media_save_path = Path(self.folder).joinpath(f"{item.id}.{extension}")
^
SyntaxError: invalid syntax
`

操作系统时MacOS， Python版本为3.5，请问该怎么办呢？

erisyoung / douyin_spider Goto Github PK

douyin_spider's People

Contributors

Stargazers

Watchers

Forkers

douyin_spider's Issues

爬取视频出错

可以根据手机号找到uid吗

怎么取的v1/feed/ 推荐列表的数据，那个签名不管用啊

运行报错

用户信息

挑战专题视频数据获取失败，测试运行显示video count:0

通过分享地址去下载没法下载哦，aweme_list返回都是空数组

-u 下载用户视频报错

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent