nandaka / pixivutil2 Goto Github PK

View Code? Open in Web Editor NEW

2.3K 2.3K 247.0 14.08 MB

Download images from Pixiv and more!

Home Page: http://nandaka.devnull.zone/

License: BSD 2-Clause "Simplified" License

Python 98.50% HTML 1.48% Dockerfile 0.03%

pixivutil2's People

Contributors

Stargazers

Watchers

Forkers

jdstroy davidtwang alivelee roxasshadow mokojumbie awkwardusername dastardlylemon prototype27 izaya138 s-vortex sx111 thedoc69 heltonchen cyart hjyssg jelly-bee xundi007 shoeshi yife lpixel pavilionvi raix852 dawnxcirno evilneo wildfootw kandastroge onenyon aetherxx amarao admiralcurtiss pixtrix awiebe unforeseenocean chisaka-kr little1tow harrywang-1523 4869aptx ljypaul2011 srndpty toshiya44 hi117 pachimonopower newuserha ececleon eromoe rachmadaniharyono nekomutsuki snowxucker zombie10 saitako waterbroz glitchedcatto tarekjor sweetsinpackets pingaowang maymeow zheung phenrei costda reothe nickgreen11 lcylym rhythm-games-maker tuskumo233 abysmli xiao-er-shang-jiu jellosnail playeryao lingxuehan yifei-fu nixxquality fake-name tkiapril thamematrix dudckd1003 dukevalentine nhorus mechamanjc williamkim8316 frenzy7 yzaoui willdeath5 unicorn00 tokychan split-n lushiety ksuiz uplk happyjin78a alexwh ksdpm fireattack httpsgithu nickduijndam milpow imtaehui0802 zsdresd real-shigure vampiricwulf hezeqiang

pixivutil2's Issues

Requests

You pixiv downloader is grateful

Of a way to add the features you need and I will

Please add features that the description of the picture in the text of the same name and picture

Many writers of the picture settings stored separately to many it's hard to

I'm begging you

あなたのpixiv downloaderは感謝しても使用しています

ところが、必要な機能が生じて追加を提案しています

画像の説明を図のような名前のテキストにしてくれる機能を追加してください

画像の設定が多くの作家が多くて別々に保存することが大変ですね

お願いします

selecting “5 – Download from user bookmark” and also exporting online bookmarks every entry is doubled

Firstly, thanks for this awesome time saving program. I really appreciate it.

I did notice something though, when selecting “5 – Download from user bookmark” and also exporting online bookmarks every entry is doubled. So instead of ending up with let’s say 100 bookmarks, it doubles to 200. Not quite sure if this is a new issue or not. Obviously it increases download times and also hits the Pixiv servers twice which isn’t a good thing.

For anyone else who is having the same problem…I solved it by exporting the online bookmarks, copy pasting the list into http://textop.us/Lines-tools/Delete-Duplicate-Lines to remove duplicates and then using the “uselist” config setting for Pixiv Downloader instead. Just thought i’d let you know and everyone else so we can all responsibly connect to Pixiv and minimize our bandwidth consumption.

http://nandaka.wordpress.com/2012/05/19/pixiv-downloader-20120519/#comment-1799

Allow formatting of manga folder & filename

I added a comment to your blog about this feature (http://nandaka.wordpress.com/2012/07/04/pixiv-downloader-20120704/#comment-1983)

It would be good to have some control over the folder and file names used for the manga entries. Presumably, it could use the same tags and formatting method used for file names.

Can I suggest two new tags for handling the page number part of the file name? How about:

%page_number% or %page_num% for page numbering using human-readable numbering (e.g. 1 of 7) starting at 1
%page_index% or %page_idx% for page numbering using pixiv's internal numbering with the index starting at 0

It would also be good to be able to specify whether to use leading zeros, with the number of zeros based on the total number of images. For 100 images using %page_number% the first image would be 001. Using %page_index% the first image of 100 would be 00 and the last, 99.

Error when trying to log-in

HTTP Error 403: request disallowed by robots.txt

Can't download anything T_T

PixivDownloader2 version 20120806
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading V:\Program Files\PixivD\config.ini ...
done.
Creating database... done.
Only process member where day last updated >= 7
Using Username: test56
logging in with saved cookie
Trying to log with saved cookie
Cookie already expired/invalid.
Log in using form.
done.
new cookie value: 22d476541f275bad092a260a60f9f6f8
Writing config file... done.
PixivDownloader2 version 20120806
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

Processing Image Id: 29126463
Title: ??????????
Tags : ?????? ??????????? ?????????????? ???? ????????? ???? ???????
Mode : big
Image URL : http://i2.pixiv.net/img44/img/believer_a/29126463.png
Filename : C:\DL Image Packs\1471757 (believer_a)\29126463.png
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>,
<httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1649
c38 whose wrapped object = <closeable_response at 0x16e2940 whose fp = <cStringI
O.StringI object at 0x016FE908>>>, <traceback object at 0x016FC378>)
Dumping html to: Error Medium Page for image 29126463.html
Cannot dump page for image_id: 29126463
Stuff happened, trying again after 2 second ( 1 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 29126463
Title: ??????????
Tags : ?????? ??????????? ?????????????? ???? ????????? ???? ???????
Mode : big
Image URL : http://i2.pixiv.net/img44/img/believer_a/29126463.png
Filename : C:\DL Image Packs\1471757 (believer_a)\29126463.png
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>,
<httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1720
d88 whose wrapped object = <closeable_response at 0x17d2a30 whose fp = <cStringI
O.StringI object at 0x017E5F98>>>, <traceback object at 0x017D7AD0>)
Dumping html to: Error Medium Page for image 29126463.html
Cannot dump page for image_id: 29126463
Stuff happened, trying again after 2 second ( 2 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 29126463
Title: ??????????
Tags : ?????? ??????????? ?????????????? ???? ????????? ???? ???????
Mode : big
Image URL : http://i2.pixiv.net/img44/img/believer_a/29126463.png
Filename : C:\DL Image Packs\1471757 (believer_a)\29126463.png
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>,
<httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1817
df8 whose wrapped object = <closeable_response at 0x184d878 whose fp = <cStringI
O.StringI object at 0x018C5CB0>>>, <traceback object at 0x01851AD0>)
Dumping html to: Error Medium Page for image 29126463.html
Cannot dump page for image_id: 29126463
Stuff happened, trying again after 2 second ( 3 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 29126463
Title: ??????????
Tags : ?????? ??????????? ?????????????? ???? ????????? ???? ???????
Mode : big
Image URL : http://i2.pixiv.net/img44/img/believer_a/29126463.png
Filename : C:\DL Image Packs\1471757 (believer_a)\29126463.png
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>,
<httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x18db
e68 whose wrapped object = <closeable_response at 0x1971738 whose fp = <cStringI
O.StringI object at 0x0197BDB8>>>, <traceback object at 0x01974878>)
Dumping html to: Error Medium Page for image 29126463.html
Cannot dump page for image_id: 29126463
Stuff happened, trying again after 2 second ( 4 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 29126463
Title: ??????????
Tags : ?????? ??????????? ?????????????? ???? ????????? ???? ???????
Mode : big
Image URL : http://i2.pixiv.net/img44/img/believer_a/29126463.png
Filename : C:\DL Image Packs\1471757 (believer_a)\29126463.png
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
1 2 3 4
HTTP Error 403: request disallowed by robots.txt
403
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>,
<httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x19a1
ed8 whose wrapped object = <closeable_response at 0x1a52ad0 whose fp = <cStringI
O.StringI object at 0x01A6AE90>>>, <traceback object at 0x018E2DA0>)
Dumping html to: Error Medium Page for image 29126463.html
Cannot dump page for image_id: 29126463
Giving up image_id: 29126463
PixivDownloader2 version 20120806
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

10. Download by Tag and Member Id

d. Manage database
e. Export online bookmark
x. Exit
Input:

and logilfe:

2012-08-09 17:17:47,533 - PixivUtil20120806 - INFO - ###############################################################
2012-08-09 17:17:47,549 - PixivUtil20120806 - INFO - Starting...
2012-08-09 17:17:47,690 - PixivUtil20120806 - INFO - Only process member where day last updated >= 7
2012-08-09 17:17:47,690 - PixivUtil20120806 - INFO - Using Username: test56
2012-08-09 17:17:47,690 - PixivUtil20120806 - INFO - logging in with saved cookie
2012-08-09 17:17:47,690 - PixivUtil20120806 - INFO - Trying to log with saved cookie
2012-08-09 17:17:51,611 - PixivUtil20120806 - INFO - Cookie already expired/invalid.
2012-08-09 17:17:51,611 - PixivUtil20120806 - INFO - Log in using form.
2012-08-09 17:17:57,503 - PixivUtil20120806 - INFO - Logged in
2012-08-09 17:18:38,331 - PixivUtil20120806 - INFO - Member id mode.
2012-08-09 17:18:43,924 - PixivUtil20120806 - INFO - Processing Member Id: 1471757
2012-08-09 17:18:51,299 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:18:55,908 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:01,753 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:06,378 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:06,378 - PixivUtil20120806 - ERROR - Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1649c38 whose wrapped object = <closeable_response at 0x16e2940 whose fp = <cStringIO.StringI object at 0x016FE908>>>, <traceback object at 0x016FC378>)
2012-08-09 17:19:06,378 - PixivUtil20120806 - ERROR - Error at processImage(): 29126463
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2012-08-09 17:19:06,378 - PixivUtil20120806 - ERROR - Dumping html to: Error Medium Page for image 29126463.html
2012-08-09 17:19:06,378 - PixivUtil20120806 - ERROR - Cannot dump page for image_id: 29126463
2012-08-09 17:19:12,815 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:17,440 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:22,065 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:26,690 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:26,690 - PixivUtil20120806 - ERROR - Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1720d88 whose wrapped object = <closeable_response at 0x17d2a30 whose fp = <cStringIO.StringI object at 0x017E5F98>>>, <traceback object at 0x017D7AD0>)
2012-08-09 17:19:26,690 - PixivUtil20120806 - ERROR - Error at processImage(): 29126463
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2012-08-09 17:19:26,690 - PixivUtil20120806 - ERROR - Dumping html to: Error Medium Page for image 29126463.html
2012-08-09 17:19:26,690 - PixivUtil20120806 - ERROR - Cannot dump page for image_id: 29126463
2012-08-09 17:19:33,283 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:37,908 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:47,096 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:51,721 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:19:51,721 - PixivUtil20120806 - ERROR - Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x1817df8 whose wrapped object = <closeable_response at 0x184d878 whose fp = <cStringIO.StringI object at 0x018C5CB0>>>, <traceback object at 0x01851AD0>)
2012-08-09 17:19:51,721 - PixivUtil20120806 - ERROR - Error at processImage(): 29126463
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2012-08-09 17:19:51,721 - PixivUtil20120806 - ERROR - Dumping html to: Error Medium Page for image 29126463.html
2012-08-09 17:19:51,721 - PixivUtil20120806 - ERROR - Cannot dump page for image_id: 29126463
2012-08-09 17:19:58,206 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:02,815 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:07,424 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:12,033 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:12,033 - PixivUtil20120806 - ERROR - Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x18dbe68 whose wrapped object = <closeable_response at 0x1971738 whose fp = <cStringIO.StringI object at 0x0197BDB8>>>, <traceback object at 0x01974878>)
2012-08-09 17:20:12,033 - PixivUtil20120806 - ERROR - Error at processImage(): 29126463
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2012-08-09 17:20:12,033 - PixivUtil20120806 - ERROR - Dumping html to: Error Medium Page for image 29126463.html
2012-08-09 17:20:12,033 - PixivUtil20120806 - ERROR - Cannot dump page for image_id: 29126463
2012-08-09 17:20:18,846 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:23,440 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:28,049 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - HTTPError: HTTP Error 403: request disallowed by robots.txt(http://i2.pixiv.net/img44/img/believer_a/29126463.png)
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - Error at processImage(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x19a1ed8 whose wrapped object = <closeable_response at 0x1a52ad0 whose fp = <cStringIO.StringI object at 0x01A6AE90>>>, <traceback object at 0x018E2DA0>)
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - Error at processImage(): 29126463
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 122, in downloadImage
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - Dumping html to: Error Medium Page for image 29126463.html
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - Cannot dump page for image_id: 29126463
2012-08-09 17:20:32,674 - PixivUtil20120806 - ERROR - Giving up image_id: 29126463

and dumped page: http://rghost.ru/39673731

Unable to log in.

PixivUtil2 throws an error right when it tries to log in.
Throws an error whether I log in manually or through config.ini credentials.

Heres the debug log.

2014-01-29 22:18:45,232 - PixivUtil20140126 - INFO - ###############################################################
2014-01-29 22:18:45,233 - PixivUtil20140126 - INFO - Starting...
2014-01-29 22:18:45,237 - PixivUtil20140126 - INFO - Setting log level to: DEBUG
2014-01-29 22:18:45,239 - PixivUtil20140126 - INFO - No default cookie jar available, creating...
2014-01-29 22:18:45,246 - PixivUtil20140126 - INFO - Only process member where day last updated >= 7
2014-01-29 22:18:45,246 - PixivUtil20140126 - INFO - Using Username: ultimatenoob
2014-01-29 22:18:45,246 - PixivUtil20140126 - INFO - logging in with saved cookie
2014-01-29 22:18:45,249 - PixivUtil20140126 - INFO - Trying to log with saved cookie
2014-01-29 22:18:46,767 - PixivUtil20140126 - INFO - Failed to login using cookie, returned page: http://www.pixiv.net/index.php?return_to=%2Fmypage.php
2014-01-29 22:18:46,769 - PixivUtil20140126 - INFO - Cookie already expired/invalid.
2014-01-29 22:18:46,769 - PixivUtil20140126 - INFO - Log in using form.
2014-01-29 22:18:48,417 - PixivUtil20140126 - ERROR - Error at pixiv_login(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x2539ea0 whose wrapped object = <closeable_response at 0x25a9440 whose fp = <cStringIO.StringI object at 0x02552560>>>, <traceback object at 0x025A75A8>)
Traceback (most recent call last):
File "PixivUtil2.py", line 258, in pixiv_login
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2014-01-29 22:18:48,420 - PixivUtil20140126 - ERROR - Unknown Error: HTTP Error 403: request disallowed by robots.txt
Traceback (most recent call last):
File "PixivUtil2.py", line 1746, in main
File "PixivUtil2.py", line 258, in pixiv_login
File "mechanize_mechanize.pyc", line 203, in open
File "mechanize_mechanize.pyc", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
2014-01-29 22:18:56,233 - PixivUtil20140126 - INFO - EXIT
2014-01-29 22:18:56,233 - PixivUtil20140126 - INFO - ###############################################################

Download by member id - downloads only few images and says it sees only 1 page of 2

http://www.pixiv.net/member_illust.php?id=20352

It downloads 10 images and says there is only 1 page but on website it says "31件" images and two pages

Log:
2013-01-19 00:13:46,079 - PixivUtil20121215 - INFO - ###############################################################
2013-01-19 00:13:46,079 - PixivUtil20121215 - INFO - Starting...
2013-01-19 00:13:46,079 - PixivUtil20121215 - INFO - Using Username: *******
2013-01-19 00:13:46,079 - PixivUtil20121215 - INFO - logging in with saved cookie
2013-01-19 00:13:46,079 - PixivUtil20121215 - INFO - Trying to log with saved cookie
2013-01-19 00:13:49,502 - PixivUtil20121215 - INFO - Logged in using cookie
2013-01-19 00:13:51,611 - PixivUtil20121215 - INFO - Member id mode.
2013-01-19 00:13:58,266 - PixivUtil20121215 - INFO - Processing Member Id: 20352
2013-01-19 00:13:58,282 - PixivUtil20121215 - INFO - Member Url: http://www.pixiv.net/member_illust.php?id=20352&p=1
2013-01-19 00:14:00,766 - PixivUtil20121215 - INFO - Member_id: 20352 complete, last image_id: 3095802

window direct log:
PixivDownloader2 version 20121215
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading V:\Program Files\PixivD\config.ini ...
done.
Creating database... done.
Using Username: *******
logging in with saved cookie
Trying to log with saved cookie
done.
PixivDownloader2 version 20121215
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption
Download by Tag and Member Id
Download Member Bookmark
d. Manage database
e. Export online bookmark
x. Exit
Input: 1
Member id: 20352
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing Member Id: 20352
Reading V:\Program Files\PixivD\config.ini ...
done.
Page 1
Member Url: http://www.pixiv.net/member_illust.php?id=20352&p=1
Member Name : ???
Member Avatar: http://i1.pixiv.net/img03/profile/tateha/5646840.jpg
Member Token : tateha
#1
Already downloaded: 29155508
#1
Already downloaded: 29022590
#1
Already downloaded: 26879813
#1
Already downloaded: 20830865
#1
Already downloaded: 19781678
#1
Already downloaded: 16862443
#1
Already downloaded: 8160208
#1
Already downloaded: 6427420
#1
Already downloaded: 3362027
#1
Already downloaded: 3095802
Last Page
Done.

cfg file:
[Settings]
proxyaddress =
useproxy = False
useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
debughttp = False
userobots = False
filenameformat = %member_id% (%member_token%)%urlFilename% - %title%
filenamemangaformat = %member_id% (%member_token%)%image_id%%urlFilename%
timeout = 60
uselist = False
processfromdb = False
overwrite = False
tagsseparator = ,
daylastupdated = 7
rootdirectory = C:\DL Image Packs
retry = 3
retrywait = 5
createdownloadlists = False
downloadlistdirectory = .
irfanviewpath = C:\Program Files\IrfanView
startirfanview = False
startirfanslide = False
alwayscheckfilesize = False
checkupdatedlimit = 0
downloadavatar = False
createmangadir = False
usetagsasdir = False
useblacklisttags = False
usesuppresstags = False
tagslimit = -1
writeimageinfo = False

[Pixiv]
numberofpage = 0
r18mode = False

*Moved issue to right repository, sry ^_^

it look like the image list is from page 1 and page 2 if you compare from pixiv... Likely the server return wrong number of images?

Yes images are both from page 1 and 2 but just not close to all of em, how do I know if it returns wrong number of images? And why would it do so for me and not for you? What can be done?

EDIT: I logged from my account I made specially for pixivdownloader manually and opened http://www.pixiv.net/member_illust.php?id=20352 and yes it shows 10 images total =_= - wtf is this? how? do they downgrade accounts in right to view all images after some 'inactivty" time or something? do you know? Cuz I wouldn't want to store my pixivs main account credentials in plain text file on my hard drive T_T

Update query for search by tag

see: https://nandaka.wordpress.com/2012/11/24/pixiv-downloader-20121124/#comment-2555

I think they changed tag system, so now instead of /tags.php?tag= query to get tagged images one need to use /search.php?s_mode=s_tag_full&word=

Crash caused by Pixiv's new animated images feature

As of June 25th 2014, Pixiv has introduced a new function that allows animations, as announced here: http://www.pixiv.net/info.php?id=2476.

The software cannot obviously process the new format, since these images cannot be even saved normally: they are played by a Java applet. So every time the software reaches an image_id that uses it, it shuts down immediately. Within hours, several artists have already started to use the new feature, so option 8 has become unusable, and it’ll extend to other functions once use of the new feature spreads.

A solution, or at least a temporary one, may be have the software skip the image_id once it finds there is no “traditional” image.

Also, by taking a look into the page source of some new images, they seem to lead to zip files that contain their individual animation frames.

For example, for
http://www.pixiv.net/member_illust.php?mode=medium&illust_id=44301046

I find
{“src”:”http://i1.pixiv.net/img-zip-ugoira/img/2014/06/25/17/58/59/44301046_ugoira600x600.zip”
“src”:”http://i1.pixiv.net/img-zip-ugoira/img/2014/06/25/17/58/59/44301046_ugoira1920x1080.zip”
(I took only these and not the commands that follow, regulating the delay of each individual frame)

Baside skipping, managing to get these may be the “key”.

'NoneType' object has no attribute 'ul'

This happens sometimes, after restart and entering same input works fine usually. (Proabably because program was open for too long and cookie expired?)

Log:

PixivDownloader2 version 20120704
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

Issues with Mechanize unescaping?

Hello there!

I'm getting this issue: http://pastebin.com/jiKW64Dc

Have a look at the log. It's going to be vastly better at explaining things than I am.

images from showcase also downloaded when do download by tags

need to remove images in

AttributeError("'NoneType' object has no attribute 'ul'",)

Running on Mac OS X 10.10 (Yosemite), encountered this error when trying both the user bookmarks and the image bookmarks.

After searching around in the html and the programs code, I found the issue:

Seems that Pixiv (at least for me) changed the class from "'display_works linkStyleWorks', to 'display_works linkStyleWorks ' (With a space at the end).

So I added the space into the required lines in the code, and everything works fine. I'm not sure if this is a Mac only error or if is now a universal change for Pixiv.

Regardless, I thought I'd report it!

-Matt

After last update, only download pair images in manga mode

Here is a full log:
screenshot: https://www.dropbox.com/s/0e83l5i3wtba2p3/Capture%20d%27%C3%A9cran%202014-10-03%2019.13.22.png?dl=0

Image ids: 30507937
Processing Image Id: 30507937
Title: 紅楼夢８新刊「共食い禁止令！」
Tags : 東方, 東方紅楼夢, 地霊殿, 霊烏路空, 古明地さとり
Date : 2012-10-01 21:27:00
Mode : manga
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=3
0507937&page=0
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=3
0507937&page=1
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=3
0507937&page=2
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=3
0507937&page=3
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&illust_id=3
0507937&page=4
Page Count : 5
Image URL : http://i2.pixiv.net/img14/img/kagamino/30507937_big_p0.jpg
Filename : I:\Pixiv\193027 kagamino\烏丸あみる _\30507937_big_p0 - 紅楼夢８新刊「共食い禁ﾚ
Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=30507937
Start downloading... 357364 of 357364 Bytes Completed in 2.793s (124.95 KiB/s)
done.

Image URL : http://i2.pixiv.net/img14/img/kagamino/30507937_big_p2.jpg
Filename : I:\Pixiv\193027 kagamino\烏丸あみる _\30507937_big_p2 - something.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=30507937
Start downloading... 622938 of 622938 Bytes Completed in 2.935s (207.27 KiB/s)
done.

Filename : I:\Pixiv\193027 kagamino\烏丸あみる _\30507937_big_p4 - something.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=30507937
Start downloading... 930539 of 930539 Bytes Completed in 2.761s (329.13 KiB/s)
done.

SOCKS proxy support

Hey there! I've used your script and I was wondering if you could add SOCKS proxy support?

All it takes is this:

pip install https://socksipy-branch.googlecode.com/files/SocksiPy-branch-1.02.tar.gz to install the SOCKS library.

Add something like this to your code:

if __config__.useProxy and __config__.proxy.startswith('socks'):
    import socks, urlparse
    parseResult = urlparse.parse(__config__.proxy)

    assert parseResult.scheme and parseResult.hostname and parseResult.port

    socksType = socks.PROXY_TYPE_SOCKS5 if parseResult.scheme == 'socks5' else socks.PROXY_TYPE_SOCKS4

    socks.setdefaultproxy(socks.PROXY_TYPE_SOCKS5, parseResult.hostname, parseResult.port)

    socks.wrapmodule(urllib)
    socks.wrapmodule(urllib2)
    socks.wrapmodule(httplib)

underneath the urllib and httplib imports.

I've done something similar locally but I don't understand your code well enough to integrate it properly ^.^

Tag list mode switched to next tag without reason

Hello,

While using tag list mode (option 7), setting starting page at 1 and not touching the default limit (by typing nothing and pressing "enter"), I remarked the program switched tags at page 615.

2014-10-12 16:29:41,052 - PixivUtil20141006 - INFO - Looping... for http://www.pixiv.net/search.php?s_mode=s_tag&p=615&word=%E3%83%95%E3%83%A9%E3%83%B3%E3%83%89%E3%83%BC%E3%83%AB%E3%83%BB%E3%82%B9%E3%82%AB%E3%83%BC%E3%83%AC%E3%83%83%E3%83%88
2014-10-12 16:29:52,842 - PixivUtil20141006 - INFO - Searching for: (フランドール) %E3%83%95%E3%83%A9%E3%83%B3%E3%83%89%E3%83%BC%E3%83%AB
2014-10-12 16:29:52,842 - PixivUtil20141006 - INFO - Looping... for http://www.pixiv.net/search.php?s_mode=s_tag&p=1&word=%E3%83%95%E3%83%A9%E3%83%B3%E3%83%89%E3%83%BC%E3%83%AB

If you use the first address ( http://www.pixiv.net/search.php?s_mode=s_tag&p=615&word=%E3%83%95%E3%83%A9%E3%83%B3%E3%83%89%E3%83%BC%E3%83%AB%E3%83%BB%E3%82%B9%E3%82%AB%E3%83%BC%E3%83%AC%E3%83%83%E3%83%88 ) you will find out that it's full, and that there is up to 1000 pages (and probably more but pixiv doesn't allow to go higher than 1000).

I don't know if it can be tested easily (I mean 615 pages of download is a pretty high number !) but I just thought I should report it.

In the meantime I just restarted the tag list action, setting the starting page to 614 to make sure I got everything right. It doesn't seem to be complaining and is at page 617 going like it should right now.

Thank you for making this and I hope it's a silly bug that you can resolve :3

unable to download images by member_id after latest pixiv update (probably)

PixivDownloader2 version 20140926
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading V:\folder\config.ini ...
Error at loadConfig(): (<class 'ConfigParser.NoOptionError'>, No option 'writeUg
oiraInfo' in section: 'Settings', <traceback object at 0x020F0FA8>)
Some configuration have invalid value, replacing with the default value.
Writing config file... Backing up old config (error exist!) to config.ini.error-
1412089005
done.
done.
Creating database... done.
Only process member where day last updated >= 7
Using Username: test56
logging in with saved cookie
Trying to log with saved cookie
done.
PixivDownloader2 version 20140926
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption
Download by Tag and Member Id
Download Member Bookmark

12. Download by Group Id

d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input: 1
Member ids: 1573847
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing Member Id: 1573847
Reading V:\folder\config.ini ...
done.
Page 1
Member Url: http://www.pixiv.net/member_illust.php?id=1573847&p=1
Traceback (most recent call last):
File "PixivUtil2.py", line 427, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 93, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'
Error at process_member(): (<type 'exceptions.AttributeError'>, AttributeError("
'NoneType' object has no attribute 'ul'",), <traceback object at 0x0285D6C0>)
Dumping html to: Error page for member 1573847.html
Traceback (most recent call last):
File "PixivUtil2.py", line 1813, in main
File "PixivUtil2.py", line 1609, in main_loop
File "PixivUtil2.py", line 1315, in menu_download_by_member_id
File "PixivUtil2.py", line 427, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 93, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'
press enter to exit.

[Feature] Add "end page" option to CLI download from tag list

There is optional starting page, please add no less optional ending page - sometimes there is a need to check only relatively recent tag updates, not all. Plus, currently it is inconsistent with interactive mode and nearby options.

Feature Request: Image Bookmark count in filename

Please and thank you.

Suggested feature: do not download pictures older than X days

As requested, I post here this suggestion I originally posted on the blog.

The idea would be to have a setting in the .ini so that the downloader gets only pictures that were posted X days before the system date. So, value 0 would be no limit, 7 would be only pics that are a week old or newer, 60 only from the last two months, and so on.

Since the program also reads the works' dates (in fact, you can even set it to include them in the filenames), it would be technically possible.

AttributeError: 'NoneType' object has no attribute 'string'

Not sure exactly what happened here, but these two files consistently throw errors at me upon trying to download them. (There are 2 HTML files that I can upload if you need them.)

Log:

PixivDownloader2 version 20120724
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

10. Download by Tag and Member Id

d. Manage database
e. Export online bookmark
x. Exit
Input: 4
Processing from database.
Found 32 items.

(snip)

done.
Processing Member Id: 491042
Reading config file... done.
Page 1
Member Name : ??
Member Avatar: http://source.pixiv.net/source/images/no_profile.png
Member Token : akkn-akikan
#1

Processing Image Id: 29074091
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x0262EF30>)

Dumping html to: Error Medium Page for image 29074091.html
Stuff happened, trying again after 2 second ( 1 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29074091
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x033C3E18>)

Dumping html to: Error Medium Page for image 29074091.html
Stuff happened, trying again after 2 second ( 2 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29074091
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x034F8D28>)

Dumping html to: Error Medium Page for image 29074091.html
Stuff happened, trying again after 2 second ( 3 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29074091
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x0363D670>)

Dumping html to: Error Medium Page for image 29074091.html
Stuff happened, trying again after 2 second ( 4 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29074091
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x03B31C60>)

Dumping html to: Error Medium Page for image 29074091.html
Giving up image_id: 29074091
done.

(snip)

done.
Processing Member Id: 1014524
Reading config file... done.
Page 1
Member Name : ??
Member Avatar: http://i1.pixiv.net/img35/profile/kemoisumi/4107803.jpg
Member Token : kemoisumi
File exist! (Identical Size)
#1

Processing Image Id: 29082131
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x03105468>)

Dumping html to: Error Medium Page for image 29082131.html
Stuff happened, trying again after 2 second ( 1 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29082131
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x03631F80>)

Dumping html to: Error Medium Page for image 29082131.html
Stuff happened, trying again after 2 second ( 2 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29082131
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x025E5260>)

Dumping html to: Error Medium Page for image 29082131.html
Stuff happened, trying again after 2 second ( 3 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29082131
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x03BD1918>)

Dumping html to: Error Medium Page for image 29082131.html
Stuff happened, trying again after 2 second ( 4 )
'NoneType' object has no attribute 'string'
Processing Image Id: 29082131
Traceback (most recent call last):
File "PixivUtil2.py", line 554, in processImage
File "PixivModel.pyc", line 169, in init
File "PixivModel.pyc", line 217, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'string'
Error at processImage(): (<type 'exceptions.AttributeError'>, AttributeError("'N
oneType' object has no attribute 'string'",), <traceback object at 0x03D30580>)

Dumping html to: Error Medium Page for image 29082131.html
Giving up image_id: 29082131

(snip)

Last Page
Done.

done.
PixivDownloader2 version 20120724
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

10. Download by Tag and Member Id

d. Manage database
e. Export online bookmark
x. Exit
Input:

New cannot download by member_id error

PixivDownloader2 version 20140926
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading C:\Users\D5114360\Downloads\images\pixivutil20140926\config.ini ...
done.
Creating database... done.
Only process member where day last updated >= 7
Username ?
Password ?
logging in with saved cookie
Trying to log with saved cookie
done.
PixivDownloader2 version 20140926
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption
Download by Tag and Member Id
Download Member Bookmark

12. Download by Group Id

d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input: 1
Member ids: 39290
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing Member Id: 39290
Reading C:\Users\D5114360\Downloads\images\pixivutil20140926\config.ini ...
done.
Page 1
Member Url: http://www.pixiv.net/member_illust.php?id=39290&p=1
Traceback (most recent call last):
File "PixivUtil2.py", line 427, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 93, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'
Error at process_member(): (<type 'exceptions.AttributeError'>, AttributeError("
'NoneType' object has no attribute 'ul'",), <traceback object at 0x0321EFD0>)
Dumping html to: Error page for member 39290.html
Traceback (most recent call last):
File "PixivUtil2.py", line 1813, in main
File "PixivUtil2.py", line 1609, in main_loop
File "PixivUtil2.py", line 1315, in menu_download_by_member_id
File "PixivUtil2.py", line 427, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 93, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'
press enter to exit.

Question: Is it possible to run om Mac OS X?

Building from source means that you can run it on Mac OS X? I tried to replace the default setup.py file with one created by 'py2applet' which will use 'py2app' to make a Mac OS X distribution. But the generated application crashes after startup. Does someone know, how this must be done?

I used the following command to create a setup file:

py2applet --make-setup PixivUtil2.py --iconfile icon-mac.icns

I made small changes in the setup file to avoid some errors. This is the resulting file:

"""
This is a setup.py script generated by py2applet

Usage:
    python setup.py py2app
"""

from setuptools import setup

APP = ['PixivUtil2.py']
DATA_FILES = []
OPTIONS = {'argv_emulation': True,
 'iconfile': '/Users/connect/Desktop/PixivUtil2-master/icon-mac.icns'}

setup(
    app=APP,
    data_files=DATA_FILES,
    options={'py2app': OPTIONS},
    setup_requires=['py2app','BeautifulSoup']
)

Then I try to build a executable by entering:

python setup.py py2app

After starting up the application, some window shows up with the message "PixivUtil2 Error". In the console there are these errors:

05-09-14 14:14:20,755 PixivUtil2[1409]: �]2;PixivDownloader 20140712 �PixivDownloader2 version 20140712
05-09-14 14:14:20,756 PixivUtil2[1409]: https://nandaka.wordpress.com/tag/pixiv-downloader/
05-09-14 14:14:20,756 PixivUtil2[1409]: Reading /Users/connect/Desktop/PixivUtil2-master/dist/PixivUtil2.app/Contents/MacOS/config.ini ...
05-09-14 14:14:20,756 PixivUtil2[1409]: Error at loadConfig(): (<type 'exceptions.IOError'>, IOError(2, 'No such file or directory'), <traceback object at 0x10481ff80>)
05-09-14 14:14:20,756 PixivUtil2[1409]: Some configuration have invalid value, replacing with the default value.
05-09-14 14:14:20,757 PixivUtil2[1409]: Writing config file... Backing up old config (error exist!) to config.ini.error-1409919260
05-09-14 14:14:20,757 PixivUtil2[1409]: done.
05-09-14 14:14:20,757 PixivUtil2[1409]: done.
05-09-14 14:14:20,762 PixivUtil2[1409]: Traceback (most recent call last):
05-09-14 14:14:20,762 PixivUtil2[1409]:   File "/Users/connect/Desktop/PixivUtil2-master/dist/PixivUtil2.app/Contents/Resources/__boot__.py", line 373, in <module>
05-09-14 14:14:20,762 PixivUtil2[1409]:     _run()
05-09-14 14:14:20,762 PixivUtil2[1409]:   File "/Users/connect/Desktop/PixivUtil2-master/dist/PixivUtil2.app/Contents/Resources/__boot__.py", line 358, in _run
05-09-14 14:14:20,762 PixivUtil2[1409]:     exec(compile(source, path, 'exec'), globals(), globals())
05-09-14 14:14:20,762 PixivUtil2[1409]:   File "/Users/connect/Desktop/PixivUtil2-master/dist/PixivUtil2.app/Contents/Resources/PixivUtil2.py", line 1828, in <module>
05-09-14 14:14:20,762 PixivUtil2[1409]:     main()
05-09-14 14:14:20,762 PixivUtil2[1409]:   File "/Users/connect/Desktop/PixivUtil2-master/dist/PixivUtil2.app/Contents/Resources/PixivUtil2.py", line 1718, in main
05-09-14 14:14:20,763 PixivUtil2[1409]:     dfilename = PixivHelper.toUnicode(sys.path[0], encoding=sys.stdin.encoding) + os.sep + dfilename
05-09-14 14:14:20,763 PixivUtil2[1409]:   File "PixivHelper.pyc", line 279, in toUnicode
05-09-14 14:14:20,763 PixivUtil2[1409]: TypeError: unicode() argument 2 must be string, not None
05-09-14 14:14:20,781 PixivUtil2[1409]: PixivUtil2 Error
05-09-14 14:14:20,781 PixivUtil2[1409]: 2014-09-05 14:14:20.780 PixivUtil2[1409:707] PixivUtil2 Error

Error on memberid 5944544

When I downloading artist id 5944544 i get:
Member Url: http://www.pixiv.net/member_illust.php?id=5944544&p=1
Traceback (most recent call last):
File “PixivUtil2.py”, line 420, in process_member
File “PixivModel.pyc”, line 49, in init
File “PixivModel.pyc”, line 69, in ParseInfo
IndexError: list index out of range
Error at processing Artist Info: (, IndexError(‘list index o
ut of range’,), )

Refuses to work for unknown reasons

Sorry for the useless title, but I really can't express it any other way. After trying to download (this happens on all artist pages, by the way), the following stuff gets written (and nothing is downloaded):

2013-02-20 20:01:43,140 - PixivUtil20130128 - INFO - Processing Member Id: 941624
2013-02-20 20:01:43,140 - PixivUtil20130128 - INFO - Member Url: http://www.pixiv.net/member_illust.php?id=941624&p=1
2013-02-20 20:01:46,000 - PixivUtil20130128 - ERROR - Error at processing Artist Info: (<type 'exceptions.AttributeError'>, AttributeError("'NoneType' object has no attribute 'find'",), <traceback object at 0x02CCCE68>)
2013-02-20 20:01:46,000 - PixivUtil20130128 - ERROR - Error at processing Artist Info: 941624
Traceback (most recent call last):
File "PixivUtil2.py", line 414, in processMember
File "PixivModel.pyc", line 44, in init
File "PixivModel.pyc", line 60, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'find'
2013-02-20 20:01:50,000 - PixivUtil20130128 - INFO - Member Url: http://www.pixiv.net/member_illust.php?id=941624&p=1
2013-02-20 20:01:52,953 - PixivUtil20130128 - ERROR - Error at processing Artist Info: (<type 'exceptions.AttributeError'>, AttributeError("'NoneType' object has no attribute 'find'",), <traceback object at 0x02E33FA8>)
2013-02-20 20:01:52,953 - PixivUtil20130128 - ERROR - Error at processing Artist Info: 941624
Traceback (most recent call last):
File "PixivUtil2.py", line 414, in processMember
File "PixivModel.pyc", line 44, in init
File "PixivModel.pyc", line 60, in ParseInfo
AttributeError: 'NoneType' object has no attribute 'find'

config.ini contents (nothing changed since it last worked):
[Settings]
proxyaddress =
useproxy = False
useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
debughttp = False
userobots = True
filenameformat = %member_token% (%member_id%)%image_id% - %title%
filenamemangaformat = %member_token% (%member_id%)%image_id%.%page_index% - %title%
timeout = 60
uselist = False
processfromdb = True
overwrite = False
tagsseparator = ,
daylastupdated = 7
rootdirectory = S:\Downloads\Pixiv Downloader
retry = 3
retrywait = 5
createdownloadlists = False
downloadlistdirectory = .
irfanviewpath = C:\Program Files\IrfanView
startirfanview = False
startirfanslide = False
alwayscheckfilesize = False
checkupdatedlimit = 0
downloadavatar = False
createmangadir = False
usetagsasdir = False
useblacklisttags = False
usesuppresstags = False
tagslimit = -1
writeimageinfo = False

[Pixiv]
numberofpage = 0
r18mode = False

[Authentication]
username = ---
password = ---
cookie = ---
usessl = False

Any help would be appreciated.

Unable to download manga since 09/25/14

Due to maybe some changes in Pixiv's code mangas, and only mangas (single pictures and ugoiras still work fine), cannot be downloaded anymore.

Here’s an extract from the log of a session where I tried to download a 3-page manga, after some retries it ends skipping the pages one by one.

2014-09-25 15:41:30,926 – PixivUtil20140712 – INFO – ###############################################################
2014-09-25 15:41:30,926 – PixivUtil20140712 – INFO – Starting…
2014-09-25 15:41:30,931 – PixivUtil20140712 – INFO – Setting log level to: DEBUG
2014-09-25 15:41:30,933 – PixivUtil20140712 – INFO – No default cookie jar available, creating…
2014-09-25 15:41:30,937 – PixivUtil20140712 – INFO – Only process member where day last updated >= 7
2014-09-25 15:41:30,937 – PixivUtil20140712 – INFO – Using Username: cpgendo
2014-09-25 15:41:30,938 – PixivUtil20140712 – INFO – logging in with saved cookie
2014-09-25 15:41:30,940 – PixivUtil20140712 – INFO – Trying to log with saved cookie
2014-09-25 15:41:34,384 – PixivUtil20140712 – INFO – Logged in using cookie
2014-09-25 15:41:35,707 – PixivUtil20140712 – INFO – Image id mode.
2014-09-25 15:41:42,953 – PixivUtil20140712 – DEBUG – Sanitized Filename: D:\Davide\pixivup\757127\757127 – 46132631_big_p0 – 9-23-2014.png
2014-09-25 15:41:42,960 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:41:46,967 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:41:50,974 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:41:54,986 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:41:54,989 – PixivUtil20140712 – ERROR – Giving up url: http://i2.pixiv.net/img30/img/yukinokeisuke/46132631_big_p0.png
2014-09-25 15:41:54,990 – PixivUtil20140712 – ERROR – Error when download_image(): http://i2.pixiv.net/img30/img/yukinokeisuke/46132631_big_p0.png
Traceback (most recent call last):
File “PixivUtil2.py”, line 724, in process_image
File “PixivUtil2.py”, line 215, in download_image
File “PixivUtil2.py”, line 215, in download_image
File “PixivUtil2.py”, line 215, in download_image
File “PixivUtil2.py”, line 86, in download_image
File “mechanize_mechanize.pyc”, line 199, in open_novisit
File “mechanize_mechanize.pyc”, line 230, in mech_open
File “mechanize_opener.pyc”, line 188, in open
File “mechanize_urllib2_fork.pyc”, line 1043, in do_request
URLError:
2014-09-25 15:41:54,990 – PixivUtil20140712 – DEBUG – Sanitized Filename: D:\Davide\pixivup\757127\757127 – 46132631_p0 – 9-23-2014.png
2014-09-25 15:41:54,999 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:41:59,019 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:42:03,025 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:42:07,032 – PixivUtil20140712 – ERROR – download_image()
2014-09-25 15:42:07,032 – PixivUtil20140712 – ERROR – Giving up url: http://i2.pixiv.net/img30/img/yukinokeisuke/46132631_p0.png
2014-09-25 15:42:07,033 – PixivUtil20140712 – ERROR – Error when download_image(): http://i2.pixiv.net/img30/img/yukinokeisuke/46132631_p0.png

if you place PixivUtil2.exe shorcut to win XP quick launch it gives erros

I made a shortcut to PixivUtil2.exe from start menu (recently used programs) and now if you launch it via it - it thinks its working directory is C:\Documents and Settings\Admin, and creates all images, logs and configs there not willing to even. works fine if you launch PixivUtil2.exe directly from its folder or using usual .lnk

I mean to here -> http://imageshack.us/photo/my-images/210/scrx.png/

[Feature] Error dump suppression

Requesting ability to arbitrary suppress dumps for errors.
Line in configuration file "supresserrordumps = " with positions True ( everything suppressed), False (nothing suppressed) or a string of error codes - 1001, 1002, 1004, 2004 and so on to fine-tune what is suppressed. Separator is either space ' ' or comma ','

Error at processImage() for non english folders

PixivDownloader2 version 20120704
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading config file... done.
Creating database... done.
Only process member where day last updated >= 7
Using Username: test56
logging in with saved cookie
Trying to log with saved cookie
Cookie already expired/invalid.
Log in using form.
done.
new cookie value: ad9248ee374adac1b63e855ce01f679f
Writing config file... done.
PixivDownloader2 version 20120704
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

Processing Image Id: 28628322
Title: Want some fun?
Tags : ???? ???? ??? ?????? ??
Mode : big
Image URL : http://i2.pixiv.net/img46/img/dantewontdie/28628322.jpg
Traceback (most recent call last):
File "PixivUtil2.py", line 649, in processImage
File "PixivHelper.pyc", line 49, in sanitizeFilename
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 32: ordinal
not in range(128)
Error at processImage(): (<type 'exceptions.UnicodeDecodeError'>, UnicodeDecodeE
rror('ascii', 'V:\Documents and Settings\Admin\xd0\xe0\xe1\xee\xf7\xe8\xe9
xf1\xf2\xee\xeb\DL Image Packs', 32, 33, 'ordinal not in range(128)'), <trace
back object at 0x016A67D8>)
Dumping html to: Error Medium Page for image 28628322.html
Cannot dump page for image_id: 28628322
Stuff happened, trying again after 2 second ( 1 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 28628322
Title: Want some fun?
Tags : ???? ???? ??? ?????? ??
Mode : big
Image URL : http://i2.pixiv.net/img46/img/dantewontdie/28628322.jpg
Traceback (most recent call last):
File "PixivUtil2.py", line 649, in processImage
File "PixivHelper.pyc", line 49, in sanitizeFilename
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 32: ordinal
not in range(128)
Error at processImage(): (<type 'exceptions.UnicodeDecodeError'>, UnicodeDecodeE
rror('ascii', 'V:\Documents and Settings\Admin\xd0\xe0\xe1\xee\xf7\xe8\xe9
xf1\xf2\xee\xeb\DL Image Packs', 32, 33, 'ordinal not in range(128)'), <trace
back object at 0x01787198>)
Dumping html to: Error Medium Page for image 28628322.html
Cannot dump page for image_id: 28628322
Stuff happened, trying again after 2 second ( 2 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 28628322
Title: Want some fun?
Tags : ???? ???? ??? ?????? ??
Mode : big
Image URL : http://i2.pixiv.net/img46/img/dantewontdie/28628322.jpg
Traceback (most recent call last):
File "PixivUtil2.py", line 649, in processImage
File "PixivHelper.pyc", line 49, in sanitizeFilename
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 32: ordinal
not in range(128)
Error at processImage(): (<type 'exceptions.UnicodeDecodeError'>, UnicodeDecodeE
rror('ascii', 'V:\Documents and Settings\Admin\xd0\xe0\xe1\xee\xf7\xe8\xe9
xf1\xf2\xee\xeb\DL Image Packs', 32, 33, 'ordinal not in range(128)'), <trace
back object at 0x016BDA58>)
Dumping html to: Error Medium Page for image 28628322.html
Cannot dump page for image_id: 28628322
Stuff happened, trying again after 2 second ( 3 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 28628322
Title: Want some fun?
Tags : ???? ???? ??? ?????? ??
Mode : big
Image URL : http://i2.pixiv.net/img46/img/dantewontdie/28628322.jpg
Traceback (most recent call last):
File "PixivUtil2.py", line 649, in processImage
File "PixivHelper.pyc", line 49, in sanitizeFilename
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 32: ordinal
not in range(128)
Error at processImage(): (<type 'exceptions.UnicodeDecodeError'>, UnicodeDecodeE
rror('ascii', 'V:\Documents and Settings\Admin\xd0\xe0\xe1\xee\xf7\xe8\xe9
xf1\xf2\xee\xeb\DL Image Packs', 32, 33, 'ordinal not in range(128)'), <trace
back object at 0x01904788>)
Dumping html to: Error Medium Page for image 28628322.html
Cannot dump page for image_id: 28628322
Stuff happened, trying again after 2 second ( 4 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 28628322
Title: Want some fun?
Tags : ???? ???? ??? ?????? ??
Mode : big
Image URL : http://i2.pixiv.net/img46/img/dantewontdie/28628322.jpg
Traceback (most recent call last):
File "PixivUtil2.py", line 649, in processImage
File "PixivHelper.pyc", line 49, in sanitizeFilename
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 32: ordinal
not in range(128)
Error at processImage(): (<type 'exceptions.UnicodeDecodeError'>, UnicodeDecodeE
rror('ascii', 'V:\Documents and Settings\Admin\xd0\xe0\xe1\xee\xf7\xe8\xe9
xf1\xf2\xee\xeb\DL Image Packs', 32, 33, 'ordinal not in range(128)'), <trace
back object at 0x019081C0>)
Dumping html to: Error Medium Page for image 28628322.html
Cannot dump page for image_id: 28628322
Giving up image_id: 28628322
PixivDownloader2 version 20120704
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id
Download by image_id
Download by tags
Download from list
Download from online user bookmark
Download from online image bookmark
Download from tags list
Download new illust from bookmark
Download by Title/Caption

10. Download by Tag and Member Id

d. Manage database
e. Export online bookmark
x. Exit
Input:

filenames for manga (_big_)

Tried downloading by user id, manga pages were named like 27842092_big_p0.jpg but they were same as 27842092_p0.jpg , so maybe if big and usual image are the same, it could name files without big ?

Add ability to move files and detect moved files

At the moment, if you move files in the database (move your folder somewhere else) and change the storage path in your config, the script assumes everything is deleted.

It'd be useful to have the script detect a change in the storage path from the config file and scan the new directory for the old files. Or have a command under the database section where you can change the path and have the script move everything.

Suggested feature: command to interrupt operations only on the image or manga currently in download

Normally, if you want to interrupt the downloader without a forced closure, you have to press CTRL+C, so that any operation on the current member_id is terminated (when you are downloading from a list, it skips to the next member_id)

The idea would be for another keyboard command applied to image_id instead of member_id. By pressing it, operation (be it download or checking) on the current image or manga would be terminated and the program would skip to the next image_id.

Attribute Error: 'NoneType' object has no attribute 'ul'

http://i.imgur.com/oD5ugXk.jpg
20140325

HTML error dump:
http://a.pomf.se/trlfvz.html

Firewall was cleared, etc. I redid the cookie config.ini, same result.

2014-10-24 12:19:43,779 - PixivUtil20140325 - INFO - ###############################################################
2014-10-24 12:19:43,779 - PixivUtil20140325 - INFO - Starting...
2014-10-24 12:19:43,785 - PixivUtil20140325 - INFO - Setting log level to: DEBUG
2014-10-24 12:19:43,786 - PixivUtil20140325 - INFO - No default cookie jar available, creating...
2014-10-24 12:19:43,792 - PixivUtil20140325 - INFO - Only process member where day last updated >= 7
2014-10-24 12:19:43,793 - PixivUtil20140325 - INFO - Using Username: conquistadork
2014-10-24 12:19:43,795 - PixivUtil20140325 - INFO - logging in with saved cookie
2014-10-24 12:19:43,796 - PixivUtil20140325 - INFO - Trying to log with saved cookie
2014-10-24 12:19:45,996 - PixivUtil20140325 - INFO - Logged in using cookie
2014-10-24 12:19:48,657 - PixivUtil20140325 - INFO - Member id mode.
2014-10-24 12:19:57,851 - PixivUtil20140325 - INFO - Processing Member Id: 17040
2014-10-24 12:19:57,884 - PixivUtil20140325 - INFO - Member Url: http://www.pixiv.net/member_illust.php?id=17040&p=1
2014-10-24 12:20:00,312 - PixivUtil20140325 - ERROR - Error at process_member(): (<type 'exceptions.AttributeError'>, AttributeError("'NoneType' object has no attribute 'ul'",), <traceback object at 0x034CAAD0>)
2014-10-24 12:20:00,312 - PixivUtil20140325 - ERROR - Error at process_member(): 17040
Traceback (most recent call last):
File "PixivUtil2.py", line 420, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 122, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'
2014-10-24 12:20:00,667 - PixivUtil20140325 - ERROR - Dumping html to: Error page for member 17040.html
2014-10-24 12:20:00,671 - PixivUtil20140325 - ERROR - Unknown Error: 'NoneType' object has no attribute 'ul'
Traceback (most recent call last):
File "PixivUtil2.py", line 1833, in main
File "PixivUtil2.py", line 1630, in main_loop
File "PixivUtil2.py", line 1341, in menu_download_by_member_id
File "PixivUtil2.py", line 420, in process_member
File "PixivModel.pyc", line 46, in init
File "PixivModel.pyc", line 122, in ParseImages
AttributeError: 'NoneType' object has no attribute 'ul'

Issue when downloading from tags (option 3)

When downloading from tags, there is an issue where the program will suddenly close halfway through downloading or show an error. Below is an example of the error message that comes up, which results in having to close the program. This issue mainly appears when downloading from a tag with a large number of results, around >10 000, although it also has happened when downloading from tags with less results.

Image #76
Image Id: 36367640
Bookmark Count: 53
Skipping imageId=36367640 because less than bookmark count limit (500 > 53)
Looping... for http://www.pixiv.net/search.php?s_mode=s_tag_full&word=%E3%83%93%
E3%82%AD%E3%83%8B&p=170
Error at process_tags(): (<class 'urllib2.URLError'>, URLError(error(10054, 'An
existing connection was forcibly closed by the remote host'),), <traceback objec
t at 0x02FD66C0>)
Cannot dump page for search tags:ビキニ
Traceback (most recent call last):
File "PixivUtil2.py", line 1856, in main
File "PixivUtil2.py", line 1655, in main_loop
File "PixivUtil2.py", line 1423, in menu_download_by_tags
File "PixivUtil2.py", line 985, in process_tags
UnboundLocalError: local variable 'search_page' referenced before assignment
press enter to exit.

Update: I also got this message while downloading from another tag.

urlopen error [Errno 10054] An existing connection was forcibly closed by the remote host
1 2 3 4
Traceback (most recent call last):
File "PixivUtil2.py", line 718, in process_image
File "mechanize_mechanize.pyc", line 569, in follow_link
File "mechanize_mechanize.pyc", line 550, in click_link
File "mechanize_mechanize.pyc", line 443, in viewing_html
BrowserStateError: not viewing any document
Error at process_image(): (<class 'mechanize._mechanize.BrowserStateError'>, Bro
wserStateError('not viewing any document',), <traceback object at 0x03022828>)
Dumping html to: Error Medium Page for image 32445747.html
Error at process_tags(): (<class 'mechanize._mechanize.BrowserStateError'>, Brow
serStateError('not viewing any document',), <traceback object at 0x03022760>)
Dumping html to: Error page for search tags DOA.html
Traceback (most recent call last):
File "PixivUtil2.py", line 1856, in main
File "PixivUtil2.py", line 1655, in main_loop
File "PixivUtil2.py", line 1423, in menu_download_by_tags
File "PixivUtil2.py", line 944, in process_tags
File "PixivUtil2.py", line 718, in process_image
File "mechanize_mechanize.pyc", line 569, in follow_link
File "mechanize_mechanize.pyc", line 550, in click_link
File "mechanize_mechanize.pyc", line 443, in viewing_html
BrowserStateError: not viewing any document
press enter to exit.

Set useRobots = False but still 403?

I changed useRobots = False but am still getting the 403 error. Python 2.7.5 on OS X using the current modules after installing them. I changed time zones to avoid daylight savings time, copied the cookie, and set keepsignedin = 1. Am I doing something wrong or is something messed up somewhere else?

Log in using form.
Error at pixiv_login(): (<class 'mechanize._response.httperror_seek_wrapper'>, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x10745c120 whose wrapped object = <closeable_response at 0x107453170 whose fp = <cStringIO.StringI object at 0x107440360>>>, <traceback object at 0x107454cf8>)
failed
Traceback (most recent call last):
  File "pixivutil2.py", line 1805, in main
    result = pixiv_login(username, password)
  File "pixivutil2.py", line 260, in pixiv_login
    __br__.open(req)
  File "build/bdist.macosx-10.9-intel/egg/mechanize/_mechanize.py", line 203, in open
    return self._mech_open(url, data, timeout=timeout)
  File "build/bdist.macosx-10.9-intel/egg/mechanize/_mechanize.py", line 255, in _mech_open
    raise response
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
press enter to exit.

Replace root does not seems to work on huge sqlite db

I moved my collection to another path this week end.
When I try to replace the root path, a sqlite-journal is created and the cli exit it states (return to db menu), but the journal does not disapear and no change is done to the db (verified with sqlitebrowser).
I waited around one hour and nothing seems to happen.

The db is ~174MB.

bookmark download dose not recover from errors.

2014-08-31 22:14:02,578 - PixivUtil20140712 - INFO - Image ID (2456####): 2002 'Not in MyPick List, Need Permission!'
2014-08-31 22:14:02,584 - PixivUtil20140712 - ERROR - Error at process_image(): (<type 'exceptions.AttributeError'>, AttributeError("'NoneType' object has no attribute 'imageTitle'",), <traceback object at 0x037C7698>)
2014-08-31 22:14:02,584 - PixivUtil20140712 - ERROR - Error at process_image(): 2456####
Traceback (most recent call last):
File "PixivUtil2.py", line 644, in process_image
AttributeError: 'NoneType' object has no attribute 'imageTitle'
2014-08-31 22:14:02,585 - PixivUtil20140712 - ERROR - Error at process_image_bookmark(): (<type 'exceptions.AttributeError'>, AttributeError("'NoneType' object has no attribute 'imageTitle'",), <traceback object at 0x033A50A8>)
Traceback (most recent call last):
File "PixivUtil2.py", line 977, in process_image_bookmark
File "PixivUtil2.py", line 644, in process_image
AttributeError: 'NoneType' object has no attribute 'imageTitle'
2014-08-31 22:14:02,588 - PixivUtil20140712 - ERROR - Unknown Error: 'NoneType' object has no attribute 'imageTitle'
Traceback (most recent call last):
File "PixivUtil2.py", line 1801, in main
File "PixivUtil2.py", line 1607, in main_loop
File "PixivUtil2.py", line 1470, in menu_download_from_online_image_bookmark
File "PixivUtil2.py", line 977, in process_image_bookmark
File "PixivUtil2.py", line 644, in process_image
AttributeError: 'NoneType' object has no attribute 'imageTitle'
2014-08-31 22:18:06,513 - PixivUtil20140712 - INFO - EXIT

Cannot use "createdownloadlists = True"

Whenever I have createdownloadlists set to True (with downloadlistdirectory = . (but it occurs no matter what I have the directory set to)) errors occur when trying to add to/create the download lists. The images do actually download.

Start downloading... 620567 of 620567 Bytes Complete.
Traceback (most recent call last):
File "PixivUtil2.py", line 178, in downloadImage
File "codecs.pyc", line 881, in open
IOError: [Errno 2] No such file or directory: u'C:\Users\nokobon\Desktop\Pixiv Util 8-6-2012b\library.zip.\Downloaded_on_2012_08-26.txt
1 2 3 4

error when download from tag list when encountered an image with a blacklisted tag

got an error when download from tag list when encountered an image with a blacklisted tag

Image Id: xxxxxxxx
Bookmark Count: 11
Processing Image Id: xxxxxxxx
Skipping image_id: xxxxxxxx because contains blacklisted tags: 3D
Traceback (most recent call last):
File “PixivUtil2.py”, line 656, in processImage
UnboundLocalError: local variable ‘viewPage’ referenced before assignment
Error at processImage(): (, UnboundLocalErr
or(“local variable ‘viewPage’ referenced before assignment”,), )
Cannot dump page for image_id: 27377905
Error at processTags(): (, UnboundLocalErro
r(“local variable ‘mediumPage’ referenced before assignment”,), )
Error at processTagsList(): (, UnboundLocal
Error(“local variable ‘mediumPage’ referenced before assignment”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1372, in main
File “PixivUtil2.py”, line 1166, in menuDownloadFromTagsList
File “PixivUtil2.py”, line 779, in processTagsList
File “PixivUtil2.py”, line 743, in processTags
File “PixivUtil2.py”, line 668, in processImage
UnboundLocalError: local variable ‘mediumPage’ referenced before assignment
press enter to exit.

http://nandaka.wordpress.com/2012/05/19/pixiv-downloader-20120519/#comment-1796

Option 8 (download from bookmark) doesn't get anything

As of July 9th, option 8 doesn't work (it did last time I used it, about 24 hours earlier), but it's not the type of error that crashes the software. It just goes:

Processing new Illust from bookmark
Page #1
No Images!
Done.

The other functions I use regularly, 1 and 2, work as usual, so my only guess is that Pixiv may have changed something in the coding of the bookmark_new_illust.php page.

changing class in parseImageBookmark to "display_works linkStyleWorks display_editable_works" fixes issue with no ul being found.

On line 618 of PixivModel.py to be specific.

Request: Animated images "Ugoira" metadata support

http://www.pixiv.net/info.php?id=2476&lang=en

Currently PixivUtil2 downloads these as .zip files. However in doesn't save any extra data - namely, delays between frames. Thus, if some image submission gets removed, there is no way to recover that information anymore.

There can be several options for converting Ugoira to a viewable format:

gif. Rather bad option due to quality loss but the most compatible.
apng. 100% quality but supported only supported on some browsers and image viewers.
webm. Quality loss is expectable, but the resulting file would be rather small, supported by most browsers.

Of course, all these options would require some serious codework or relying on more prerequisites like ImageMagick or apngasm etc.

At the same time, there can be another (easier imo) option that would at least allow keeping extra info, to save it for later, when more options might emerge:

save the whole html page containing the image, so it can still be viewed directly in any browser, just like original.
(I think it should be same as "ugoira_view" page)

There is also a userscript to convert Ugoira into svg, but that requires extracting images from zip and relying on using svg-complaint browser. Even though it not many people would like that, saving original .html would give them an option to do that.

Script in question, if that helps:

// ==UserScript==
// @name        Ugoira backup
// @include     http://www.pixiv.net/member_illust.php*
// @grant       none
// @run-at      document-start
// ==/UserScript==

document.addEventListener('DOMContentLoaded', function(){

var frames = pixiv.context.ugokuIllustFullscreenData.frames,
    numFrames = frames.length,
    width = pixiv.context.illustSize[0],
    height = pixiv.context.illustSize[1];

var result = '';

for(var i=0; i<=numFrames-1; i++) {
    result += ''+
        ''+
        ''+
        '';
}
result +='';

$("._ugoku-illust-player-container").after(
    $("", {
        href : 'data:image/svg+xml,'+result,
        text: 'Get ugoira .svg ' ,
        target:'_blank'
    })
);

$("._ugoku-illust-player-container").after(' | ');

$("._ugoku-illust-player-container").after(
    $("", {
        href : pixiv.context.ugokuIllustFullscreenData.src,
        text: 'Get ugoira .zip '
    })
);

}, false);

Not logging in.

Hi, when I run pixivutil, it will not log in. It just stays there after saying "Log in using...".
I turned SSL on/off and also tried without cookies to see if it would generate a new one.

http://pastebin.com/njzz9jjK

can't download by id: ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'

My old pixivdownloader gave this error so I tried updating and new one has the very same problem - can't download when I tell it to by id, gives only errors:

PixivDownloader2 version 20140606
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading C:\Private\PixivDownloader\config.ini ...
done.
Creating database... done.
Only process member where day last updated >= 7
Using Username: test56
logging in with saved cookie
Trying to log with saved cookie
done.
PixivDownloader2 version 20140606
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id

Download by image_id

Download by tags

Download from list

Download from online user bookmark

Download from online image bookmark

Download from tags list

Download new illust from bookmark

Download by Title/Caption

Download by Tag and Member Id

Download Member Bookmark

12. Download by Group Id

d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input: 1
Member id: 1422579
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing Member Id: 1422579
Reading C:\Private\PixivDownloader\config.ini ...
done.
Page 1
Member Url: http://www.pixiv.net/member_illust.php?id=1422579&p=1
Member Name : Saru
Member Avatar: http://i1.pixiv.net/img43/profile/longbb/6295157.jpg
Member Token : longbb

1

Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x02ABFBE8>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 1 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x02DD53F0>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 2 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x030E6418>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 3 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x02A9B7D8>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 4 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x02A57738>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 5 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x02992878>)
Dumping html to: Error Medium Page for image 43863737.html
Stuff happened, trying again after 2 second ( 6 )
Traceback (most recent call last):
File "PixivUtil2.py", line 513, in process_member
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Processing Image Id: 43863737
Traceback (most recent call last):
File "PixivUtil2.py", line 617, in process_image
File "PixivModel.pyc", line 256, in init
File "PixivModel.pyc", line 349, in ParseWorksData
File "_strptime.pyc", line 325, in _strptime
ValueError: time data '6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'
Error at process_image(): (<type 'exceptions.ValueError'>, ValueError("time data
'6 3 2014, 00:01' does not match format '%Y-%m-%d %H:%M'",), <traceback object
at 0x035946C0>)
Dumping html to: Error Medium Page for image 43863737.html
Giving up image_id: 43863737
PixivDownloader2 version 20140606
https://nandaka.wordpress.com/tag/pixiv-downloader/

Download by member_id

Download by image_id

Download by tags

Download from list

Download from online user bookmark

Download from online image bookmark

Download from tags list

Download new illust from bookmark

Download by Title/Caption

Download by Tag and Member Id

Download Member Bookmark

12. Download by Group Id

d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input:

Error: [Errno 28] No space left on device

Now if there is no space left on drive it just throws random errors and continue making those, it would be very nice that if program finds out that there is no space left it would pause itself, notify the user that it did so and make a prompt line saying "no space left on drive, clean up some space and press ENTER to continue" (and last failed due to space problem image would be tried to redownloaded.

Page 4
Member Name : yamasan
Member Avatar: http://i1.pixiv.net/img19/profile/yamamasa/2814862.png
Member Token : yamamasa
#61

Processing Image Id: 18558854
Title: ???????????
Tags : ???? ??????????????????? ??????????? ??????? ??? ?????? ????????????? ???
??? ??????? ???????????
Mode : big
Image URL : http://i1.pixiv.net/img19/img/yamamasa/18558854.png
Filename : C:\DL Image Packs\346855 (yamamasa)\18558854.png
Start downloading... 722763 of 722763 Bytes Complete.
done.
#62

Processing Image Id: 18361849
Title: ???????
Tags : ???? ???????????? ??????????????????? ????? ????????????? ????? ?????? ??
???? ???????????? ?????
Mode : big
Image URL : http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Filename : C:\DL Image Packs\346855 (yamamasa)\18361849.png
Start downloading... 151552 of 1194460 Bytes Downloaded file incomplete!
151552 of 1194460 Bytes
Filename = C:\DL Image Packs\346855 (yamamasa)\18361849.png
URL = http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Traceback (most recent call last):
File "PixivUtil2.py", line 164, in downloadImage
IOError: [Errno 28] No space left on device
1 2 3 4
Found file with different filesize, removing...
Start downloading... 184320 of 1194460 Bytes Downloaded file incomplete!
184320 of 1194460 Bytes
Filename = C:\DL Image Packs\346855 (yamamasa)\18361849.png
URL = http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Traceback (most recent call last):
File "PixivUtil2.py", line 164, in downloadImage
IOError: [Errno 28] No space left on device
1 2 3 4
Found file with different filesize, removing...
Start downloading... 53248 of 1194460 Bytes Downloaded file incomplete!
53248 of 1194460 Bytes
Filename = C:\DL Image Packs\346855 (yamamasa)\18361849.png
URL = http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Traceback (most recent call last):
File "PixivUtil2.py", line 164, in downloadImage
IOError: [Errno 28] No space left on device
1 2 3 4
Found file with different filesize, removing...
Start downloading... 270336 of 1194460 Bytes Downloaded file incomplete!
270336 of 1194460 Bytes
Filename = C:\DL Image Packs\346855 (yamamasa)\18361849.png
URL = http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Traceback (most recent call last):
File "PixivUtil2.py", line 164, in downloadImage
IOError: [Errno 28] No space left on device
Traceback (most recent call last):
File "PixivUtil2.py", line 672, in processImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 223, in downloadImage
File "PixivUtil2.py", line 164, in downloadImage
IOError: [Errno 28] No space left on device
Error at processImage(): (<type 'exceptions.IOError'>, IOError(28, 'No space lef
t on device'), <traceback object at 0x00FD0F58>)
Dumping html to: Error Medium Page for image 18361849.html
Cannot dump page for image_id: 18361849
Stuff happened, trying again after 2 second ( 1 )
local variable 'parseBigImage' referenced before assignment
Processing Image Id: 18361849
Title: ???????
Tags : ???? ???????????? ??????????????????? ????? ????????????? ????? ?????? ??
???? ???????????? ?????
Mode : big
Image URL : http://i1.pixiv.net/img19/img/yamamasa/18361849.png?1303610439
Filename : C:\DL Image Packs\346855 (yamamasa)\18361849.png
Found file with different filesize, removing...
Start downloading... 65536 of 1194460 Bytes

[Feature] Counter in titlebar

When downloading from list the titlebar of the program is updated with the MemberID being downloaded and the Page nr. Can’t you include a counter as well, so we can quickly know how far we are in the list? Something in the lines of MemberId: 1234 Page: 5 Order: 9 of 17.

[Feature] Download images by Group

Reference:
http://www.pixiv.net/group/images.php?id=881&max_id=0
http://www.pixiv.net/group/images.php?format=json&max_id=0&id=881
http://www.pixiv.net/group/images.php?format=json&max_id=615396&id=881

Note: URL NSFW

UseTagAsDir generate wrong directory

I downloaded files with %tag1%, then later switched to %tag2%. I’m using ‘usetagsasdir’ so I expected something like /root/%searchtag%/. It worked fine with the first batch, but the second batch resulted in /root/%tag1%/%tag2%/

need to check processTags

Manga Mode downloading mobile site images following site redesign.

Following a recent redesign of Pixiv's manga sub-pages, the utility has been attempting to download images from the mobile site as well as the normal 'big' image. It returns a 404 when it looks for the 'big' image on the mobile site, and downloads the 128x128 preview image instead.

It appears that the new design is hosting the mobile images in a way that causes the utility to register them as normal images. When downloading a two-image submission, it registers four images on the page.
#4

Processing Image Id: 35718646
Title: ??????????????????
Tags : ?????????? ???????????? ?????? ??
Mode : manga
Page Count : 4
Image URL : http://i1.pixiv.net/img05/img/hitman/35718646_big_p0.jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_big_p0.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
Start downloading... 1332421 of 1332421 Bytes Complete.
done.

Image URL : http://i1.pixiv.net/img05/img/hitman/mobile/35718646_128x128_big_p0.
jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_128x128_big_p0.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
[downloadImage()] HTTP Error 404: Not Found (http://i1.pixiv.net/img05/img/hitma
n/mobile/35718646_128x128_big_p0.jpg)
No big manga image available, try the small one

Image URL : http://i1.pixiv.net/img05/img/hitman/mobile/35718646_128x128_p0.jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_128x128_p0.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
Start downloading... 14602 of 14602 Bytes Complete.
done.

Image URL : http://i1.pixiv.net/img05/img/hitman/35718646_big_p1.jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_big_p1.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
Start downloading... 161704 of 161704 Bytes Complete.
done.

Image URL : http://i1.pixiv.net/img05/img/hitman/mobile/35718646_128x128_big_p1.
jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_128x128_big_p1.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
[downloadImage()] HTTP Error 404: Not Found (http://i1.pixiv.net/img05/img/hitma
n/mobile/35718646_128x128_big_p1.jpg)
No big manga image available, try the small one

Image URL : http://i1.pixiv.net/img05/img/hitman/mobile/35718646_128x128_p1.jpg
Filename : K:\Download Pile\Pixiv\Test\35718646_128x128_p1.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=manga&illust_id=35718
646
Start downloading... 7727 of 7727 Bytes Complete.
done.

Have a problem in Download from list (list.txt)

in win8 64 cmd

PixivDownloader2 version 20140325
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading I:\pixivutil\config.ini ...
done.
Creating database... done.
Only process member where day last updated >= 7
Using Username: aixinggecheng
logging in with saved cookie
Trying to log with saved cookie
done.
PixivDownloader2 version 20140325
https://nandaka.wordpress.com/tag/pixiv-downloader/
1. Download by member_id
2. Download by image_id
3. Download by tags
4. Download from list
5. Download from online user bookmark
6. Download from online image bookmark
7. Download from tags list
8. Download new illust from bookmark
9. Download by Title/Caption
10. Download by Tag and Member Id
11. Download Member Bookmark
12. Download by Group Id
------------------------
d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input: 4
Processing from database.
Select only last 7 days.
Found 0 items.
PixivDownloader2 version 20140325
https://nandaka.wordpress.com/tag/pixiv-downloader/
1. Download by member_id
2. Download by image_id
3. Download by tags
4. Download from list
5. Download from online user bookmark
6. Download from online image bookmark
7. Download from tags list
8. Download new illust from bookmark
9. Download by Title/Caption
10. Download by Tag and Member Id
11. Download Member Bookmark
12. Download by Group Id
------------------------
d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit
Input:4 I:\pixivutil\list.txt
PixivDownloader2 version 20140325
https://nandaka.wordpress.com/tag/pixiv-downloader/
1. Download by member_id
2. Download by image_id
3. Download by tags
4. Download from list
5. Download from online user bookmark
6. Download from online image bookmark
7. Download from tags list
8. Download new illust from bookmark
9. Download by Title/Caption
10. Download by Tag and Member Id
11. Download Member Bookmark
12. Download by Group Id
------------------------
d. Manage database
e. Export online bookmark
r. Reload config.ini
p. Print config.ini
x. Exit

I get it;

log

2014-04-06 02:18:54,934 - PixivUtil20140325 - INFO - Starting...
2014-04-06 02:18:54,937 - PixivUtil20140325 - INFO - Setting log level to: DEBUG
2014-04-06 02:18:54,938 - PixivUtil20140325 - INFO - No default cookie jar available, creating... 
2014-04-06 02:18:54,944 - PixivUtil20140325 - INFO - Only process member where day last updated >= 7
2014-04-06 02:18:54,944 - PixivUtil20140325 - INFO - Using Username: aixinggecheng
2014-04-06 02:18:54,944 - PixivUtil20140325 - INFO - logging in with saved cookie
2014-04-06 02:18:54,944 - PixivUtil20140325 - INFO - Trying to log with saved cookie
2014-04-06 02:18:58,305 - PixivUtil20140325 - INFO - Logged in using cookie
2014-04-06 02:19:04,210 - PixivUtil20140325 - INFO - Export Bookmark mode.

What should I do ?

I use the exe get list.txt
Iike this

Export date: 2014-04-06 02:19:18.592000

171007
806502
2704736
2789630
1043550
3030723
2539243
393713
5770091
68864

END-OF-FILE

but when i use it,it don`t work
and i test change list
like this
1721007
1721007 .\test
it don't work too;

nandaka / pixivutil2 Goto Github PK

pixivutil2's People

Contributors

Stargazers

Watchers

Forkers

pixivutil2's Issues

10. Download by Tag and Member Id

10. Download by Tag and Member Id

10. Download by Tag and Member Id

12. Download by Group Id

10. Download by Tag and Member Id

(snip)

(snip)

(snip)

10. Download by Tag and Member Id

12. Download by Group Id

10. Download by Tag and Member Id

10. Download by Tag and Member Id

12. Download by Group Id

1

12. Download by Group Id

Export date: 2014-04-06 02:19:18.592000

END-OF-FILE

Recommend Projects

Recommend Topics

Recommend Org