UTF-8 file names decoding/encoding issue about commonsdownloader HOT 4 OPEN

Quick answer on one point:

With @symac's patched CommonsDownloader version of October 1st (see mail discussions)

@symac edits were merged in #5 and #6

from commonsdownloader.

file names on the filesystem are not properly encoded : two bytes UTF-8 chars (like é), that are properly encoded in the file list (Abbaye Saint-Pierre de Marcilhac-sur-Célé - Eglise.JPG,99999, get translated to two one byte chars, like in Abbaye_Saint-Pierre_de_Marcilhac-sur-Célé_-_Eglise

Can’t reproduce with Python 2.7.3 under Ubuntu 12.04 Needs further investigation for Windows

from commonsdownloader.

On the console, output is misencoded too, but not in the same way : Downloading Abbaye_Saint-Pierre_de_Marcilhac-sur-C├®l├®_-_Eglise.JPG

Can’t reproduce either. Would not that rather be an issue with your Terminal which does not properly support Unicode @edouardhue ?

from commonsdownloader.

Garbage on the console is probably a terminal issue: it is the same with [http://github.com/edouardhue/commons-downloader]. But I don't have any issue with file names in the filesystem.

from commonsdownloader.