Umlauts and Regular Expressions about organize HOT 7 CLOSED

Thank you for the minimal reproducer! I found the issue - the strings are both unicode but are composed differently:

>>> s1 = 'Erträgnisaufstellung'  # copied from config.yaml
>>> s2 = 'Erträgnisaufstellung'  # copied from filename
>>> s1.encode('utf-8')
b'Ertr\xc3\xa4gnisaufstellung'
>>> s2.encode('utf-8')
b'Ertra\xcc\x88gnisaufstellung'

To be honest, this sent me down a rabbit hole. It seems like the HFS+ filesystem saves filenames in UTF-8 in NFD (decomposed) form and in your config you wrote the NFC (precomposed) form.
The form on NFS filesystems is not specified and filenames on samba shares and in linux seem to be in NFC. APFS does not enforce a normalization as far as I know.

I guess using the NFKD form internally for all comparisons would behave like expected for most use cases. This means rolling my own unicode-normalized glob implementation and normalizing the config before parsing. This is now on my todo-list but might take a while because it needs to be tested on different platforms. I'm really wondering why python doesn't simplify these things for you :/

from organize.

Hi, thank you for the detailed report. Unfortunately I'm not able to reproduce this - it works for me on both windows 10 and macOS :/

• Can you check whether your config.yaml is UTF-8 encoded? Or even better send the original file via email (address is in my profile)
• Can you try retyping the filename by hand and check again? UTF-8 has some identical looking, confusable characters, maybe your ä is really an 𝚊̈ (https://unicode.org/cldr/utility/confusables.jsp?a=ä&r=None)

from organize.

I think the encoding of the config file is correct and I tried both versions of the confusables again, but with no luck. I will send you an email with an example file and config.

from organize.

In the meantime you can copy your filename into your config file and everything should work 👌

from organize.

Hi Thomas, sorry for the ultra late reply!

This is indeed a rabbit hole! Never heard of the confusables before, but it is good to know. I remember that I tried to copy the filename, but that did not work either.

As I tested it now it works though. I guess this has sth. to do with these confusables. The original 'ä' in the PDF from my bank was probably a different one than the 'ä' I type on my Mac and after fiddling around with renaming and adjusting the config a couple of times, the original 'ä' probably disappeared.

Thanks for clearing that up and thanks for providing organize!

from organize.

Hey thank you so much for the kind words and for the donation! It's very much appreciated!

from organize.

This is now fixed and will be available in the next version 👍

from organize.