Documentation and a couple questions about pegparser HOT 1 OPEN

Hey, thanks for raising the issue (somehow I'm only seeing this now). I definitely agree that this project (which was one of my first) needs way better documentation. Unfortunately I'm currently very short on time for open-source projects, so I need to prioritise projects with more active users.

As for unicode support, I'm pretty sure this library only supports parsing one byte at I time, so if you need unicode you would have to add your own support as a specialised character parser. For UTF-8 encoded strings I think for many use-cases unicode will implicitly work anyways, but I there are probably a bunch of edge-cases that I'm not considering atm.

Whitespaces (or any other separator symbols) can be set as valid tokens that can be parsed between any two rules (essentially transforming the grammar). This still needs to be set explicitly by calling g.setSeparator(<rule>) on the grammar object, where <rule> would define a parser rule for whitespace characters, e.g. g["Whitespace"] << "[\t ]".

Hope this is still somehow relevant to you or whoever stumbles upon it. Good luck with your compiler!

from pegparser.