Feature Request: Blacklists about wikijs-sitemap HOT 6 OPEN

I will create time to work on this.
PRs are welcomed too.

from wikijs-sitemap.

What do you think of tag-based exclusion? I suggest implementing an environment variable that specifies tags for exclusion.

For instance, if you want to exclude pages marked as private or secret, you would set EXCLUDED_TAGS=private, secret in the environment variable.
Then, simply tag any new pages you don't want indexed with private or secret to automatically exclude them from the sitemap.

This method seems more clearer and easier to manage compared to editing paths, as it eliminates the need to update the environment variable each time you create new pages.

from wikijs-sitemap.

Usually it's not single pages that are set to private but paths. I'd much rather see an environment variable (list) where the user can set paths that should not be included in the sitemap.xml.

from wikijs-sitemap.

If we have EXCLUDED_PATHS=/path/to/marketing, should it exclude all pages down the path?
For example /path/to/marketing/sales/schedule is excluded too because it is under marketing.

from wikijs-sitemap.

If you'd ask me I'd say yes, block everything below a given path, except when there are whitelists that allow it (override). Like it is handled in robots.txt.

from wikijs-sitemap.

I will work on the EXCLUDED_PATHS option soon. Thank you for your input.

from wikijs-sitemap.