It's a good opportunity to perform a benchmark, so those measures can be used when we apply cache or dedicate efforts in improve the performance of the tool

Overview

The current logic takes the two last words of the host as if it was the second level domain and the top level domain.

But this cause problems if the top level domain includes more than one word, for example, if the site was www.google.co.uk we would get only .co.uk, and we couldn't compare it with our blacklisted sites.

We need to found a better way to extract this information properly that fit better with all the types of domains that could exists.

Extra details

Some domains I found are:

.co.uk
.com.au
.co.nz
.com.br

There is also a problem with those websites that creates spaces as subdomains, in that cases the subdomain could be important, for example: "blogspot"

nsfwsite.blogspot.com

References

• Top level domain lists

Would you consider creating a Docker container for your tool?

Salam , heliomar
I have been searching for maybe 6 months and tried to devlop my own solution after this long period of searching (I'm not very good in programing but can do somethings) , But I'm very happy that you working on this because I'm also working on the same.
Maybe some PRs from me will be here soon.

Thanks a lot , Best wishes.