Comments (3)
This library is compatible only with Google Safe Browsing API data source.
URLs are transformed into hashes and hash prefixes as described in this spec:
https://developers.google.com/safe-browsing/v4/urls-hashing
Conceptually it is possible to add support for other URL blacklist providers, but it would require a major overhaul. In fact it would be easier to make a separate library for other feeds as they list URLs in clear text while Google provides only irreversible hashes which require extra transformations and lookups.
from gglsbl.
My intention would be to generate the same sort of hashes that Google does, and then add those to the database. I'm not looking to add support for other feed providers to the library itself, but rather to add some helper functionality for generating the same hash format as Google does, and for associating those hashes with threat lists.
from gglsbl.
Gotcha. You can use this class to translate URL to hash: https://github.com/afilipovich/gglsbl/blob/master/gglsbl/protocol.py#L168
from gglsbl.
Related Issues (20)
- Specify version of google-api-python-client in setup.py HOT 5
- Site not detected HOT 2
- Error in storage.py:cleanup_full_hashes() HOT 1
- Cant update DB process is Killed prematurely HOT 6
- GSB not returning correct results HOT 9
- HTTP Error 413: Request Entity Too Large HOT 3
- fair_use_delay infinite sleep HOT 1
- client behind proxy, option to specify proxy details? HOT 2
- Unable to open the database file HOT 24
- How to remove the process of verify in Google server? HOT 2
- SafeBrowsingListTestCase FAIL HOT 3
- 500 hash limit per API request to /v4/fullHashes:find HOT 2
- Quota exceeded when using gglsbl-rest HOT 1
- Web Risk API HOT 4
- minimumWaitDuration should be separated for for get_threats_update and get_full_hashes HOT 1
- SafeBrowsingListTestCase Wrong HOT 3
- GSB cannot detect the phish url HOT 1
- Question on GSB removal
- sqlite3.IntegrityError: UNIQUE constraint failed
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gglsbl.