awegnergithub / smokedetector Goto Github PK

Will be a one time script to sync the current lists with Helios

The HeliosParser.remove() and HeliosParser.exists() methods need to be created

[10:44:33] requests.exceptions.ConnectionError: HTTPSConnectionPool(host='yy9bl73174.execute-api.us-east-2.amazonaws.com', port=443): Max retries exceeded with url: /production/blackl
ists/blacklist-keyword (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fec388978d0>: Failed to establish a new connection: [Errno -3] Temporary
failure in name resolution',))
2018-01-07 16:44:33.079990 UTC

Exception didn't actually cause a restart. It just hung.

Remove old, unused parsers

Remove old .txt files and ensure they are ignored correctly

Clean up logic around pulling blacklists/pulling in general

Local file writes need to occur on .add() and .remove() if either fails.

Add a command to flush local files to Helios

Check for existing local files on start up. If exist, merge into local memory. If helios key exists, attempt to write records to Helios and remove local file.

Helios has been updated to use num_items in #1. Smokey needs to use the correct key

Need to add commands for

• unblacklist-keyword
• unblacklist-website
• unblacklist-username
• unwatch