Let people download this material en masse.

• increment through URLs
• save the output as files
• see if the server provides etags, to avoid reharvesting material
• store hashes of each file in a hash table
• extract the name and the filing date from each, store as metadata

• set up a Docker container for Elasticsearch
• expose that Docker container to HTTP
• script the identification of all changed documents
• have Elasticsearch index the delta

• allow searching
• provide bulk downloads

Given #9, there's no sense in updating this too often. Only update it when there's a 404. But not every time. Maybe mod 10?

There is good reason to believe that this is bringing down the legislature's server. Keep it from running until they indicate that is fixed.

This is an improbable goal, given the source material, but convert filings to machine-readable data, and provide that via an API and as bulk downloads.

• determine the frequency of updates to the website
• set up a cron job to re-scrape the data at that frequency