Consider alternative methods of determining whether an entity has been updated about python-legistar-scraper HOT 5 CLOSED

I don't think there are, but I had a potentially useful idea for a windowed scrape (at least for events).

Right now, we attempt the widowed scrapes attempt to find all events that have been updated after the beginning of the window.

It would probably be helpful if we also scraped events that are scheduled to occur after the beginning of the window.

These recent and upcoming events are the ones most likely to change.

An increased false positive rate seems worth it if this helps us really reduce the false negatives.

from python-legistar-scraper.

@fgregg That's really smart!

from python-legistar-scraper.

Could do something similar with bills by using

MatterAgendaDate
MatterIntroducitonDate

and the other date field on matters.

from python-legistar-scraper.

let me know if you'd like to see a PR

from python-legistar-scraper.

@fgregg We have the go-ahead from Metro to prioritize this for May. I'd love to review a PR at your convenience.

from python-legistar-scraper.