hackla-engage / engage-scraper Goto Github PK

Currently the summary is being scraped correctly, but the recommended actions are not. We need to move the recommended action scraping to the format that the summary uses.

Spacing is an issue in both body and recommendation scraping. This stems from the heavy use of random unicode spacing characters, spans with no spacing but width, multiple spans in a single word. Currently we strip unicode to produce ASCII, but there may be a better way. We are left with results like:

computer system s ha ve become operationally

and

Authorize the City Man ager to negotiate a nd

or

$452,75 0(in clud esa contingency);

Each time we successfully scrape new agenda content and post to the feed, we should post a new tweet to the Engage Santa Monica twitter account: @EngageStaMonica

Tweet language should equal:

Agenda Items for the next @santamonicacity City Council meeting is open for public feedback until 11:59am [Month | Date]. Head to http://sm.engage.town now to voice your opinion!

Month | Date text should be formatted like e.g. "Feb 26th".