Current Py3.x unicode normalizer is flawed about facebook-page-post-scraper HOT 2 OPEN

@rougetimelord , this worked for me:

1. remove the ".encoding('utf-8')" from the code
2. change writing mode to 'w' and add the encoding in the scrapeFacebookPageFeedStatus funtion:

def scrapeFacebookPageFeedStatus(page_id, access_token):
    with open('data/%s_facebook_statuses.csv' % page_id, 'w', newline='', encoding='utf-8') as file:
        w = csv.writer(file)

from facebook-page-post-scraper.

We just ran into this, with the escaped utf-8 being written to our CSV output. We fixed it in Python 2 with the following:

bytes(line).decode('unicode-escape').encode('latin1').decode('utf-8')

from facebook-page-post-scraper.