until date issue about facebook-page-post-scraper HOT 9 OPEN

@iamrajeshchauhan
What is happening is that the re.search command in line 187, i.e.

until = re.search('until=([0-9]?)(&|$)', next_url).group(1)

is returning no results.

And since there are no results produced, the return type of the re.search() command will be NoneType and NoneType has no attribute called group in it.

Hope it helps! :)

from facebook-page-post-scraper.

Huh, I tested this workflow and didn't see an error. A possible cause is that if there isn't a next_url.

A workaround may be to only set until if no defined until exists.

from facebook-page-post-scraper.

@gabru-md
So while running code what should I do?

from facebook-page-post-scraper.

what page are you trying to scrape?

from facebook-page-post-scraper.

it's not fixed, so in the code what changes are we require to solve the error. You can take any page example for scrapping.

from facebook-page-post-scraper.

great ! thanks, @minimaxir Is that possible can we scrap the data(comments, reply, likes, etc) from Facebook where the post was live video?

from facebook-page-post-scraper.

@minimaxir Hi, I am getting the same error. I gave since_date = "2017-01-01" # ( 1st Jan 2017 )
until_date = "2017-07-02" # ( 2nd July 2017) . The error comes just after 100 records (1st July 2017 back to 8th Feb 2017) are written on the .cv file. Post are available in the page for Jan 2017 also.

from facebook-page-post-scraper.

Hi @minimaxir I am experiencing the same issue. I only get the first 100 records. Thereafter I get the same error. I know there are many more. I tried different dates, always get 100 records only. I am not sure how to implement your suggestion from June 20th, above. Any suggestions, please?

from facebook-page-post-scraper.

Hi @tiborko ,

I think if you can use below script for scrapping that would be great.

https://github.com/minimaxir/facebook-page-post-scraper/blob/master/get_fb_posts_fb_page.py

Thanks !

from facebook-page-post-scraper.