scrapehero-code / amazon-review-scraper Goto Github PK

Hi, first of all thank you for the code!

I am however having the problem that when scraping multiple pages of reviews for the same product, only the first page gets scraped. The other pages get "scraped" too and show up in the data, but the actual reviews extracted from them are the ones from the first page.

Does anyone know how to fix this?

Thank you!

Traceback (most recent call last): File "reviews.py", line 50, in <module> if 'Verified Purchase' in r['verified']: TypeError: argument of type 'NoneType' is not iterable

Now, Amazon can find buyers to request reviews because it is too much trouble. How to use scripts to automatically request buyer reviews thx.

I installed all the requirements and ran the code for testing without changing the urls or anything and got the following error:

Downloading https://www.amazon.com/Nike-Womens-Reax-Running-Shoes/product-reviews/B07ZPL752N/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews
Traceback (most recent call last):
File "C:/Users/amazon-review-scraper-master/reviews.py", line 46, in
for r in data['reviews']:
TypeError: 'NoneType' object is not iterable

Could you tell me where the code might need to be changed or what I should do?

Hi there, thank you for the code. It is really helpful.

but I would like to ask which part of the code should be updated to scrap multiple pages. It only scraps the first page even though I put multiple pages in 'urls.txt'. Is there any easy fix solution for the issue?

for example, when I put five different urls like below, it only read the first one and kept repeating the same result for five times.

https://www.amazon.com/2030-Biggest-Collide-Reshape-Everything/product-reviews/1250268176/ref=cm_cr_arp_d_paging_btm_next_2?ie=UTF8&reviewerType=all_reviews&pageNumber=1
https://www.amazon.com/2030-Biggest-Collide-Reshape-Everything/product-reviews/1250268176/ref=cm_cr_arp_d_paging_btm_next_2?ie=UTF8&reviewerType=all_reviews&pageNumber=2
https://www.amazon.com/2030-Biggest-Collide-Reshape-Everything/product-reviews/1250268176/ref=cm_cr_arp_d_paging_btm_next_2?ie=UTF8&reviewerType=all_reviews&pageNumber=3
https://www.amazon.com/2030-Biggest-Collide-Reshape-Everything/product-reviews/1250268176/ref=cm_cr_arp_d_paging_btm_next_2?ie=UTF8&reviewerType=all_reviews&pageNumber=4
https://www.amazon.com/2030-Biggest-Collide-Reshape-Everything/product-reviews/1250268176/ref=cm_cr_arp_d_paging_btm_next_2?ie=UTF8&reviewerType=all_reviews&pageNumber=5

Thank you.

I installed all the requirements and ran the code for testing without changing the urls or anything and got the following error:

Downloading https://www.amazon.com/Nike-Womens-Reax-Running-Shoes/product-reviews/B07ZPL752N/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews
Traceback (most recent call last):
File "C:/Users/amazon-review-scraper-master/reviews.py", line 46, in
for r in data['reviews']:
TypeError: 'NoneType' object is not iterable

Could you tell me where the code might need to be changed or what I should do?