search_pubs - StopIteration about scholarly HOT 4 CLOSED

@Owaiskhan9654 , that was not the issue that OP @MatteoRiva95 posted.

The issue was with the exception StopIteration, which I don't think it has anything to do with Proxies.

First, consider this code:

from scholarly import scholarly

search_phrase = "massive MIMO"
search_query = scholarly.search_pubs(search_phrase)
search_query2 = scholarly.search_pubs(search_phrase, start_index=970)

You will get:
search_query.total_results --> 179000
search_query2.total_results --> 0 (it's 0 even if start_index= 10)

This is issue 1.

Issue 2:
When you iterate over the results using next(search_query).
search_query2 raises THAT exception (StopIteration) after 10 results or so.

What's going on? Any idea @ipeirotis?

from scholarly.

Any update? Still getting this issue @ipeirotis @papr @marcoscarpetta @guicho271828

from scholarly.

You need a paid proxy for searching publications.

from scholarly.

Seems to be related to the anti-crawling mechanism of Google. The URL that we create seems to be flagged as unusual by Google and Google returns back an "error" page. I do not have a clear path how to fix this.

from scholarly.