Request Throttling about amazon-product-api HOT 5 CLOSED

Hey @FdezRomero!
It think it is a good idea to add an option to limit requests.
https://github.com/jhurliman/node-rate-limiter comes to mind. Any advantages of using bottleneck over it?
Can you show an example of that option in other languages?

from amazon-product-api.

Hi @t3chnoboy,

I chose Bottleneck over node-rate-limiter because it allows to create a different keys/queues for each API endpoint and seemed very lightweight and performant (the creators use it for production DNS). However, I'm not sure if some endpoints are counted together for the rate limiting or not, I found contradictory information about this. Anyway, I have no preference in using these libraries or a custom implementation as long as it supports concurrency.

You can find an example of the MaxQPS I mentioned before in bottlenose, a client written in Python (I haven't used it myself).

Thanks!

from amazon-product-api.

Hi @FdezRomero. I recently ran into the same throttling issue and found that global throttling, i.e. not per-endpoint throttling, was the solution. Putting https://github.com/jhurliman/node-rate-limiter, as @t3chnoboy suggested, in front of all requests worked well.

from amazon-product-api.

Thanks @kaijuliu, knowing that the limit is actually global and not per endpoint really helps 👍
I read some time ago a comment saying that the European stores acted like a cluster and the rest were independent, but I never found official information from Amazon...

from amazon-product-api.

@t3chnoboy can we close this issue?

from amazon-product-api.