Code Monkey home page Code Monkey logo

Comments (4)

SpikeHD avatar SpikeHD commented on August 18, 2024 1

I believe what's happening is that the response the bot is getting is the same as the one cURL is getting, which is the 301 error, which isn't very helpful in terms of getting Amazon data, obviously. I believe it's a redirect-following error, so I can look into it later.

from amazonmonitor.

SpikeHD avatar SpikeHD commented on August 18, 2024

Can you give me a short example of what your proxylist looks like? What problem specifically are you having? Like, are the requests failing or something?

Edit: Sorry just read through the debug output a bit more, no need to answer those. Do they work without user/pass authentication? Can you test the Amazon request using the proxy with something like cURL to see what specifically comes back?

from amazonmonitor.

wirdo89 avatar wirdo89 commented on August 18, 2024

Thank-you for your response.

I'm not getting anything back when doing a curl with or without proxy on that URL. When I try it on amazon.de itself it shows the same thing with or without proxy.
The proxies work with and without user/password yes. Tested both though.
When testing with proxy on for example "https://www.amazon.de/-/en/gp/movers-and-shakers/?ref_=nav_em_ms_0_1_1_4" it works fine with CURL and it downloads some code.

c:\temp>curl https://www.amazon.de/-/en/gp/movers-and-shakers/?ref_=nav_em_ms_0_1_1_4 --proxy 185.250.XX.XXX:8085 --output test.txt
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 41789 0 41789 0 0 41789 0 --:--:-- 0:00:01 --:--:-- 31467

c:\temp>curl amazon.de --proxy 185.250.XX.XXX:8085

<title>301 Moved Permanently</title>

301 Moved Permanently


Server

c:\temp>curl amazon.de

<title>301 Moved Permanently</title>

301 Moved Permanently


Server

from amazonmonitor.

SpikeHD avatar SpikeHD commented on August 18, 2024

I can't say I have ever come across this error since my last comment. If this is still an issue, let me know!

from amazonmonitor.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.