Single URL errors about gowitness HOT 9 CLOSED

Ran into this issue as well recently, think the issue may be from the instantiation of the http transport in chrome.go missing some of the defaults?

transport := http.DefaultTransport.(*http.Transport).Clone()

Seems to fix the issue with a shallow copy, but need to test it out a bit more against more assets in comparison to the old version.

from gowitness.

I can replicate this on Kali for https://tesla.com, but works fine on macOS. 🤔

from gowitness.

So there are two problems here. For the error related to reddit a fix is incoming shortly. As for tesla.com, there seems to be weirdness in how the server responds based on the User-Agent and Connection headers. Still debugging this.

from gowitness.

I am happy I fixed the reddit example (thanks for reporting @znre). As for tesla.com, the preflight request fails with this request.

For the sake of copy/paste.

GET / HTTP/1.1
Host: www.tesla.com
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.102 Safari/537.36
Referer: https://tesla.com
Accept-Encoding: gzip, deflate
Connection: close

Change the User-Agent to curl, and it will work, or Connection to keep-alive and it will sometimes work. So the question is I guess, does it make sense to set the UA in the preflight as well? In my mind it does, but we have this interesting case now.

from gowitness.

Hey there, any updates on this one? It seems that gowitness single https://www.tesla.com/es_ES/ works just fine.
I'm from Spain by the way 😉

from gowitness.

@leonjza I am still facing the same issues in the latest build. gowitness fails to create a local 'screenshot' folder. I think we can change it to use mkdirall instead of mkdir and it would resolve the issue.

https://stackoverflow.com/questions/37932551/mkdir-if-not-exists-using-golang

from gowitness.

@lyonys are you providing a path that is deeper than 1 directory? Right now we are preparing the directory here.

from gowitness.

Closing this for now. Looks like the tesla.com example works at the moment.

from gowitness.

only the https://tesla.com is not working again, reproduced on kali

from gowitness.