davidferguson / archivetheweb Goto Github PK

I try to archive everything embedded on a Twitter page (e.g. twitter.com/realDonaldTrump), but the images and text that loads when you scroll down does not archive. I've tested this myself.

Care to fix this? Thank you.

Hi, thanks so much for this application. I really wanted this since two years back. Anyway, do you plan to support archiving flash and video files that only loads when I click them on a web page? I know the Wayback Machine does not always archive those like it should. Maybe a way to double check if everything has been archived on said web page.

Will you consider a Firefox release as well? I really enjoy this program.

Thanks,

DKL3

have a regex-based/plainlist(should work with both in the same list) ignore list of sites/parts of sites that the user never wants to archive

have a option/tab for what exactly was successfully archived, and maybe another part that tells you what failed, and why (should mainly be because of the site blocking the crawler via the robots.txt)