Code Monkey home page Code Monkey logo

waybacklapse's Introduction

waybacklapse

This is a rewrite of the original waybacklapse using docker and phantomjs directly. It eliminates the need for the screenshot-as-a-service node application. You can still get the original version from pip and can checkout the source using the following command:

You can view the original README here.

Getting Started

Quick Method

Requires Python3 on your system.

  • pip install invoke or conda install invoke
  • invoke runner which will build/start the docker container and run the command-line application. Output will be generated in ./output.

Detailed Method

  • Build the image: docker-compose build
  • Start the container: docker-compose up

To generate a GIF in ./output run: docker-compose run wayback python3 /usr/src/app/waybacklapse.py. You will be prompted for inputs. If you want to specify these values (not answering prompts) you can use the flag options shown by --help.

Developing

  • Create a virtualenv/conda-env and activate it
  • pip install invoke
  • invoke test
  • invoke

waybacklapse's People

Contributors

kpurdon avatar vantonio avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar

Forkers

amoncho vantonio pythonthings

waybacklapse's Issues

timelapse empty

Hi!

I had this same idea pop into my head a hour ago and was excited that someone had ran with this idea recently. I ran into your blog post and checked out your tools. I took a look and this is exactly how I would of approached the problem so super stoked.

I'm running into getting it to run just for google.com and my timelapse directory is always empty. it looks like its pulling all the occurrences from the internet archive but nothings being generated from imagemagick.

wonder if there was some other tricks to or steps I'm missing
would love to submit a PR to fix. Thanks for sharing your work!

see stack trace below

  • OSX Yosemite 10.10

after installing and following the blogpost

(.waybacklapse)╭─stanzheng@stanzheng-2  /usr/local  ‹master›
╰─$ python --version                                                                                                                                1 ↵
Python 2.7.6
(.waybacklapse)╭─stanzheng@stanzheng-2  /usr/local  ‹master›
╰─$ convert --version
Version: ImageMagick 6.8.8-9 Q16 x86_64 2014-03-23 http://www.imagemagick.org
Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
Features: DPC Modules
Delegates: bzlib freetype jng jpeg ltdl png xml zlib

(.waybacklapse)╭─stanzheng@stanzheng-2  /usr/local  ‹master›
╰─$ node -v
v0.10.33
(.waybacklapse)╭─stanzheng@stanzheng-2  /usr/local  ‹master›
╰─$

(.waybacklapse)╭─stanzheng@stanzheng-2  ~/code/c4hrva/null/grow-n-up  ‹master*›
╰─$ sudo waybacklapse                                                                                                                               1 ↵
What URL would you like to create a timelapse of (ex. google.com): http://google.com
What directory would you like the output in: http://google.com
What year would you like your timelapse to begin: 2006
What year would you like your timelapse to end: 2014
What speed would you like your timelapse (100=slow|25=fast): 25
Would you like a (1) yearly or (2) monthly timelapse: 2
Capturing http://web.archive.org/web/20060101071845/http://google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060101071845.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060101071845.png: No such file or directory
Capturing http://web.archive.org/web/20060201043319/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060201043319.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060201043319.png: No such file or directory
Capturing http://web.archive.org/web/20060301031331/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060301031331.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060301031331.png: No such file or directory
Capturing http://web.archive.org/web/20060401233304/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060401233304.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060401233304.png: No such file or directory
Capturing http://web.archive.org/web/20060501235513/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060501235513.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060501235513.png: No such file or directory
Capturing http://web.archive.org/web/20060601005652/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060601005652.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060601005652.png: No such file or directory
Capturing http://web.archive.org/web/20060701142245/http://google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060701142245.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060701142245.png: No such file or directory
Capturing http://web.archive.org/web/20060801070123/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060801070123.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060801070123.png: No such file or directory
Capturing http://web.archive.org/web/20060902075053/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20060902075053.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20060902075053.png: No such file or directory
Capturing http://web.archive.org/web/20061001030436/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20061001030436.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20061001030436.png: No such file or directory
Capturing http://web.archive.org/web/20061101161201/http://www3.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20061101161201.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20061101161201.png: No such file or directory
Capturing http://web.archive.org/web/20061201030432/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20061201030432.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20061201030432.png: No such file or directory
Capturing http://web.archive.org/web/20070101184059/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070101184059.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070101184059.png: No such file or directory
Capturing http://web.archive.org/web/20070201185600/http://google.com ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070201185600.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070201185600.png: No such file or directory
Capturing http://web.archive.org/web/20070301010925/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070301010925.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070301010925.png: No such file or directory
Capturing http://web.archive.org/web/20070401135543/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070401135543.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070401135543.png: No such file or directory
Capturing http://web.archive.org/web/20070501105952/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070501105952.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070501105952.png: No such file or directory
Capturing http://web.archive.org/web/20070601045708/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070601045708.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070601045708.png: No such file or directory
Capturing http://web.archive.org/web/20070701051629/http://www.google.com ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070701051629.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070701051629.png: No such file or directory
Capturing http://web.archive.org/web/20070802094218/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070802094218.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070802094218.png: No such file or directory
Capturing http://web.archive.org/web/20070901064928/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20070901064928.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20070901064928.png: No such file or directory
Capturing http://web.archive.org/web/20071001095431/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20071001095431.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20071001095431.png: No such file or directory
Capturing http://web.archive.org/web/20071101040432/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20071101040432.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20071101040432.png: No such file or directory
Capturing http://web.archive.org/web/20071201223819/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20071201223819.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20071201223819.png: No such file or directory
Capturing http://web.archive.org/web/20080101042906/http://www.google.com:80/# ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080101042906.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080101042906.png: No such file or directory
Capturing http://web.archive.org/web/20080201001612/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080201001612.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080201001612.png: No such file or directory
Capturing http://web.archive.org/web/20080305190619/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080305190619.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080305190619.png: No such file or directory
Capturing http://web.archive.org/web/20080401212302/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080401212302.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080401212302.png: No such file or directory
Capturing http://web.archive.org/web/20080501222533/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080501222533.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080501222533.png: No such file or directory
Capturing http://web.archive.org/web/20080602155742/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080602155742.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080602155742.png: No such file or directory
Capturing http://web.archive.org/web/20080701155704/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080701155704.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080701155704.png: No such file or directory
Capturing http://web.archive.org/web/20080801084649/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080801084649.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080801084649.png: No such file or directory
Capturing http://web.archive.org/web/20080902173409/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20080902173409.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20080902173409.png: No such file or directory
Capturing http://web.archive.org/web/20081001150909/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20081001150909.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20081001150909.png: No such file or directory
Capturing http://web.archive.org/web/20081102201815/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20081102201815.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20081102201815.png: No such file or directory
Capturing http://web.archive.org/web/20081201005019/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20081201005019.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20081201005019.png: No such file or directory
Capturing http://web.archive.org/web/20090101001458/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090101001458.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090101001458.png: No such file or directory
Capturing http://web.archive.org/web/20090201005707/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090201005707.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090201005707.png: No such file or directory
Capturing http://web.archive.org/web/20090301005751/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090301005751.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090301005751.png: No such file or directory
Capturing http://web.archive.org/web/20090401012653/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090401012653.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090401012653.png: No such file or directory
Capturing http://web.archive.org/web/20090501024751/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090501024751.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090501024751.png: No such file or directory
Capturing http://web.archive.org/web/20090601170324/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090601170324.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090601170324.png: No such file or directory
Capturing http://web.archive.org/web/20090701043129/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090701043129.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090701043129.png: No such file or directory
Capturing http://web.archive.org/web/20090802005717/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090802005717.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090802005717.png: No such file or directory
Capturing http://web.archive.org/web/20090901191100/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20090901191100.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20090901191100.png: No such file or directory
Capturing http://web.archive.org/web/20091001004448/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20091001004448.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20091001004448.png: No such file or directory
Capturing http://web.archive.org/web/20091101005626/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20091101005626.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20091101005626.png: No such file or directory
Capturing http://web.archive.org/web/20091201191240/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20091201191240.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20091201191240.png: No such file or directory
Capturing http://web.archive.org/web/20100102171911/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100102171911.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100102171911.png: No such file or directory
Capturing http://web.archive.org/web/20100202152027/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100202152027.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100202152027.png: No such file or directory
Capturing http://web.archive.org/web/20100301085045/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100301085045.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100301085045.png: No such file or directory
Capturing http://web.archive.org/web/20100401021023/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100401021023.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100401021023.png: No such file or directory
Capturing http://web.archive.org/web/20100501161322/http://[email protected]/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100501161322.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100501161322.png: No such file or directory
Capturing http://web.archive.org/web/20100601085920/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100601085920.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100601085920.png: No such file or directory
Capturing http://web.archive.org/web/20100701071253/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100701071253.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100701071253.png: No such file or directory
Capturing http://web.archive.org/web/20100801005652/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100801005652.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100801005652.png: No such file or directory
Capturing http://web.archive.org/web/20100901123229/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20100901123229.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20100901123229.png: No such file or directory
Capturing http://web.archive.org/web/20101001010604/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20101001010604.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20101001010604.png: No such file or directory
Capturing http://web.archive.org/web/20101101060815/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20101101060815.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20101101060815.png: No such file or directory
Capturing http://web.archive.org/web/20101201004149/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20101201004149.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20101201004149.png: No such file or directory
Capturing http://web.archive.org/web/20110101025146/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110101025146.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110101025146.png: No such file or directory
Capturing http://web.archive.org/web/20110201000143/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110201000143.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110201000143.png: No such file or directory
Capturing http://web.archive.org/web/20110301014243/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110301014243.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110301014243.png: No such file or directory
Capturing http://web.archive.org/web/20110401002955/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110401002955.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110401002955.png: No such file or directory
Capturing http://web.archive.org/web/20110501034236/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110501034236.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110501034236.png: No such file or directory
Capturing http://web.archive.org/web/20110601002253/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110601002253.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110601002253.png: No such file or directory
Capturing http://web.archive.org/web/20110701022144/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110701022144.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110701022144.png: No such file or directory
Capturing http://web.archive.org/web/20110801085947/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110801085947.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110801085947.png: No such file or directory
Capturing http://web.archive.org/web/20110901003620/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20110901003620.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20110901003620.png: No such file or directory
Capturing http://web.archive.org/web/20111001000926/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20111001000926.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20111001000926.png: No such file or directory
Capturing http://web.archive.org/web/20111101002009/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20111101002009.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20111101002009.png: No such file or directory
Capturing http://web.archive.org/web/20111201003601/http://www.google.com:80/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20111201003601.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20111201003601.png: No such file or directory
Capturing http://web.archive.org/web/20120101000928/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120101000928.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120101000928.png: No such file or directory
Capturing http://web.archive.org/web/20120201000345/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120201000345.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120201000345.png: No such file or directory
Capturing http://web.archive.org/web/20120301000307/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120301000307.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120301000307.png: No such file or directory
Capturing http://web.archive.org/web/20120401000625/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120401000625.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120401000625.png: No such file or directory
Capturing http://web.archive.org/web/20120501000143/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120501000143.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120501000143.png: No such file or directory
Capturing http://web.archive.org/web/20120601000327/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120601000327.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120601000327.png: No such file or directory
Capturing http://web.archive.org/web/20120701001236/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120701001236.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120701001236.png: No such file or directory
Capturing http://web.archive.org/web/20120801000623/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120801000623.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120801000623.png: No such file or directory
Capturing http://web.archive.org/web/20120901000323/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20120901000323.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20120901000323.png: No such file or directory
Capturing http://web.archive.org/web/20121001001608/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20121001001608.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20121001001608.png: No such file or directory
Capturing http://web.archive.org/web/20121101000221/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20121101000221.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20121101000221.png: No such file or directory
Capturing http://web.archive.org/web/20121201002305/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20121201002305.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20121201002305.png: No such file or directory
Capturing http://web.archive.org/web/20130101000813/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130101000813.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130101000813.png: No such file or directory
Capturing http://web.archive.org/web/20130201000125/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130201000125.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130201000125.png: No such file or directory
Capturing http://web.archive.org/web/20130301001159/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130301001159.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130301001159.png: No such file or directory
Capturing http://web.archive.org/web/20130401000354/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130401000354.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130401000354.png: No such file or directory
Capturing http://web.archive.org/web/20130501000349/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130501000349.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130501000349.png: No such file or directory
Capturing http://web.archive.org/web/20130601000405/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130601000405.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130601000405.png: No such file or directory
Capturing http://web.archive.org/web/20130701000237/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130701000237.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130701000237.png: No such file or directory
Capturing http://web.archive.org/web/20130801001014/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130801001014.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130801001014.png: No such file or directory
Capturing http://web.archive.org/web/20130901000510/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20130901000510.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20130901000510.png: No such file or directory
Capturing http://web.archive.org/web/20131001000114/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20131001000114.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20131001000114.png: No such file or directory
Capturing http://web.archive.org/web/20131101000141/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20131101000141.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20131101000141.png: No such file or directory
Capturing http://web.archive.org/web/20131201001016/http://google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20131201001016.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20131201001016.png: No such file or directory
Capturing http://web.archive.org/web/20140101000015/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140101000015.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140101000015.png: No such file or directory
Capturing http://web.archive.org/web/20140201002024/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140201002024.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140201002024.png: No such file or directory
Capturing http://web.archive.org/web/20140301000048/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140301000048.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140301000048.png: No such file or directory
Capturing http://web.archive.org/web/20140401000447/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140401000447.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140401000447.png: No such file or directory
Capturing http://web.archive.org/web/20140501000321/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140501000321.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140501000321.png: No such file or directory
Capturing http://web.archive.org/web/20140601001808/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140601001808.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140601001808.png: No such file or directory
Capturing http://web.archive.org/web/20140701005551/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140701005551.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140701005551.png: No such file or directory
Capturing http://web.archive.org/web/20140801012636/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140801012636.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140801012636.png: No such file or directory
Capturing http://web.archive.org/web/20140901001648/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20140901001648.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20140901001648.png: No such file or directory
Capturing http://web.archive.org/web/20141001001137/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20141001001137.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20141001001137.png: No such file or directory
Capturing http://web.archive.org/web/20141101000032/http://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20141101000032.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20141101000032.png: No such file or directory
Capturing http://web.archive.org/web/20141201000626/https://www.google.com/ ...
Attemting to download: http://google.com/2014121914121419017493/http://google.com_20141201000626.png
/bin/sh: http://google.com/2014121914121419017493/http://google.com_20141201000626.png: No such file or directory
Generating GIF (convert -delay 25 http://google.com/2014121914121419017493/*.png http://google.com/2014121914121419017493/timelapse/http://google.com.gif)
convert: improper image header `/var/tmp/magick-29359uYUfa-Vl0a83' @ error/png.c/ReadPNGImage/4029.
convert: no data returned `http://google.com/2014121914121419017493/*.png' @ error/url.c/ReadURLImage/265.
convert: no images defined `http://google.com/2014121914121419017493/timelapse/http://google.com.gif' @ error/convert.c/ConvertImageCommand/3150.
(.waybacklapse)╭─stanzheng@stanzheng-2  ~/code/c4hrva/null/grow-n-up  ‹master*›
╰─$ ls

GhostDriver failure

Trying to run for bitly.com monthly verbose redirects w/ defaults.

  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 119, in worker
    result = (True, func(*args, **kwds))
  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 47, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/usr/src/app/waybacklapse.py", line 34, in capture_url
    with closing(webdriver.PhantomJS()) as driver:
  File "/usr/local/lib/python3.4/site-packages/selenium/webdriver/phantomjs/webdriver.py", line 53, in __init__
    self.service.start()
  File "/usr/local/lib/python3.4/site-packages/selenium/webdriver/phantomjs/service.py", line 84, in start
    raise WebDriverException("Can not connect to GhostDriver")
selenium.common.exceptions.WebDriverException: Message: Can not connect to GhostDriver

"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/app/waybacklapse.py", line 108, in <module>
    cli()
  File "/usr/local/lib/python3.4/site-packages/click/core.py", line 664, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.4/site-packages/click/core.py", line 644, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.4/site-packages/click/core.py", line 837, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.4/site-packages/click/core.py", line 464, in invoke
    return callback(*args, **kwargs)
  File "/usr/src/app/waybacklapse.py", line 91, in cli
    repeat(allow_redirects)))
  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 268, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 599, in get
    raise self._value
selenium.common.exceptions.WebDriverException: Message: Can not connect to GhostDriver

Fix missing images

Some images returned from wb are "missing" (usually a redirect in progress). Adding a delay may fix this.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.