From https://code.google.com/archive/p/warrick/issues/29

What steps will reproduce the problem? 1. ./warrick.pl -dr 2013-08-05 -d -a ia -D ../ftp/ http://www.atlantischild.hu/

What is the expected output? What do you see instead?

http://wayback.archive.org/web/20111031230326/http://www.atlantischild.hu/index.php?option=com_content&task=view&id=21&Itemid=9 has non-zero lenght, I get zero lenght files: "index.php?option=com_content&task=view&id=21&Itemid=9"

What version of the product are you using? On what operating system? warrickv2-2-5

Please provide any additional information below.

I've got a non-zero lenght file which has GET parameters in its name but all files containing & (ampersand) in their names are empty.

log says (below) as you see, nothig anfter "?" in "To stats ... Location:"

At Frontier location 79 of 769

My frontier at 79: http://atlantischild.hu:80/index.php?option=com_content&task=blogcategory&id=21&Itemid=28 My memento to get: |http://atlantischild.hu:80/index.php?option=com_content&task=blogcategory&id=21&Itemid=28|

targetpath: index.php

appending query string option=com_content&task=blogcategory&id=21&Itemid=28

mcurling: /home/davidprog/dev/design-check/atlantis/warrick//mcurl.pl -D "/home/davidprog/dev/design-check/atlantis/warrick/../ftp//logfile.o" -dt "Sun, 04 Aug 2013 22:00:00 GMT" -tg "http://web.archive.org/web" -L -o "/home/davidprog/dev/design-check/atlantis/warrick/../ftp//index.php?option=com_content&task=blogcategory&id=21&Itemid=28" "http://atlantischild.hu:80/index.php?option=com_content&task=blogcategory&id=21&Itemid=28"

Reading logfile: /home/davidprog/dev/design-check/atlantis/warrick/../ftp//logfile.o

To stats http://atlantischild.hu:80/index.php?option=com_content&task=blogcategory&id=21&Itemid=28 => Location: http://web.archive.org/web/20120903050228/http://www.atlantischild.hu/index.php? => /home/davidprog/dev/design-check/atlantis/warrick/../ftp//index.php?option=com_content&task=blogcategory&id=21&Itemid=28 --> stat IA

returning /home/davidprog/dev/design-check/atlantis/warrick/../ftp//index.php?option=com_content&task=blogcategory&id=21&Itemid=28 Search HTML resource /home/davidprog/dev/design-check/atlantis/warrick/../ftp//index.php?option=com_content&task=blogcategory&id=21&Itemid=28 for links to other missing resources... No Content in /home/davidprog/dev/design-check/atlantis/warrick/../ftp//index.php?option=com_content&task=blogcategory&id=21&Itemid=28!!

This is caused is a simple escaping bug in mcurl.pl and MementoThread.pm that can be fixed with a patch as follows:

~/t2/warrick2$ diff -u ../../warrick2/mcurl.pl mcurl.pl --- ../../warrick2/mcurl.pl 2014-02-05 16:35:37.362518862 -0800 +++ mcurl.pl 2012-03-27 13:02:41.000000000 -0700 @@ -95,10 +95,7 @@

for (my $i = 0; $i <= $#ARGV; ++$i) # { - if ( ( index($ARGV[$i] , ' ') > -1 ) - or ( index($ARGV[$i] , '?') > -1 ) - or ( index($ARGV[$i] , '*') > -1 ) - ) { + if ( index($ARGV[$i] , ' ') > -1 ){ $ARGV[$i] = '"' .$ARGV[$i] . '"'; } } ~/t2/warrick2$ diff -u ../../warrick2/MementoThread.pm MementoThread.pm --- ../../warrick2/MementoThread.pm 2014-02-05 16:38:19.914518843 -0800 +++ MementoThread.pm 2012-03-27 13:02:42.000000000 -0700 @@ -97,7 +97,7 @@ $acceptDateTimeHeader = " -H "Accept-Datetime: ".$self->{DateTime}." " "; }

my $command = "curl -I $acceptDateTimeHeader "$self->{URI}" ";
my $command = "curl -I $acceptDateTimeHeader $self->{URI} "; if($self->{Debug} == 1){ print "DEBUG: " .$command ."\n"; } @@ -351,7 +351,7 @@

} else {

$command = "curl @params $acceptDateTimeHeader "". $self->{TimeGate} ."/" . $self->{URI} . """;

$command = "curl @params $acceptDateTimeHeader ". $self->{TimeGate} ."/" . $self->{URI};

}

@@ -390,7 +390,7 @@

         $command = "curl -I -L $acceptDateTimeHeader ". $self->{Info}->{TimeGate} ;
     } else {

• $command = "curl -I -L $acceptDateTimeHeader "". $self->{TimeGate} ."/" . $self->{URI} . """; + $command = "curl -I -L $acceptDateTimeHeader ". $self->{TimeGate} ."/" . $self->{URI};

     }
  

@@ -667,4 +667,4 @@ return $result; }

Last update 5 years ago ..

From https://code.google.com/archive/p/warrick/issues/28

IA had a number of URLs like this

http://www.harding.edu:80/fmccown/

that had the default port 80 in them (who knows why). Warrick treats this URL as if it were different than

http://www.harding.edu/fmccown/

which of course they are not.

From https://code.google.com/archive/p/warrick/issues/14

Optimization: Use a perl hash-table instead of a perl array. This way, you neatly eliminate duplicates, but can still traverse it like an array.

From https://code.google.com/archive/p/warrick/issues/21

I want to recover an older version of a website, that contains "better" information compared to the pervius one and make a local copy for my personal use. I can't get a full website dump, it's alsways incomplete. I'm using OSX.

It's me or the software ? :)

sudo perl ./warrick.pl -o /Users/cesare/Documents/drclark.net/warrick.log -dr 2012-07-23 -D /Users/cesare/Documents/drclark.net - -ic -nc -nv -a ia -nB "http://www.drclark.net/"

drclark.net_recoveryLog.out.txt
warrick.log.txt

From https://code.google.com/archive/p/warrick/issues/39

What steps will reproduce the problem? 1. ./INSTALL 2. ./TEST 3. Error presents

What is the expected output?

Successful test

What do you see instead?

net4-dev# ./TEST Starting test...

Welcome to the Warrick Program!

Warrick is a website recovery tool out of Old Dominion University

Please provide feedback to Justin F. Brunelle at [email protected]

Arguments: -D MAKEFILE -o MAKEFILE_LOGFILE.log -xc -nr -dr 2007-08-02 -T -nv http://www.cs.odu.edu/

Unknown option: nr

TESTING DOWNLOAD COMPLETE...

Downloaded 28 resources, which is greater than the 27 from the testfile. We've found a new memento. Test success! cat: MAKEFILE/TESTHEADERS.out: No such file or directory 0 vs 0

What version of the product are you using? On what operating system?

Downloaded version warrickv2-2-5.tar.gz except version string in source says 2.2.3 + I'll open a separate ticket on this problem.

Please provide any additional information below.

From https://code.google.com/archive/p/warrick/issues/23

What steps will reproduce the problem? 1. Install warrick, etc., under CentOS 5.8 2. run it (e.g. warrick.pl -o mylog http://www.mysite.com

What is the expected output? What do you see instead? A directory of stuff. Get an error message and nothing in the log.

What version of the product are you using? On what operating system? Latest (as of today). CentOS 5.8

From https://code.google.com/archive/p/warrick/issues/12

When the "no clobber" option is picked, and a file is detected to already exist, Warrick should not do any sleeping while moving on to the next file in the frontier. This will greatly enhance the usability of Warrick, and reduce the need for session management with the *.save files, and would be far more flexible. The most difficult part of the documentation to understand is the *.save feature used for saving sessions.

From https://code.google.com/archive/p/warrick/issues/16

Optimization: if the user is only pulling from one source, why call sed to do filtering as if pulling from all sources?

From https://code.google.com/archive/p/warrick/issues/30

What steps will reproduce the problem? 1. Download warrickv2-2-5.tar.gz from project's "Downloads" 2. Look inside it with mc for example (with Midnight Commander)

What is the expected output? What do you see instead?

README file says version is 2.0 Expected: 2.5

Almost all files are executable. Even .o text files. Expected: executable must be only files which you have to run.

.o extension is confusing for text files (it usually have compiled object files) with 2 URL inside it. Expected: another extension and may be put these 20 files into a subdir.

I do not expect to see 'curl.exe' here. Expected: either Windows support is officially claimed on the project page or remove the file.

piklog.log is 1 Mb size. Is it really need into distribution archive? Expected: if the file is a part of test suite it might be placed into TEST_FILES subdir.

What version of the product are you using? On what operating system? warrick-2.5 Ubuntu 13.04 x32

Please provide any additional information below.

The usual thing which developers do is just using 'dist' makefile target or 'makedist.sh' script. It does some clean-up ('make clean' or 'rm' command for specified filelist) and put only really needed files into distribution archive.

From https://code.google.com/archive/p/warrick/issues/32

What steps will reproduce the problem? 1.Try to recover sites with non english accents and characters 2. 3.

What is the expected output? What do you see instead?

instead of ó i see ó instead of á i see á

etc...

What version of the product are you using? On what operating system?

Last V on ubuntu 12.04LTS Please provide any additional information below.

I am not sure whether we are talking the same thing. But is it possible to adding something like to all pages with a option in warrick script?

When running test after initially installing Warrick, the script report:

Arguments: -D MAKEFILE -o MAKEFILE_LOGFILE.log -xc -nr -dr 2007-08-02 -T -nv http://www.cs.odu.edu/

Unknown option: nr

Perhaps this argument is being captured by the perl environment instead of the perl script, i.e., an option to consider when executing the script.

Issues derived from the command:

perl warrick.pl -D MAKEFILE -o MAKEFILE_LOGFILE.log -xc -nr -dr 2007-08-02 -T -nv http://www.cs.odu.edu/

This may prevent the output files from being generated, which may explain why the TEST script fails on the first check.

Perl v5.18.2
macOS 10.13.4

From https://code.google.com/archive/p/warrick/issues/33

URI format changes by the archives have rendered the -k and uri-rewriting features inoperable. we need to develop a way -- without hardcoding -- to either automatically or easily manually change the URI strings that we need to detect to make relative.

Archive watermarks, status bars, and other archive-added features should be treated similarly.

Ported from https://code.google.com/archive/p/warrick/issues/40

What steps will reproduce the problem? 1. Download warrickv2-2-5.tar.gz 2. Unpack 3. $version in warrick.pl reports 2.2.3 instead of 2.2.5

Please provide any additional information below.

Either v2.2.3 is incorrectly in download slot for 2.2.5 or incorrect version string is in file.

v2.2.4 download has same incorrect 2.2.3 version string also.

From https://code.google.com/archive/p/warrick/issues/15

Please describe your feature requests here.

Optimization: Use perl's internal 'stream editing' instead of calling out to sed by fork/exec. Not only do you save system call & fork & exec overhead, but perl has higher performance I/O according to one source.