<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clip

The <div class="snippet-clipboard-content notranslate position-relative overflow-a

No luck. Console output of my new try: <div class="snippet-clipboard-content notra

No luck with the Java 7 either. <div class="snippet-clipboard-content notranslate

I propose that You download a <a href="http://technology.softf1.com/various_virtual_ap

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

Heritrix3 Fails to Build from Source,about internetarchive/heritrix3

Comments (11)

martinvahi commented on June 10, 2024

The

mavaen -e -X package

gives

jaan 31, 2017 11:51:29 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170131115124/reports/responsecode-report.txt
jaan 31, 2017 11:51:29 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170131115124/reports/processors-report.txt
jaan 31, 2017 11:51:29 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170131115124/reports/frontier-summary-report.txt
jaan 31, 2017 11:51:29 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170131115124/reports/threads-report.txt
jaan 31, 2017 11:51:29 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170131115124
jaan 31, 2017 11:51:29 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.046 sec
Running org.archive.crawler.selftest.CheckpointSelfTest
log4j:ERROR No layout set for the appender named [console].
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.338 sec <<< FAILURE!
Running org.archive.crawler.prefetch.RuntimeLimitEnforcerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.756 sec
Running org.archive.crawler.prefetch.QuotaEnforcerTest
Tests run: 13, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 0.782 sec <<< FAILURE!
Running org.archive.crawler.prefetch.PreconditionEnforcerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec
Running org.archive.crawler.prefetch.PreselectorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.crawler.framework.EngineTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.041 sec
Running org.archive.crawler.framework.CrawlControllerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
Running org.archive.crawler.framework.CrawlLimitEnforcerTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.05 sec
Running org.archive.crawler.restlet.ScriptingConsoleTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.086 sec
Running org.archive.crawler.restlet.XmlMarshallerTest
<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.155 sec
Running org.archive.crawler.postprocessor.LowDiskPauseProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.postprocessor.SupplementaryLinksScoperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec
Running org.archive.crawler.datamodel.CandidateURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
Running org.archive.crawler.datamodel.CrawlURITest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running org.archive.crawler.util.TopNSetTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.crawler.util.BdbUriUniqFilterTest
jaan 31, 2017 11:51:41 AM org.archive.crawler.util.BdbUriUniqFilterTest testWriting
INFO: Looking for override system property org.archive.crawler.util.BdbUriUniqFilterTest.maxcount
jaan 31, 2017 11:51:41 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Added 1000 in 29
jaan 31, 2017 11:51:41 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Added random 9 in 1
jaan 31, 2017 11:51:41 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Deleted random 9 in 0
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 4 urls from scheme+authority of url http://forgetme.com (leaving 2 urls from other scheme+authorities)
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 1 urls from scheme+authority of url https://forgetme.com/extra-stuff-ignored (leaving 1 urls from other scheme+authorities)
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 1 urls from scheme+authority of url http://forgetme.com:90/ (leaving 0 urls from other scheme+authorities)
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.137 sec
Running org.archive.crawler.util.FPUriUniqFilterTest
jaan 31, 2017 11:51:42 AM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Added 1000 in 21
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Added random 9 in 0
jaan 31, 2017 11:51:42 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Deleted random 9 in 0
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec
Running org.archive.crawler.util.BloomUriUniqFilterTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.185 sec
Running org.archive.crawler.processor.HashCrawlMapperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.crawler.processor.LexicalCrawlMapperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.frontier.BdbMultipleWorkQueuesTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.crawler.frontier.BdbFrontierTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.crawler.frontier.FrontierJournalTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.frontier.precedence.BaseQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.crawler.frontier.precedence.SuccessCountsQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
Running org.archive.crawler.frontier.precedence.HopsUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.crawler.frontier.precedence.BaseUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.crawler.frontier.precedence.CostUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.crawler.frontier.precedence.HighestUriQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.crawler.frontier.BucketQueueAssignmentPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec

Results :

Failed tests:   testSomething(org.archive.crawler.selftest.StatisticsSelfTest): expected:<9727> but was:<9728>

Tests in error: 
  testSomething(org.archive.crawler.selftest.CheckpointSelfTest)
  testServerNovelKbForceRetire(org.archive.crawler.prefetch.QuotaEnforcerTest): Java heap space
  testSerializationIfAppropriate(org.archive.crawler.prefetch.QuotaEnforcerTest): Java heap space

Tests run: 88, Failures: 1, Errors: 3, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Heritrix 3 ......................................... SUCCESS [  0.002 s]
[INFO] Heritrix 3: 'commons' subproject (utility classes) . SUCCESS [06:34 min]
[INFO] Heritrix 3: 'modules' subproject (reusable components) SUCCESS [ 38.758 s]
[INFO] Heritrix 3: 'engine' subproject .................... FAILURE [04:44 min]
[INFO] Heritrix 3 (distribution bundles) .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11:58 min
[INFO] Finished at: 2017-01-31T13:51:43+02:00
[INFO] Final Memory: 31M/210M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project heritrix-engine: There are test failures.
[ERROR] 
[ERROR] Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/engine/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project heritrix-engine: There are test failures.

Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/engine/target/surefire-reports for the individual test results.
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.

Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/engine/target/surefire-reports for the individual test results.
	at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:87)
	at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:631)
	at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:605)
	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:136)
	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:97)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
	... 20 more
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :heritrix-engine
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$

from heritrix3.

anjackson commented on June 10, 2024

I just built the master branch and it worked okay. Hm.

You might find more information in the test report files, e.g. /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/modules/target/surefire-reports/org.archive.modules.fetcher.CookieStoreTest.txt

You seem to be hitting different errors on different builds, so perhaps you're running out of disk space (e.g. tmp space) or RAM?

from heritrix3.

martinvahi commented on June 10, 2024

No luck. Console output of my new try:

se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls
commons  contrib  dist  engine  modules  pom.xml  README.md
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ rm -fr ./*
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls -l
kokku 0
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ git clone --recursive https://github.com/internetarchive/heritrix3.git
Cloning into 'heritrix3'...
remote: Counting objects: 26097, done.
remote: Total 26097 (delta 0), reused 0 (delta 0), pack-reused 26097
Receiving objects: 100% (26097/26097), 9.14 MiB | 2.12 MiB/s, done.
Resolving deltas: 100% (10176/10176), done.
Checking connectivity... done.
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls
heritrix3
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ cd heritrix3/
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ ls
commons  contrib  dist  engine  modules  pom.xml  README.md
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ nice -n20 mvn package
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] Heritrix 3
[INFO] Heritrix 3: 'commons' subproject (utility classes)
[INFO] Heritrix 3: 'modules' subproject (reusable components)
[INFO] Heritrix 3: 'engine' subproject
[INFO] Heritrix 3 (distribution bundles)
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The artifact poi:poi:jar:2.5.1 has been relocated to poi:poi:jar:2.5.1-final-20040804
[WARNING] The artifact itext:itext:jar:1.3 has been relocated to com.lowagie:itext:jar:1.3
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 77 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[9,19] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,28] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,67] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Recompile with -Xlint:deprecation for details.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java uses unchecked or unsafe operations.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 37 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-commons ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.bdb.StoredQueueTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.926 sec
Running org.archive.surt.SURTTokenizerTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:93)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1006)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.apache.log4j.Logger.getLogger(Logger.java:104)
	at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
	at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
	at org.apache.commons.httpclient.util.EncodingUtil.<clinit>(EncodingUtil.java:54)
	at org.apache.commons.httpclient.URI.decode(URI.java:1773)
	at org.apache.commons.httpclient.URI.decode(URI.java:1731)
	at org.apache.commons.httpclient.URI.getAuthority(URI.java:2725)
	at org.archive.surt.SURTTokenizer.getKey(SURTTokenizer.java:151)
	at org.archive.surt.SURTTokenizer.<init>(SURTTokenizer.java:60)
	at org.archive.surt.SURTTokenizerTest.toSurtT(SURTTokenizerTest.java:177)
	at org.archive.surt.SURTTokenizerTest.testEmptyPath(SURTTokenizerTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.681 sec
Running org.archive.settings.file.BdbModuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.524 sec
Running org.archive.settings.file.PrefixFinderTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.11 sec
Running org.archive.util.FileUtilsTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.186 sec
Running org.archive.util.PaddingStringBufferTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.util.ObjectIdentityBdbCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 10
veebr 02, 2017 11:49:52 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 20
veebr 02, 2017 11:49:57 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2621440 diskHits=131072 supplieds=131072 expungePuts=131072 syncs=0
level to 30
veebr 02, 2017 11:50:02 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 93%, gets=4194304 memHits=3801088 diskHits=262144 supplieds=131072 expungePuts=262144 syncs=0
level to 40
veebr 02, 2017 11:50:06 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=5505024 memHits=4980736 diskHits=393216 supplieds=131072 expungePuts=393216 syncs=0
level to 50
veebr 02, 2017 11:50:11 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=6815744 memHits=6160384 diskHits=524288 supplieds=131072 expungePuts=524288 syncs=0
level to 60
veebr 02, 2017 11:50:16 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 91%, gets=8126464 memHits=7340032 diskHits=655360 supplieds=131072 expungePuts=655360 syncs=0
OIBCT:DB name:consistencyCache,  hit%: 90%, gets=8519680 memHits=7602176 diskHits=786432 supplieds=131072 expungePuts=786432 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 11:50:24 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 11:50:25 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
10000,0
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.83 sec
Running org.archive.util.PropertyUtilsTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.util.SURTTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.util.UriUtilsTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.util.fingerprint.MemLongFPSetTest
veebr 02, 2017 11:50:29 AM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.034 sec
Running org.archive.util.fingerprint.LongFPSetCacheTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec
Running org.archive.util.fingerprint.ArrayLongFPCacheTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.util.MimetypeUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.util.SurtPrefixSetTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.util.anvl.ANVLRecordTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.util.BloomFilter64bitTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.521 sec
Running org.archive.util.LongToIntConsistentHashTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.303 sec
Running org.archive.util.ms.PieceReaderTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.util.ms.DocTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec
Running org.archive.util.TextUtilsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.util.ObjectIdentityBdbManualCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=121072 syncs=0
level to 10
veebr 02, 2017 11:52:54 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 974 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=1431792 syncs=0
level to 20
veebr 02, 2017 11:53:19 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2631440 diskHits=121072 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=2742512 syncs=0
level to 30
veebr 02, 2017 11:53:42 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 97%, gets=4194304 memHits=3942160 diskHits=121072 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=4053232 syncs=0
level to 40
veebr 02, 2017 11:54:08 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 95%, gets=5505024 memHits=5131808 diskHits=242144 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=5363952 syncs=0
level to 50
veebr 02, 2017 11:54:33 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 94%, gets=6815744 memHits=6321456 diskHits=363216 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=6674672 syncs=0
level to 60
veebr 02, 2017 11:54:58 AM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 93%, gets=8126464 memHits=7511104 diskHits=484288 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=7985392 syncs=0
OIBMCT:DB name:consistencyCache,  hit%: 94%, gets=8519680 memHits=7904320 diskHits=484288 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=8378608 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 158.712 sec
Running org.archive.io.SinkHandlerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.BufferedSeekInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.io.arc.ARCReaderFactoryTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec
Running org.archive.io.arc.ARCWriterPoolTest
veebr 02, 2017 11:55:06 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
veebr 02, 2017 11:55:06 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.709 sec
Running org.archive.io.arc.ARCWriterTest
veebr 02, 2017 11:55:07 AM org.archive.util.DevUtils warnHandle
WARNING: java.lang.Throwable: Gap between expected and actual: -1
 writing arc /tmp/heritrix-junit-tests/testGapError-JUNIT.arc.gz.open
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:398)
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:357)
	at org.archive.io.arc.ARCWriterTest.testGapError(ARCWriterTest.java:522)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec
Running org.archive.io.warc.WARCWriterTest
veebr 02, 2017 11:55:07 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/ /index.html
java.lang.IllegalArgumentException: Contains disallowed white space 0x20: http://www.archive.org/test/ /index.html
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:148)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testSpaceInURL(WARCWriterTest.java:423)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 11:55:07 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/	/index.html
java.lang.IllegalArgumentException: Contains illegal character 0x9: http://www.archive.org/test/	/index.html
	at org.archive.io.warc.WARCWriter.baseCharacterCheck(WARCWriter.java:137)
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:146)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testTabInURL(WARCWriterTest.java:428)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec
Running org.archive.io.HeaderedArchiveRecordTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.io.RepositionableInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.io.RecordingInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.123 sec
Running org.archive.io.ArchiveTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.ArchiveReaderFactoryTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.ReplayCharSequenceTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.273 sec
Running org.archive.uid.UUIDGeneratorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec

Results :

Tests run: 165, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix-commons ---
[INFO] Building jar: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/heritrix-commons-3.3.0-SNAPSHOT.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'modules' subproject (reusable components) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 51 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 166 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 56 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java uses or overrides a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-modules ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.modules.canonicalize.StripWWWNRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.218 sec
Running org.archive.modules.canonicalize.LowercaseRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.canonicalize.StripSessionCFIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running org.archive.modules.canonicalize.RulesCanonicalizationPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.canonicalize.FixupQueryStringTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.canonicalize.StripSessionIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.canonicalize.StripUserinfoRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.canonicalize.StripWWWRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.canonicalize.RegexRuleTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
Running org.archive.modules.ScriptedProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.extractor.HTTPContentDigestTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorImpliedURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorXMLTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.037 sec
Running org.archive.modules.extractor.ExtractorJSTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1001)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:867)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:773)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:483)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.apache.log4j.Logger.getLogger(Logger.java:104)
	at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
	at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
	at org.apache.commons.httpclient.util.EncodingUtil.<clinit>(EncodingUtil.java:54)
	at org.apache.commons.httpclient.URI.decode(URI.java:1773)
	at org.apache.commons.httpclient.URI.decode(URI.java:1731)
	at org.apache.commons.httpclient.URI.getHost(URI.java:2793)
	at org.archive.url.UsableURI.getHost(UsableURI.java:351)
	at org.archive.util.UriUtils.speculativeFixup(UriUtils.java:345)
	at org.archive.modules.extractor.ExtractorJS.considerString(ExtractorJS.java:174)
	at org.archive.modules.extractor.ExtractorJS.considerStrings(ExtractorJS.java:155)
	at org.archive.modules.extractor.ExtractorJS.considerStrings(ExtractorJS.java:134)
	at org.archive.modules.extractor.ExtractorJS.innerExtract(ExtractorJS.java:121)
	at org.archive.modules.extractor.ContentExtractor.extract(ContentExtractor.java:37)
	at org.archive.modules.extractor.Extractor.innerProcess(Extractor.java:102)
	at org.archive.modules.Processor.innerProcessResult(Processor.java:175)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.extractor.StringExtractorTestBase.testOne(StringExtractorTestBase.java:83)
	at org.archive.modules.extractor.StringExtractorTestBase.testExtraction(StringExtractorTestBase.java:62)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:226)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec
Running org.archive.modules.extractor.ExtractorCSSTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.modules.extractor.ExtractorDOCTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.extractor.ExtractorPDFTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.extractor.JerichoExtractorHTMLTest
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag frame at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c19,p18)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c57,p56) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c113,p112) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c172,p171) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c73,p72)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) has missing whitespace after quoted attribute value at position (r1,c118,p117)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c75,p74) missing required end tag
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c38,p37) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c66,p65) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 11:55:20 AM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.073 sec
Running org.archive.modules.extractor.ExtractorHTTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.AggressiveExtractorHTMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorSWFTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorUniversalTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorMultipleRegexTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.531 sec
Running org.archive.modules.extractor.ExtractorHTMLTest
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.033 sec
Running org.archive.modules.credential.CredentialStoreTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.credential.HttpAuthenticationCredentialTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.credential.HtmlFormCredentialTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.net.CrawlServerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.net.RobotstxtTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec
Running org.archive.modules.net.ServerCacheTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.net.RobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.net.FirstNamedRobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.CrawlHostTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.modules.forms.FormLoginProcessorTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.339 sec
Running org.archive.modules.recrawl.PersistLogProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.recrawl.PersistLoadProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.ContentDigestHistoryTest
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@51f49060
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@27eb3298
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@77cf3f8b
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@1df98368
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@f713686
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@5a62b2a4
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-jdk14/1.6.6/slf4j-jdk14-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
veebr 02, 2017 11:55:21 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@1556f2dd
veebr 02, 2017 11:55:21 AM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {request={numRecords=1, totalBytes=520, contentBytes=202, sizeOnDisk=10}, metadata={numRecords=1, totalBytes=370, contentBytes=62, sizeOnDisk=10}, response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, totals={numRecords=4, totalBytes=2017, contentBytes=802, sizeOnDisk=40}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}}
veebr 02, 2017 11:55:21 AM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@17ae98d7
veebr 02, 2017 11:55:21 AM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {request={numRecords=2, totalBytes=1040, contentBytes=404, sizeOnDisk=20}, metadata={numRecords=2, totalBytes=739, contentBytes=123, sizeOnDisk=20}, response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, revisit={numRecords=1, totalBytes=746, contentBytes=141, sizeOnDisk=10}, totals={numRecords=7, totalBytes=3652, contentBytes=1206, sizeOnDisk=70}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}}
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.978 sec
Running org.archive.modules.recrawl.FetchHistoryProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.PersistStoreProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.deciderules.HasViaDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.deciderules.ViaSurtPrefixedDecideRuleTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec
Running org.archive.modules.deciderules.MatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.deciderules.NotMatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.modules.deciderules.DecideRuleSequenceTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.deciderules.HopsPathMatchesRegexDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.modules.writer.WARCWriterProcessorTest
veebr 02, 2017 11:55:22 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=100
veebr 02, 2017 11:55:22 AM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:205)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:385)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:346)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:219)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:195)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest.testResilientOnError(WARCWriterProcessorTest.java:107)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:226)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 11:55:22 AM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:205)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:385)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:346)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:219)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:195)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest$2.run(WARCWriterProcessorTest.java:120)

veebr 02, 2017 11:55:22 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
warcsDir=/tmp/heritrix-junit-tests/WARCWriterProcessorTest-testStats
warc=/tmp/heritrix-junit-tests/WARCWriterProcessorTest-testStats/warcs/WEB-20170202095522767-00000-~~.warc.gz.open
stats={request={numRecords=1, totalBytes=510, contentBytes=202, sizeOnDisk=10}, metadata={numRecords=1, totalBytes=336, contentBytes=38, sizeOnDisk=10}, response={numRecords=1, totalBytes=416, contentBytes=147, sizeOnDisk=10}, totals={numRecords=4, totalBytes=1909, contentBytes=784, sizeOnDisk=40}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}}
veebr 02, 2017 11:55:22 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.719 sec
Running org.archive.modules.writer.MirrorWriterProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.writer.ARCWriterProcessorTest
veebr 02, 2017 11:55:22 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.fetcher.CookieFetchHTTPIntegrationTest
log4j:ERROR No layout set for the appender named [console].
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.238 sec
Running org.archive.modules.fetcher.FetchFTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.fetcher.FetchHTTPTest
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:09:55:24 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:09:55:24 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:09:55:24 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:09:55:24 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET /401-no-challenge HTTP/1.0" 401 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 57 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
95.153.20.212 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:24 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:24 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /if-modified-since HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /if-modified-since HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /if-none-match HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /if-none-match HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:26 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:26 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:28 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:28 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:28 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:29 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:29 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:29 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:29 +0000] "GET /chunked.txt HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /99% HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /??blahblah HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /cp1251 HTTP/1.0" 200 189 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /unsupported-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:31 +0000] "GET /invalid-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:31 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:32 +0000] "POST / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.408 sec
Running org.archive.modules.fetcher.CookieStoreTest
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@27d57a2c
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@834831b
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@76d05cc9
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@7428de63
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@38eb2c50
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@18eec010
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO: before: [[version: 0][name: name1][value: value1][domain: example.com][path: null][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: null][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: null][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: null][expiry: Mon May 29 06:42:12 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: null][expiry: null]]
veebr 02, 2017 11:55:32 AM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO:  after: [[version: 0][name: name1][value: value1][domain: example.com][path: /][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: /][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: /][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: /][expiry: Mon May 29 06:42:12 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: /][expiry: null]]
veebr 02, 2017 11:55:33 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@5b498842
veebr 02, 2017 11:55:42 AM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@2bef09c0
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.143 sec
Running org.archive.modules.fetcher.FetchDNSTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec

Results :

Tests run: 188, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix-modules ---
[INFO] Building jar: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/heritrix-modules-3.3.0-SNAPSHOT.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'engine' subproject 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix-engine ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 71 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-engine ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 135 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/target/classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/src/main/java/org/archive/crawler/framework/ToePool.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/src/main/java/org/archive/crawler/framework/ToePool.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix-engine ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-engine ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 54 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java uses or overrides a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/src/test/java/org/archive/crawler/prefetch/QuotaEnforcerTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-engine ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.modules.fetcher.FormAuthTest
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-jdk14/1.6.6/slf4j-jdk14-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1001)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:867)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:773)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:483)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:73)
	at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:270)
	at org.mortbay.log.Slf4jLog.<init>(Slf4jLog.java:31)
	at org.mortbay.log.Slf4jLog.<init>(Slf4jLog.java:26)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at java.lang.Class.newInstance(Class.java:442)
	at org.mortbay.log.Log.<clinit>(Log.java:68)
	at org.mortbay.component.Container.add(Container.java:200)
	at org.mortbay.component.Container.update(Container.java:164)
	at org.mortbay.component.Container.update(Container.java:106)
	at org.mortbay.jetty.Server.setConnectors(Server.java:160)
	at org.mortbay.jetty.Server.addConnector(Server.java:134)
	at org.archive.modules.fetcher.FormAuthTest.startHttpServers(FormAuthTest.java:271)
	at org.archive.modules.fetcher.FormAuthTest.testFormAuth(FormAuthTest.java:147)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:09:55:45 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FormAuthTest"
veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FormAuthTest testFormAuth
INFO: 
GET / HTTP/1.0
Connection: Close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host: localhost:7779
User-Agent: org.archive.modules.fetcher.FormAuthTest

abcdefghijklmnopqrstuvwxyz0123456789

veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FormAuthTest testFormAuth
INFO: 
GET /auth/1 HTTP/1.0
Connection: Close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host: localhost:7779
User-Agent: org.archive.modules.fetcher.FormAuthTest



HTTP/1.1 302 Found
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: JSESSIONID=lcwaahb39qf1wxjdxnd059ee;Path=/
Content-Length: 0
Location: http://localhost:7779/login.html;jsessionid=lcwaahb39qf1wxjdxnd059ee
Connection: close
Server: Jetty(6.1.26)


veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FormAuthTest testFormAuth
INFO: 
POST /j_security_check HTTP/1.0
Connection: Close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Content-Length: 56
Content-Type: application/x-www-form-urlencoded; charset=ISO-8859-1
Host: localhost:7779
User-Agent: org.archive.modules.fetcher.FormAuthTest
Cookie: JSESSIONID=lcwaahb39qf1wxjdxnd059ee

j_password=form-auth-password&j_username=form-auth-login

HTTP/1.1 302 Found
Content-Length: 0
Location: http://localhost:7779/auth/1
Connection: close
Server: Jetty(6.1.26)


veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - form-auth-login [02/veebr/2017:09:55:45 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FormAuthTest"
veebr 02, 2017 11:55:45 AM org.archive.modules.fetcher.FormAuthTest testFormAuth
INFO: 
GET /auth/1 HTTP/1.0
Connection: Close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host: localhost:7779
User-Agent: org.archive.modules.fetcher.FormAuthTest
Cookie: JSESSIONID=lcwaahb39qf1wxjdxnd059ee

abcdefghijklmnopqrstuvwxyz0123456789

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.46 sec
Running org.archive.crawler.selftest.CharsetSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:55:46 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:55:46 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:55:46 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:55:48 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095548
veebr 02, 2017 9:55:48 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:55:48 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095548
veebr 02, 2017 9:55:49 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:55:49 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095548
veebr 02, 2017 9:55:52 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:55:52 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095548
veebr 02, 2017 9:55:52 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095548
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/crawl-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/seeds-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/hosts-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/source-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/mimetype-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/responsecode-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/processors-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/frontier-summary-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/CharsetSelfTest/jobs/selftest-job/20170202095548/reports/threads-report.txt
veebr 02, 2017 9:55:54 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095548
veebr 02, 2017 9:55:54 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.538 sec
Running org.archive.crawler.selftest.RandomServletTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running org.archive.crawler.selftest.Precedence1SelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:55:57 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:55:57 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:55:57 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:55:58 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095558
veebr 02, 2017 9:55:59 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:55:59 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095558
veebr 02, 2017 9:56:00 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:56:00 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095558
veebr 02, 2017 9:56:07 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:56:07 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095558
veebr 02, 2017 9:56:07 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095558
veebr 02, 2017 9:56:08 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/crawl-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/seeds-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/hosts-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/source-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/mimetype-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/responsecode-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/processors-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/frontier-summary-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence1SelfTest/jobs/selftest-job/20170202095558/reports/threads-report.txt
veebr 02, 2017 9:56:09 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095558
veebr 02, 2017 9:56:09 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.632 sec
Running org.archive.crawler.selftest.Precedence3SelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:56:11 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:56:12 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:56:12 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:56:13 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095613
veebr 02, 2017 9:56:13 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:56:13 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095613
veebr 02, 2017 9:56:14 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:56:14 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095613
veebr 02, 2017 9:56:30 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:56:30 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095613
veebr 02, 2017 9:56:30 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095613
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/crawl-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/seeds-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/hosts-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/source-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/mimetype-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/responsecode-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/processors-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/frontier-summary-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence3SelfTest/jobs/selftest-job/20170202095613/reports/threads-report.txt
veebr 02, 2017 9:56:32 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095613
veebr 02, 2017 9:56:32 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
[http://127.0.0.1:7777/robots.txt, http://127.0.0.1:7777/H.html, http://127.0.0.1:7777/favicon.ico, http://127.0.0.1:7777/D.html, http://127.0.0.1:7777/L.html, http://127.0.0.1:7777/B.html, http://127.0.0.1:7777/F.html, http://127.0.0.1:7777/A.html, http://127.0.0.1:7777/C.html, http://127.0.0.1:7777/J.html, http://127.0.0.1:7777/I.html, http://127.0.0.1:7777/K.html, http://127.0.0.1:7777/N.html, http://127.0.0.1:7777/E.html, http://127.0.0.1:7777/G.html, http://127.0.0.1:7777/M.html, http://127.0.0.1:7777/O.html]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.607 sec
Running org.archive.crawler.selftest.SimpleSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:56:35 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:56:35 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:56:35 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:56:37 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095637
veebr 02, 2017 9:56:37 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:56:37 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095637
veebr 02, 2017 9:56:38 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:56:38 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095637
veebr 02, 2017 9:56:42 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:56:42 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095637
veebr 02, 2017 9:56:42 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095637
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/crawl-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/seeds-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/hosts-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/source-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/mimetype-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/responsecode-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/processors-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/frontier-summary-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/SimpleSelfTest/jobs/selftest-job/20170202095637/reports/threads-report.txt
veebr 02, 2017 9:56:44 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095637
veebr 02, 2017 9:56:44 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.705 sec
Running org.archive.crawler.selftest.MaxLinkHopsSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:56:47 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:56:47 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:56:47 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:56:48 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095648
veebr 02, 2017 9:56:48 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:56:48 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095648
veebr 02, 2017 9:56:49 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:56:49 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095648
veebr 02, 2017 9:56:53 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:56:53 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095648
veebr 02, 2017 9:56:53 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095648
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/crawl-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/seeds-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/hosts-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/source-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/mimetype-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/responsecode-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/processors-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/frontier-summary-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/MaxLinkHopsSelfTest/jobs/selftest-job/20170202095648/reports/threads-report.txt
veebr 02, 2017 9:56:55 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095648
veebr 02, 2017 9:56:55 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.118 sec
Running org.archive.crawler.selftest.FormLoginSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:56:58 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:56:58 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:56:58 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:56:59 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095659
veebr 02, 2017 9:57:00 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:00 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095659
veebr 02, 2017 9:57:01 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:01 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095659
UNREGISTERED FOR KRYO class java.util.LinkedList in class org.archive.modules.CrawlURI
UNREGISTERED FOR KRYO class org.archive.modules.forms.HTMLForm$NameValue in class org.archive.modules.CrawlURI
veebr 02, 2017 9:57:04 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:57:04 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095659
veebr 02, 2017 9:57:04 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095659
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/crawl-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/seeds-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/hosts-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/source-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/mimetype-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/responsecode-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/processors-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/frontier-summary-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormLoginSelfTest/jobs/selftest-job/20170202095659/reports/threads-report.txt
veebr 02, 2017 9:57:05 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095659
veebr 02, 2017 9:57:05 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.13 sec
Running org.archive.crawler.selftest.Precedence2SelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:57:08 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z

10 entries loaded
10 records imported from /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/rank.txt to BDB env /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/state
veebr 02, 2017 9:57:08 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:57:08 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:57:10 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095710
veebr 02, 2017 9:57:10 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:10 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095710
veebr 02, 2017 9:57:11 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:11 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095710
veebr 02, 2017 9:57:18 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:57:18 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095710
veebr 02, 2017 9:57:18 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095710
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/crawl-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/seeds-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/hosts-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/source-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/mimetype-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/responsecode-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/processors-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/frontier-summary-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence2SelfTest/jobs/selftest-job/20170202095710/reports/threads-report.txt
veebr 02, 2017 9:57:20 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095710
veebr 02, 2017 9:57:20 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.724 sec
Running org.archive.crawler.selftest.BackgroundImageExtractionSelfTestCase
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:57:23 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:57:23 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:57:23 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:57:24 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095724
veebr 02, 2017 9:57:25 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:25 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095724
veebr 02, 2017 9:57:26 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:26 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095724
veebr 02, 2017 9:57:29 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:57:29 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095724
veebr 02, 2017 9:57:29 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095724
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/crawl-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/seeds-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/hosts-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/source-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/mimetype-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/responsecode-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/processors-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/frontier-summary-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BackgroundImageExtractionSelfTestCase/jobs/selftest-job/20170202095724/reports/threads-report.txt
veebr 02, 2017 9:57:30 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095724
veebr 02, 2017 9:57:30 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.577 sec
Running org.archive.crawler.selftest.FormAuthSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:57:33 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:57:33 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:57:33 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:57:35 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095735
veebr 02, 2017 9:57:35 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:35 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095735
veebr 02, 2017 9:57:36 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:36 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095735
veebr 02, 2017 9:57:39 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:57:39 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095735
veebr 02, 2017 9:57:39 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095735
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/crawl-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/seeds-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/hosts-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/source-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/mimetype-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/responsecode-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/processors-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/frontier-summary-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FormAuthSelfTest/jobs/selftest-job/20170202095735/reports/threads-report.txt
veebr 02, 2017 9:57:41 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095735
veebr 02, 2017 9:57:41 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.567 sec
Running org.archive.crawler.selftest.FramesSelfTestCase
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:57:44 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:57:44 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:57:44 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:57:45 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095745
veebr 02, 2017 9:57:46 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:46 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095745
veebr 02, 2017 9:57:47 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:47 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095745
veebr 02, 2017 9:57:51 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:57:51 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095745
veebr 02, 2017 9:57:51 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095745
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/crawl-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/seeds-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/hosts-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/source-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/mimetype-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/responsecode-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/processors-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/frontier-summary-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/FramesSelfTestCase/jobs/selftest-job/20170202095745/reports/threads-report.txt
veebr 02, 2017 9:57:53 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095745
veebr 02, 2017 9:57:53 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.591 sec
Running org.archive.crawler.selftest.HttpAuthSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:57:55 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:57:56 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:57:56 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:57:57 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095757
veebr 02, 2017 9:57:57 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:57:57 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095757
veebr 02, 2017 9:57:58 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:57:58 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095757
veebr 02, 2017 9:58:02 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:58:02 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095757
veebr 02, 2017 9:58:02 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095757
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/crawl-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/seeds-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/hosts-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/source-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/mimetype-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/responsecode-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/processors-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/frontier-summary-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/HttpAuthSelfTest/jobs/selftest-job/20170202095757/reports/threads-report.txt
veebr 02, 2017 9:58:04 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095757
veebr 02, 2017 9:58:04 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.573 sec
Running org.archive.crawler.selftest.StatisticsSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:58:07 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:58:07 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:58:07 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:58:09 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095809
veebr 02, 2017 9:58:09 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:58:09 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
veebr 02, 2017 9:58:09 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095809
veebr 02, 2017 9:58:10 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:58:10 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095809
veebr 02, 2017 9:58:17 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:58:17 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095809
veebr 02, 2017 9:58:17 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095809
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/crawl-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/seeds-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/hosts-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/source-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/mimetype-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/responsecode-report.txt
veebr 02, 2017 9:58:19 AM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {request={numRecords=13, totalBytes=8021, contentBytes=3824, sizeOnDisk=130}, metadata={numRecords=13, totalBytes=7512, contentBytes=3432, sizeOnDisk=130}, response={numRecords=13, totalBytes=17147, contentBytes=12669, sizeOnDisk=130}, totals={numRecords=40, totalBytes=33417, contentBytes=20386, sizeOnDisk=400}, warcinfo={numRecords=1, totalBytes=737, contentBytes=461, sizeOnDisk=10}}
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/processors-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/frontier-summary-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/StatisticsSelfTest/jobs/selftest-job/20170202095809/reports/threads-report.txt
veebr 02, 2017 9:58:19 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095809
veebr 02, 2017 9:58:19 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.561 sec <<< FAILURE!
Running org.archive.crawler.selftest.Precedence4SelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:58:22 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:58:22 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:58:22 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:58:23 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095823
veebr 02, 2017 9:58:23 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:58:23 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095823
veebr 02, 2017 9:58:24 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:58:24 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095823
veebr 02, 2017 9:58:30 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:58:30 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095823
veebr 02, 2017 9:58:30 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095823
veebr 02, 2017 9:58:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/crawl-report.txt
veebr 02, 2017 9:58:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/seeds-report.txt
veebr 02, 2017 9:58:32 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/hosts-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/source-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/mimetype-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/responsecode-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/processors-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/frontier-summary-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/Precedence4SelfTest/jobs/selftest-job/20170202095823/reports/threads-report.txt
veebr 02, 2017 9:58:33 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095823
veebr 02, 2017 9:58:33 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.063 sec
Running org.archive.crawler.selftest.BadURIsStopPageParsingSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:58:36 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:58:36 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:58:36 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:58:37 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095837
veebr 02, 2017 9:58:37 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:58:37 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095837
veebr 02, 2017 9:58:38 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:58:38 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095837
veebr 02, 2017 9:58:44 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:58:44 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095837
veebr 02, 2017 9:58:44 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095837
veebr 02, 2017 9:58:46 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/crawl-report.txt
veebr 02, 2017 9:58:46 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/seeds-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/hosts-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/source-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/mimetype-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/responsecode-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/processors-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/frontier-summary-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/BadURIsStopPageParsingSelfTest/jobs/selftest-job/20170202095837/reports/threads-report.txt
veebr 02, 2017 9:58:47 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095837
veebr 02, 2017 9:58:47 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.591 sec
Running org.archive.crawler.selftest.UserAgentSelfTest
Oracle Corporation Java(TM) SE Runtime Environment 1.8.0_121-b13
Using ad-hoc HTTPS certificate with fingerprint...
SHA1:C4:CE:69:14:B6:63:70:F0:9E:7C:E9:E3:59:A6:C8:87:76:F7:7C:DF
Verify in browser before accepting exception.
veebr 02, 2017 9:58:49 AM org.archive.crawler.framework.Engine addJobDirectory
INFO: added crawl job: selftest-job
engine listening at port 8443
operator login set per command-line
Heritrix version: 3.3.0-SNAPSHOT-2017-02-02T09:49:44Z
veebr 02, 2017 9:58:49 AM org.archive.crawler.framework.CrawlJob instantiateContainer
INFO: Job instantiated
veebr 02, 2017 9:58:49 AM org.archive.crawler.framework.CrawlJob launch
INFO: Job launched
veebr 02, 2017 9:58:51 AM org.archive.spring.PathSharingContext initLaunchId
INFO: launch id 20170202095851
veebr 02, 2017 9:58:51 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
veebr 02, 2017 9:58:51 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: PREPARING 20170202095851
veebr 02, 2017 9:58:52 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl running.
veebr 02, 2017 9:58:52 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: RUNNING 20170202095851
Connection=Close
Accept=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host=127.0.0.1:7777
User-Agent=Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-2017-02-02T09:49:44Z +http://crawler.archive.org/selftestcrawl)
Connection=Close
Accept=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host=127.0.0.1:7777
User-Agent=Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-2017-02-02T09:49:44Z +http://crawler.archive.org/selftestcrawl)
Connection=Close
Referer=http://127.0.0.1:7777/robots.txt
Accept=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Host=127.0.0.1:7777
User-Agent=Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-2017-02-02T09:49:44Z +http://crawler.archive.org/selftestcrawl)
veebr 02, 2017 9:58:54 AM org.archive.crawler.framework.CrawlController noteFrontierState
INFO: Crawl empty.
veebr 02, 2017 9:58:54 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: STOPPING 20170202095851
veebr 02, 2017 9:58:54 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: EMPTY 20170202095851
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/crawl-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/seeds-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/hosts-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/source-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/mimetype-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/responsecode-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/processors-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/frontier-summary-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.reporting.StatisticsTracker writeReportFile
INFO: wrote report: /tmp/heritrix-junit-tests/selftest/UserAgentSelfTest/jobs/selftest-job/20170202095851/reports/threads-report.txt
veebr 02, 2017 9:58:56 AM org.archive.crawler.framework.CrawlJob onApplicationEvent
INFO: FINISHED 20170202095851
veebr 02, 2017 9:58:56 AM org.archive.crawler.frontier.AbstractFrontier crawlEnded
INFO: Closing with 0 urls still in queue.
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.541 sec
Running org.archive.crawler.selftest.CheckpointSelfTest
log4j:ERROR No layout set for the appender named [console].
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
java.lang.NullPointerException
	at org.archive.crawler.selftest.CheckpointSelfTest.stopHttpServer(CheckpointSelfTest.java:65)
	at org.archive.crawler.selftest.SelfTestBase.close(SelfTestBase.java:143)
	at org.archive.crawler.selftest.SelfTestBase.testSomething(SelfTestBase.java:156)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.018 sec <<< FAILURE!
Running org.archive.crawler.prefetch.RuntimeLimitEnforcerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec
Running org.archive.crawler.prefetch.QuotaEnforcerTest
Tests run: 13, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 0.457 sec <<< FAILURE!
Running org.archive.crawler.prefetch.PreconditionEnforcerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running org.archive.crawler.prefetch.PreselectorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.crawler.framework.EngineTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.crawler.framework.CrawlControllerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.crawler.framework.CrawlLimitEnforcerTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.crawler.restlet.ScriptingConsoleTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.388 sec
Running org.archive.crawler.restlet.XmlMarshallerTest
<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


<?xml version="1.0" standalone='yes'?>

<doc>
  <c>1</c>
  <a>a-value</a>
  <m>
    <x>10</x>
    <y>y-value</y>
  </m>
</doc>


Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 sec
Running org.archive.crawler.postprocessor.LowDiskPauseProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.crawler.postprocessor.SupplementaryLinksScoperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec
Running org.archive.crawler.datamodel.CandidateURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running org.archive.crawler.datamodel.CrawlURITest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.crawler.util.TopNSetTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.crawler.util.BdbUriUniqFilterTest
veebr 02, 2017 9:59:00 AM org.archive.crawler.util.BdbUriUniqFilterTest testWriting
INFO: Looking for override system property org.archive.crawler.util.BdbUriUniqFilterTest.maxcount
veebr 02, 2017 9:59:00 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Added 1000 in 34
veebr 02, 2017 9:59:00 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Added random 9 in 0
veebr 02, 2017 9:59:00 AM org.archive.crawler.util.BdbUriUniqFilterTest runTestWriting
INFO: Deleted random 9 in 0
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 4 urls from scheme+authority of url http://forgetme.com (leaving 2 urls from other scheme+authorities)
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 1 urls from scheme+authority of url https://forgetme.com/extra-stuff-ignored (leaving 1 urls from other scheme+authorities)
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.BdbUriUniqFilter forgetAllSchemeAuthorityMatching
INFO: forgot 1 urls from scheme+authority of url http://forgetme.com:90/ (leaving 0 urls from other scheme+authorities)
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.953 sec
Running org.archive.crawler.util.FPUriUniqFilterTest
veebr 02, 2017 9:59:01 AM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Added 1000 in 16
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Added random 9 in 0
veebr 02, 2017 9:59:01 AM org.archive.crawler.util.FPUriUniqFilterTest testWriting
INFO: Deleted random 9 in 0
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec
Running org.archive.crawler.util.BloomUriUniqFilterTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.135 sec
Running org.archive.crawler.processor.HashCrawlMapperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
Running org.archive.crawler.processor.LexicalCrawlMapperTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.frontier.BdbMultipleWorkQueuesTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.frontier.BdbFrontierTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.crawler.frontier.FrontierJournalTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.crawler.frontier.precedence.BaseQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.crawler.frontier.precedence.SuccessCountsQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.crawler.frontier.precedence.HopsUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.crawler.frontier.precedence.BaseUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.crawler.frontier.precedence.CostUriPrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.crawler.frontier.precedence.HighestUriQueuePrecedencePolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.crawler.frontier.BucketQueueAssignmentPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec

Results :

Failed tests:   testSomething(org.archive.crawler.selftest.StatisticsSelfTest): expected:<9727> but was:<9728>

Tests in error: 
  testSomething(org.archive.crawler.selftest.CheckpointSelfTest)
  testServerNovelKbForceRetire(org.archive.crawler.prefetch.QuotaEnforcerTest): Java heap space
  testSerializationIfAppropriate(org.archive.crawler.prefetch.QuotaEnforcerTest): Java heap space

Tests run: 88, Failures: 1, Errors: 3, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Heritrix 3 ......................................... SUCCESS [  0.004 s]
[INFO] Heritrix 3: 'commons' subproject (utility classes) . SUCCESS [05:33 min]
[INFO] Heritrix 3: 'modules' subproject (reusable components) SUCCESS [ 25.674 s]
[INFO] Heritrix 3: 'engine' subproject .................... FAILURE [03:18 min]
[INFO] Heritrix 3 (distribution bundles) .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:17 min
[INFO] Finished at: 2017-02-02T11:59:01+02:00
[INFO] Final Memory: 36M/386M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project heritrix-engine: There are test failures.
[ERROR] 
[ERROR] Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/engine/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :heritrix-engine
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ date
N veebr  2 11:59:12 EET 2017
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ mvn -version
Apache Maven 3.3.9 (NON-CANONICAL_2016-12-13T22:49:44+02:00_mmmv; 2016-12-13T22:49:44+02:00)
Maven home: /home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9
Java version: 1.8.0_121, vendor: Oracle Corporation
Java home: /home/se_dynamicsearchengine_01/OracleJava/jdk_v_1_8_0_u121/jre
Default locale: et_EE, platform encoding: UTF-8
OS name: "linux", version: "3.16.0-4-amd64", arch: "amd64", family: "unix"
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ free
             total       used       free     shared    buffers     cached
Mem:       8197820    4679628    3518192      11556     322396    1709764
-/+ buffers/cache:    2647468    5550352
Swap:      7977980    1276068    6701912
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ uname -a
Linux mvahi 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ java -version
java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ echo $JAVA_HOME
/home/se_dynamicsearchengine_01/OracleJava/jdk_v_1_8_0_u121
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ echo $M2
/home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ which mvn
/home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9/bin/mvn
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ date
N veebr  2 11:59:49 EET 2017
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ df
Failisüsteem   1K-blokke     Kasut      Vaba Kas% Haagitud
/dev/sda1        9480420   7832504   1143292  88% /
udev               10240         0     10240   0% /dev
tmpfs            1639564      8864   1630700   1% /run
tmpfs            4098908         4   4098904   1% /dev/shm
tmpfs               5120         0      5120   0% /run/lock
tmpfs            4098908         0   4098908   0% /sys/fs/cgroup
/dev/sda6      188824364 156934452  22275116  88% /home
/dev/sdb1      961301000 281650908 630795708  31% /opt/hdd_01_for_large_files
tmpfs             819784         0    819784   0% /run/user/1000
tmpfs             819784         0    819784   0% /run/user/1001
tmpfs             819784         0    819784   0% /run/user/1009
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ ls -l
kokku 32
drwxr-xr-x 4 se_dynamicsearchengine_01 se_dynamicsearchengine_01  4096 veebr  2 11:49 commons
drwxr-xr-x 3 se_dynamicsearchengine_01 se_dynamicsearchengine_01  4096 veebr  2 11:49 contrib
drwxr-xr-x 3 se_dynamicsearchengine_01 se_dynamicsearchengine_01  4096 veebr  2 11:49 dist
drwxr-xr-x 5 se_dynamicsearchengine_01 se_dynamicsearchengine_01  4096 veebr  2 11:55 engine
drwxr-xr-x 4 se_dynamicsearchengine_01 se_dynamicsearchengine_01  4096 veebr  2 11:55 modules
-rw-r--r-- 1 se_dynamicsearchengine_01 se_dynamicsearchengine_01 11001 veebr  2 11:49 pom.xml
lrwxrwxrwx 1 se_dynamicsearchengine_01 se_dynamicsearchengine_01    15 veebr  2 11:49 README.md -> dist/README.txt
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ whoami
se_dynamicsearchengine_01
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$

from heritrix3.

martinvahi commented on June 10, 2024

Sorry, I forgot that I'm supposed to bootstrap with Java 7, not Java 8. I'll post the new console output, the one with the Java 7 in a moment.

On the other hand, it is also a flaw that it tries to bootstrap it with Java 8 at all, if it requires Java 7 for bootstrapping. It should just throw an exception with an error message saying that Java 7 is required, and stop right there in stead of trying to build it with Java 8.

from heritrix3.

martinvahi commented on June 10, 2024

No luck with the Java 7 either.

se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls
heritrix3
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ rm -fr ./*
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ java -version
java version "1.7.0_76"
Java(TM) SE Runtime Environment (build 1.7.0_76-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.76-b04, mixed mode)
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ mvn -version 
Apache Maven 3.3.9 (NON-CANONICAL_2016-12-13T22:49:44+02:00_mmmv; 2016-12-13T22:49:44+02:00)
Maven home: /home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9
Java version: 1.7.0_76, vendor: Oracle Corporation
Java home: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/Java_7/jdk_v_1_7_0_u76/jre
Default locale: et_EE, platform encoding: UTF-8
OS name: "linux", version: "3.16.0-4-amd64", arch: "amd64", family: "unix"
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ git clone --recursive https://github.com/internetarchive/heritrix3.git
Cloning into 'heritrix3'...
remote: Counting objects: 26097, done.
remote: Total 26097 (delta 0), reused 0 (delta 0), pack-reused 26097
Receiving objects: 100% (26097/26097), 9.14 MiB | 2.29 MiB/s, done.
Resolving deltas: 100% (10176/10176), done.
Checking connectivity... done.
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ ls 
heritrix3
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01$ cd heritrix3/
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ ls
commons  contrib  dist  engine  modules  pom.xml  README.md
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ date
N veebr  2 12:10:11 EET 2017
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ free
             total       used       free     shared    buffers     cached
Mem:       8197820    4669768    3528052      11564     323768    1701044
-/+ buffers/cache:    2644956    5552864
Swap:      7977980    1276060    6701920
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ df
Failisüsteem   1K-blokke     Kasut      Vaba Kas% Haagitud
/dev/sda1        9480420   7832504   1143292  88% /
udev               10240         0     10240   0% /dev
tmpfs            1639564      8864   1630700   1% /run
tmpfs            4098908         4   4098904   1% /dev/shm
tmpfs               5120         0      5120   0% /run/lock
tmpfs            4098908         0   4098908   0% /sys/fs/cgroup
/dev/sda6      188824364 156934452  22275116  88% /home
/dev/sdb1      961301000 281645512 630801104  31% /opt/hdd_01_for_large_files
tmpfs             819784         0    819784   0% /run/user/1000
tmpfs             819784         0    819784   0% /run/user/1001
tmpfs             819784         0    819784   0% /run/user/1009
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ nice -n20 mvn package
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] Heritrix 3
[INFO] Heritrix 3: 'commons' subproject (utility classes)
[INFO] Heritrix 3: 'modules' subproject (reusable components)
[INFO] Heritrix 3: 'engine' subproject
[INFO] Heritrix 3 (distribution bundles)
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The artifact poi:poi:jar:2.5.1 has been relocated to poi:poi:jar:2.5.1-final-20040804
[WARNING] The artifact itext:itext:jar:1.3 has been relocated to com.lowagie:itext:jar:1.3
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 77 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/IdentityCacheableWrapper.java:[7,63] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,28] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,67] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Recompile with -Xlint:deprecation for details.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java uses unchecked or unsafe operations.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 37 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-commons ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.bdb.StoredQueueTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.9 sec
Running org.archive.surt.SURTTokenizerTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:93)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:191)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1006)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.apache.log4j.Logger.getLogger(Logger.java:104)
	at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
	at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
	at org.apache.commons.httpclient.util.EncodingUtil.<clinit>(EncodingUtil.java:54)
	at org.apache.commons.httpclient.URI.decode(URI.java:1773)
	at org.apache.commons.httpclient.URI.decode(URI.java:1731)
	at org.apache.commons.httpclient.URI.getAuthority(URI.java:2725)
	at org.archive.surt.SURTTokenizer.getKey(SURTTokenizer.java:151)
	at org.archive.surt.SURTTokenizer.<init>(SURTTokenizer.java:60)
	at org.archive.surt.SURTTokenizerTest.toSurtT(SURTTokenizerTest.java:177)
	at org.archive.surt.SURTTokenizerTest.testSimple(SURTTokenizerTest.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec
Running org.archive.settings.file.BdbModuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.723 sec
Running org.archive.settings.file.PrefixFinderTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 sec
Running org.archive.util.FileUtilsTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.221 sec
Running org.archive.util.PaddingStringBufferTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.util.ObjectIdentityBdbCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 10
veebr 02, 2017 12:10:42 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 expungePuts=0 syncs=0
level to 20
veebr 02, 2017 12:10:47 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2621440 diskHits=131072 supplieds=131072 expungePuts=131086 syncs=0
level to 30
veebr 02, 2017 12:10:52 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 93%, gets=4194304 memHits=3801088 diskHits=262144 supplieds=131072 expungePuts=262151 syncs=0
level to 40
veebr 02, 2017 12:10:57 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=5505024 memHits=4980736 diskHits=393216 supplieds=131072 expungePuts=393281 syncs=0
level to 50
veebr 02, 2017 12:11:01 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 92%, gets=6815744 memHits=6160384 diskHits=524288 supplieds=131072 expungePuts=524445 syncs=0
level to 60
veebr 02, 2017 12:11:05 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBCT:DB name:consistencyCache,  hit%: 91%, gets=8126464 memHits=7340032 diskHits=655360 supplieds=131072 expungePuts=655835 syncs=0
OIBCT:DB name:consistencyCache,  hit%: 90%, gets=8519680 memHits=7602176 diskHits=786432 supplieds=131072 expungePuts=786432 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 12:11:12 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
veebr 02, 2017 12:11:13 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
10000,0
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.865 sec
Running org.archive.util.PropertyUtilsTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.util.SURTTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.util.UriUtilsTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Running org.archive.util.fingerprint.MemLongFPSetTest
veebr 02, 2017 12:11:16 PM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.util.fingerprint.LongFPSetCacheTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec
Running org.archive.util.fingerprint.ArrayLongFPCacheTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.util.MimetypeUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.util.SurtPrefixSetTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.util.anvl.ANVLRecordTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.util.BloomFilter64bitTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.548 sec
Running org.archive.util.LongToIntConsistentHashTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.311 sec
Running org.archive.util.ms.PieceReaderTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.util.ms.DocTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec
Running org.archive.util.TextUtilsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.util.ObjectIdentityBdbManualCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
level to 0
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=262144 memHits=131072 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=121072 syncs=0
level to 10
veebr 02, 2017 12:13:34 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 961 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 100%, gets=1572864 memHits=1441792 diskHits=0 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=1431792 syncs=0
level to 20
veebr 02, 2017 12:13:57 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 95%, gets=2883584 memHits=2631440 diskHits=121072 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=2742512 syncs=0
level to 30
veebr 02, 2017 12:14:21 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 94%, gets=4194304 memHits=3821088 diskHits=242144 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=4053232 syncs=0
level to 40
veebr 02, 2017 12:14:44 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 93%, gets=5505024 memHits=5010736 diskHits=363216 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=5363952 syncs=0
level to 50
veebr 02, 2017 12:15:07 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 92%, gets=6815744 memHits=6200384 diskHits=484288 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=6674672 syncs=0
level to 60
veebr 02, 2017 12:15:31 PM org.archive.util.TestUtils forceScarceMemory
INFO: forcing scarce memory via 954 1MB blocks
OIBMCT:DB name:consistencyCache,  hit%: 92%, gets=8126464 memHits=7390032 diskHits=605360 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=7985392 syncs=0
OIBMCT:DB name:consistencyCache,  hit%: 91%, gets=8519680 memHits=7662176 diskHits=726432 supplieds=131072 inMemItems=131072 dirtyItems=10000 evictions=8378608 syncs=0
UNREGISTERED FOR KRYO class java.util.HashMap in class org.archive.util.IdentityCacheableWrapper
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 149.911 sec
Running org.archive.io.SinkHandlerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.BufferedSeekInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.arc.ARCReaderFactoryTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec
Running org.archive.io.arc.ARCWriterPoolTest
veebr 02, 2017 12:15:40 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
veebr 02, 2017 12:15:41 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.708 sec
Running org.archive.io.arc.ARCWriterTest
veebr 02, 2017 12:15:41 PM org.archive.util.DevUtils warnHandle
WARNING: java.lang.Throwable: Gap between expected and actual: -1
 writing arc /tmp/heritrix-junit-tests/testGapError-JUNIT.arc.gz.open
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:398)
	at org.archive.io.arc.ARCWriter.write(ARCWriter.java:357)
	at org.archive.io.arc.ARCWriterTest.testGapError(ARCWriterTest.java:522)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.079 sec
Running org.archive.io.warc.WARCWriterTest
veebr 02, 2017 12:15:41 PM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/ /index.html
java.lang.IllegalArgumentException: Contains disallowed white space 0x20: http://www.archive.org/test/ /index.html
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:148)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testSpaceInURL(WARCWriterTest.java:423)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 12:15:41 PM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/	/index.html
java.lang.IllegalArgumentException: Contains illegal character 0x9: http://www.archive.org/test/	/index.html
	at org.archive.io.warc.WARCWriter.baseCharacterCheck(WARCWriter.java:137)
	at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:146)
	at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
	at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
	at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
	at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
	at org.archive.io.warc.WARCWriterTest.testTabInURL(WARCWriterTest.java:428)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec
Running org.archive.io.HeaderedArchiveRecordTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.io.RepositionableInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.RecordingInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.12 sec
Running org.archive.io.ArchiveTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.io.ArchiveReaderFactoryTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.io.ReplayCharSequenceTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.383 sec
Running org.archive.uid.UUIDGeneratorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec

Results :

Tests run: 165, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ heritrix-commons ---
[INFO] Building jar: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/commons/target/heritrix-commons-3.3.0-SNAPSHOT.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'modules' subproject (reusable components) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 51 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 166 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/main/java/org/archive/modules/writer/ARCWriterProcessor.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ heritrix-modules ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-modules ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 56 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java uses or overrides a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/src/test/java/org/archive/modules/extractor/ExtractorCSSTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-modules ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.modules.canonicalize.StripWWWNRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec
Running org.archive.modules.canonicalize.LowercaseRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.canonicalize.StripSessionCFIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.canonicalize.RulesCanonicalizationPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
Running org.archive.modules.canonicalize.FixupQueryStringTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.canonicalize.StripSessionIDsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.modules.canonicalize.StripUserinfoRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.canonicalize.StripWWWRuleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.canonicalize.RegexRuleTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.ScriptedProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec
Running org.archive.modules.extractor.HTTPContentDigestTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorImpliedURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.extractor.ExtractorXMLTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.047 sec
Running org.archive.modules.extractor.ExtractorJSTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:191)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1001)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:867)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:773)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:483)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.apache.log4j.Logger.getLogger(Logger.java:104)
	at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
	at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
	at org.apache.commons.httpclient.util.EncodingUtil.<clinit>(EncodingUtil.java:54)
	at org.apache.commons.httpclient.URI.decode(URI.java:1773)
	at org.apache.commons.httpclient.URI.decode(URI.java:1731)
	at org.apache.commons.httpclient.URI.getHost(URI.java:2793)
	at org.archive.url.UsableURI.getHost(UsableURI.java:351)
	at org.archive.util.UriUtils.speculativeFixup(UriUtils.java:345)
	at org.archive.modules.extractor.ExtractorJS.considerString(ExtractorJS.java:174)
	at org.archive.modules.extractor.ExtractorJS.considerStrings(ExtractorJS.java:155)
	at org.archive.modules.extractor.ExtractorJS.considerStrings(ExtractorJS.java:134)
	at org.archive.modules.extractor.ExtractorJS.innerExtract(ExtractorJS.java:121)
	at org.archive.modules.extractor.ContentExtractor.extract(ContentExtractor.java:37)
	at org.archive.modules.extractor.Extractor.innerProcess(Extractor.java:102)
	at org.archive.modules.Processor.innerProcessResult(Processor.java:175)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.extractor.StringExtractorTestBase.testOne(StringExtractorTestBase.java:83)
	at org.archive.modules.extractor.StringExtractorTestBase.testExtraction(StringExtractorTestBase.java:62)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:226)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec
Running org.archive.modules.extractor.ExtractorCSSTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
Running org.archive.modules.extractor.ExtractorDOCTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorPDFTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.JerichoExtractorHTMLTest
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag frame at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c19,p18)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c57,p56) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c113,p112) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c172,p171) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c73,p72)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) has missing whitespace after quoted attribute value at position (r1,c118,p117)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c75,p74) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c75,p74) missing required end tag
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c38,p37) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c66,p65) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r6,c5,p438) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) has missing whitespace after quoted attribute value at position (r1,c34,p33)
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag a at (r1,c1,p0) contains a '/' character before the closing '>', which is ignored because tags of this name cannot be empty-element tags
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
veebr 02, 2017 12:15:54 PM au.id.jericho.lib.html.LoggerProviderJava$JavaLogger info
INFO: StartTag at (r1,c1,p0) missing required end tag
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 sec
Running org.archive.modules.extractor.ExtractorHTTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.AggressiveExtractorHTMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorSWFTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.extractor.ExtractorURITest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.extractor.ExtractorUniversalTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.extractor.ExtractorMultipleRegexTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.693 sec
Running org.archive.modules.extractor.ExtractorHTMLTest
comparing: http://www.anotherexample.com/ and https://www.anotherexample.com/
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
Running org.archive.modules.credential.CredentialStoreTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.credential.HttpAuthenticationCredentialTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.credential.HtmlFormCredentialTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.CrawlServerTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.RobotstxtTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
Running org.archive.modules.net.ServerCacheTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.net.RobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.net.FirstNamedRobotsPolicyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.net.CrawlHostTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
Running org.archive.modules.forms.FormLoginProcessorTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.14 sec
Running org.archive.modules.recrawl.PersistLogProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
Running org.archive.modules.recrawl.PersistLoadProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.ContentDigestHistoryTest
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@972141f
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@1dd6bc36
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@21740433
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@47bfc16d
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest bdb
INFO: created org.archive.bdb.BdbModule@3fce8b57
veebr 02, 2017 12:15:55 PM org.archive.modules.recrawl.ContentDigestHistoryTest historyStore
INFO: created org.archive.modules.recrawl.BdbContentDigestHistory@7e31c78a
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/se_dynamicsearchengine_01/.m2/repository/org/slf4j/slf4j-jdk14/1.6.6/slf4j-jdk14-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
veebr 02, 2017 12:15:55 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
veebr 02, 2017 12:15:56 PM org.archive.modules.recrawl.ContentDigestHistoryTest loader
INFO: created org.archive.modules.recrawl.ContentDigestHistoryLoader@139819d6
veebr 02, 2017 12:15:56 PM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}, request={numRecords=1, totalBytes=520, contentBytes=202, sizeOnDisk=10}, totals={numRecords=4, totalBytes=2018, contentBytes=803, sizeOnDisk=40}, metadata={numRecords=1, totalBytes=371, contentBytes=63, sizeOnDisk=10}}
veebr 02, 2017 12:15:56 PM org.archive.modules.recrawl.ContentDigestHistoryTest storer
INFO: created org.archive.modules.recrawl.ContentDigestHistoryStorer@4183422d
veebr 02, 2017 12:15:56 PM org.archive.modules.writer.WARCWriterProcessor report
INFO: final stats: {response={numRecords=1, totalBytes=480, contentBytes=141, sizeOnDisk=10}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}, revisit={numRecords=1, totalBytes=746, contentBytes=141, sizeOnDisk=10}, request={numRecords=2, totalBytes=1040, contentBytes=404, sizeOnDisk=20}, totals={numRecords=7, totalBytes=3653, contentBytes=1207, sizeOnDisk=70}, metadata={numRecords=2, totalBytes=740, contentBytes=124, sizeOnDisk=20}}
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.926 sec
Running org.archive.modules.recrawl.FetchHistoryProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.recrawl.PersistStoreProcessorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.deciderules.HasViaDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.deciderules.ViaSurtPrefixedDecideRuleTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.archive.modules.deciderules.MatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.modules.deciderules.NotMatchesStatusCodeDecideRuleTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
Running org.archive.modules.deciderules.DecideRuleSequenceTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.deciderules.HopsPathMatchesRegexDecideRuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.writer.WARCWriterProcessorTest
veebr 02, 2017 12:15:56 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=100
veebr 02, 2017 12:15:56 PM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:205)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:385)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:346)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:219)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:195)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest.testResilientOnError(WARCWriterProcessorTest.java:107)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at org.archive.state.ModuleTestBase.runTest(ModuleTestBase.java:226)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

veebr 02, 2017 12:15:57 PM org.archive.modules.writer.WARCWriterProcessor innerProcessResult
SEVERE: Failed write of Records: http://test.com/
java.io.IOException: pretend no space left on device
	at org.archive.modules.writer.WARCWriterProcessorTest$FailWARCWriter.writeRecord(WARCWriterProcessorTest.java:205)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:385)
	at org.archive.io.warc.WARCWriter.writeWarcinfoRecord(WARCWriter.java:346)
	at org.archive.io.warc.WARCWriter.createFile(WARCWriter.java:129)
	at org.archive.io.WriterPoolMember.createFile(WriterPoolMember.java:204)
	at org.archive.io.WriterPoolMember.checkSize(WriterPoolMember.java:180)
	at org.archive.modules.writer.WARCWriterProcessor.write(WARCWriterProcessor.java:219)
	at org.archive.modules.writer.WARCWriterProcessor.innerProcessResult(WARCWriterProcessor.java:195)
	at org.archive.modules.Processor.process(Processor.java:142)
	at org.archive.modules.writer.WARCWriterProcessorTest$2.run(WARCWriterProcessorTest.java:120)

veebr 02, 2017 12:15:57 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
warcsDir=/tmp/heritrix-junit-tests/WARCWriterProcessorTest-testStats
warc=/tmp/heritrix-junit-tests/WARCWriterProcessorTest-testStats/warcs/WEB-20170202101557623-00000-~~.warc.gz.open
stats={response={numRecords=1, totalBytes=416, contentBytes=147, sizeOnDisk=10}, warcinfo={numRecords=1, totalBytes=647, contentBytes=397, sizeOnDisk=10}, request={numRecords=1, totalBytes=510, contentBytes=202, sizeOnDisk=10}, totals={numRecords=4, totalBytes=1909, contentBytes=784, sizeOnDisk=40}, metadata={numRecords=1, totalBytes=336, contentBytes=38, sizeOnDisk=10}}
veebr 02, 2017 12:15:57 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=1000000000, maxActive=1, maxWait=500
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.034 sec
Running org.archive.modules.writer.MirrorWriterProcessorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.writer.ARCWriterProcessorTest
veebr 02, 2017 12:15:57 PM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=WEB, template=${prefix}-${timestamp17}-${serialno}-${heritrix.pid}~${heritrix.hostname}~${heritrix.port}, compress=true, maxSize=100000000, maxActive=1, maxWait=500
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
Running org.archive.modules.fetcher.CookieFetchHTTPIntegrationTest
log4j:ERROR No layout set for the appender named [console].
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.16 sec
Running org.archive.modules.fetcher.FetchFTPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.archive.modules.fetcher.FetchHTTPTest
veebr 02, 2017 12:15:59 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:15:59 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:15:59 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:15:59 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:15:59 +0000] "GET /200k HTTP/1.0" 200 200000 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:01 +0000] "GET /if-modified-since HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:01 +0000] "GET /if-modified-since HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:01 +0000] "GET /if-none-match HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:01 +0000] "GET /if-none-match HTTP/1.0" 304 0 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:01 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:03 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:03 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:03 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:03 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:03 +0000] "GET / HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:03 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:03 +0000] "GET /chunked.txt HTTP/1.1" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:05 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:05 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:05 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:05 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /99% HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /??blahblah HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /url%20with%20spaces?query%20with%20spaces HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /cp1251 HTTP/1.0" 200 189 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /unsupported-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:06 +0000] "GET /invalid-charset HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:06 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "example.com" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "POST / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET /set-cookie HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:10:16:07 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - basic-auth-login [02/veebr/2017:10:16:07 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:10:16:07 +0000] "GET /auth/1 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 - digest-auth-login [02/veebr/2017:10:16:07 +0000] "GET /auth/2 HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET /401-no-challenge HTTP/1.0" 401 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 57 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
95.153.20.212 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
127.0.0.1 -  -  [02/veebr/2017:10:16:07 +0000] "GET / HTTP/1.0" 200 37 "-" "org.archive.modules.fetcher.FetchHTTPTests"
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.FetchHTTPRequest$ServerCacheResolver resolve
INFO: host "localhost" is not in serverCache, allowing java to resolve it
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.728 sec
Running org.archive.modules.fetcher.CookieStoreTest
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@1f300e3d
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@5d42f5b7
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@25bde0f0
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@6b326556
veebr 02, 2017 12:16:07 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@5f3f0bb0
veebr 02, 2017 12:16:08 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@36632125
veebr 02, 2017 12:16:08 PM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO: before: [[version: 0][name: name1][value: value1][domain: example.com][path: null][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: null][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: null][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: null][expiry: Mon May 29 07:02:48 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: null][expiry: null]]
veebr 02, 2017 12:16:08 PM org.archive.modules.fetcher.CookieStoreTest testSaveLoadCookies
INFO:  after: [[version: 0][name: name1][value: value1][domain: example.com][path: /][expiry: null], [version: 0][name: name2][value: value2][domain: example.com][path: /][expiry: null], [version: 0][name: name3][value: value3][domain: example.com][path: /][expiry: null], [version: 0][name: name5][value: value5][domain: example.com][path: /][expiry: Mon May 29 07:02:48 EEST 2017], [version: 0][name: name6][value: value6][domain: example.com][path: /path1][expiry: null], [version: 0][name: name4][value: value4][domain: example.org][path: /][expiry: null]]
veebr 02, 2017 12:16:08 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@694306a8
veebr 02, 2017 12:16:16 PM org.archive.modules.fetcher.CookieStoreTest bdb
INFO: created org.archive.bdb.BdbModule@70494dff
Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 10.351 sec <<< FAILURE!
Running org.archive.modules.fetcher.FetchDNSTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec

Results :

Failed tests:   testConcurrentLoad(org.archive.modules.fetcher.CookieStoreTest)

Tests run: 188, Failures: 1, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Heritrix 3 ......................................... SUCCESS [  0.001 s]
[INFO] Heritrix 3: 'commons' subproject (utility classes) . SUCCESS [05:19 min]
[INFO] Heritrix 3: 'modules' subproject (reusable components) FAILURE [ 25.537 s]
[INFO] Heritrix 3: 'engine' subproject .................... SKIPPED
[INFO] Heritrix 3 (distribution bundles) .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:45 min
[INFO] Finished at: 2017-02-02T12:16:17+02:00
[INFO] Final Memory: 32M/362M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project heritrix-modules: There are test failures.
[ERROR] 
[ERROR] Please refer to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_01/heritrix3/modules/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :heritrix-modules
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ uname -a
Linux mvahi 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ df
Failisüsteem   1K-blokke     Kasut      Vaba Kas% Haagitud
/dev/sda1        9480420   7833064   1142732  88% /
udev               10240         0     10240   0% /dev
tmpfs            1639564      8864   1630700   1% /run
tmpfs            4098908         4   4098904   1% /dev/shm
tmpfs               5120         0      5120   0% /run/lock
tmpfs            4098908         0   4098908   0% /sys/fs/cgroup
/dev/sda6      188824364 156934452  22275116  88% /home
/dev/sdb1      961301000 281646464 630800152  31% /opt/hdd_01_for_large_files
tmpfs             819784         0    819784   0% /run/user/1000
tmpfs             819784         0    819784   0% /run/user/1001
tmpfs             819784         0    819784   0% /run/user/1009
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ free
             total       used       free     shared    buffers     cached
Mem:       8197820    4681404    3516416      11568     325732    1709448
-/+ buffers/cache:    2646224    5551596
Swap:      7977980    1276056    6701924
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ java -v
Unrecognized option: -v
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ whoami
se_dynamicsearchengine_01
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ echo $JAVA_HOME
/opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/Java_7/jdk_v_1_7_0_u76
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ echo $M2
/home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ which mvn
/home/mmmv/mmmv_userspace_distro_t1/applications/Maven/v_3_3_9/bin/mvn
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ which java
/opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/Java_7/jdk_v_1_7_0_u76/bin/java
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$ which javac
/opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/Java_7/jdk_v_1_7_0_u76/bin/javac
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_01/heritrix3$

from heritrix3.

anjackson commented on June 10, 2024

Ah, the missing log class is a red-herring as it's not a fatal error. I noticed a Java heap space error in your logs. The build is very heavy on RAM, and your default Java heap is perhaps too small. The Travis-CI build runs fine, using:

export JAVA_OPTS=-Xmx1500m
export MAVEN_OPTS=-Xmx1500m
export _JAVA_OPTIONS=-Xmx1500m

On my laptop I just set JAVA_OPTS and it works fine.

from heritrix3.

martinvahi commented on June 10, 2024

Still no luck. I just pressed the Ctrl-C after seeing the errors on console.
It's with a freshly cloned source.

se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ ls
commons  contrib  dist  engine  mmmv_build_it.bash  modules  pom.xml  README.md
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ chmod 0755 ./mmmv_build_it.bash 
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ ./mmmv_build_it.bash 
Picked up _JAVA_OPTIONS: -Xmx1500m
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] Heritrix 3
[INFO] Heritrix 3: 'commons' subproject (utility classes)
[INFO] Heritrix 3: 'modules' subproject (reusable components)
[INFO] Heritrix 3: 'engine' subproject
[INFO] Heritrix 3 (distribution bundles)
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes) 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The artifact poi:poi:jar:2.5.1 has been relocated to poi:poi:jar:2.5.1-final-20040804
[WARNING] The artifact itext:itext:jar:1.3 has been relocated to com.lowagie:itext:jar:1.3
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 77 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/target/classes
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/util/IdentityCacheableWrapper.java:[7,63] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,28] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,67] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/io/Warc2Arc.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/io/Warc2Arc.java: Recompile with -Xlint:deprecation for details.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/util/TestUtils.java: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/util/TestUtils.java uses unchecked or unsafe operations.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/main/java/org/archive/util/TestUtils.java: Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ heritrix-commons ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ heritrix-commons ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 37 source files to /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/target/test-classes
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Some input files use or override a deprecated API.
[INFO] /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/src/test/java/org/archive/io/warc/WARCWriterTest.java: Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ heritrix-commons ---
[INFO] Surefire report directory: /opt/hdd_01_for_large_files/large_files/se_dynamicsearchengine_01/se_heritrix_04/commons/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Picked up _JAVA_OPTIONS: -Xmx1500m
Running org.archive.bdb.StoredQueueTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.932 sec
Running org.archive.surt.SURTTokenizerTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:93)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:191)
	at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
	at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
	at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
	at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
	at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
	at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
	at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1006)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
	at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
	at org.apache.log4j.Logger.getLogger(Logger.java:104)
	at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
	at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
	at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
	at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
	at org.apache.commons.httpclient.util.EncodingUtil.<clinit>(EncodingUtil.java:54)
	at org.apache.commons.httpclient.URI.decode(URI.java:1773)
	at org.apache.commons.httpclient.URI.decode(URI.java:1731)
	at org.apache.commons.httpclient.URI.getAuthority(URI.java:2725)
	at org.archive.surt.SURTTokenizer.getKey(SURTTokenizer.java:151)
	at org.archive.surt.SURTTokenizer.<init>(SURTTokenizer.java:60)
	at org.archive.surt.SURTTokenizerTest.toSurtT(SURTTokenizerTest.java:177)
	at org.archive.surt.SURTTokenizerTest.testSimple(SURTTokenizerTest.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:164)
	at junit.framework.TestCase.runBare(TestCase.java:130)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:120)
	at junit.framework.TestSuite.runTest(TestSuite.java:230)
	at junit.framework.TestSuite.run(TestSuite.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
	at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
	at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
	at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
	at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
	at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.372 sec
Running org.archive.settings.file.BdbModuleTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.724 sec
Running org.archive.settings.file.PrefixFinderTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec
Running org.archive.util.FileUtilsTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.274 sec
Running org.archive.util.PaddingStringBufferTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
Running org.archive.util.ObjectIdentityBdbCacheTest
UNREGISTERED FOR KRYO class java.util.concurrent.atomic.AtomicInteger in class org.archive.util.IdentityCacheableWrapper
^Cse_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ echo "I pressed Ctrl after seeing the err at conle."
I pressed Ctrl after seeing the err at console.
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ java -version
java version "1.7.0_76"
Java(TM) SE Runtime Environment (build 1.7.0_76-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.76-b04, mixed mode)
se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$ cat ./mmmv_build_it.bash 
#!/usr/bin/env bash

# https://github.com/internetarchive/heritrix3/issues/175#issuecomment-276944659

export JAVA_OPTS=-Xmx1500m
export MAVEN_OPTS=-Xmx1500m
export _JAVA_OPTIONS=-Xmx1500m

nice -n20 mvn package 

se_dynamicsearchengine_01@mvahi:~/large_files/se_heritrix_04$

from heritrix3.

martinvahi commented on June 10, 2024

I propose that You download a virtual appliance from my home page,
prepare the Heritrix in that and then publish the virtual appliance.
That way people can run the Heritrix the way they can currently
try out Gigablast

The reason, why I'm trying to get the Heritrix to work is that the
Gigablast is unstable, has its own problems.

from heritrix3.

cslr commented on June 10, 2024

I cannot get Heritrix to compile from repository. It gives errors and compilation stops.

mvn -e -X package

Failed tests: testConnectionTimeout(org.archive.modules.fetcher.FetchHTTPTests)

Please fix it. I don't have time to figure out what is wrong or how to change compilation but would need to have source code modifed version of Heritrix.

from heritrix3.

martinvahi commented on June 10, 2024

@cslr Sometimes the issue with upstream developers is that
they focus on the core development of their project and do not
spend time testing the different build environments. I've noticed the
same problem with my own work: my own development environment
is "tainted" by having some set of dependencies "miraculously" installed
at one machine and when I build or try to run my own project on some other
machine or at some other virtual appliance, then things do not look as pretty as I thought they look.

Currently the only way I know, how to find those flaws, is to use a

FRESH, UNTAINTED, VIRTUAL MACHINE CLONE

at every pre-release test and to test things at both, Linux and BSD.
Even with C++ it's so that different compilers find different errors. Doing all that
pre-release testing is quite a lot of work, but it's necessary work. On the other
hand, its TOO MUCH WORK, if the typical American release-soon-and-often
methodology is used, which explains, why that work is often, usually, left
undone and hence the various build flaws. That issue is not specific to the
Heritrix project at all.

Also, different authors interpret the meaning of a public repository differently.
For some, the public repository is a place, where to share TESTING-CANDIDATES,
while for others public repository is a place for sharing RELEASES. At one of the
teams, where I once worked, we made it so that the release candidate BINARY
was used internally for about 3 months and if no serious issues emerged, then
the same binary went to paying customers and the release cycle for paying
customers was about once a year. The rest were release candidates for
internal use.

So, with that in mind, I'm sure that the Heretix developers do, what they can,
but just like the actual, de facto, "Debian stable" is the Ubuntu Linux, the
"Heritix stable" might be a sub-component of the

https://yacy.net/en/index.html

I suggest that You, @cslr, use the YaCy and then the YaCy developers pull from the
upstream Heritrix developers and do the testing. I'm not saying that the YaCy is stable,
but at least it works for a little while, till it freezes or crashes. Alternatively You may
want to experiment with the

https://www.findx.com/

core, the gigablast.com fork, the

https://github.com/privacore

As of 2018_03_12 I have not tested the privacore source. If You want, then You may also use my list of seed-URLs for Your search engine experiments:

https://github.com/martinvahi/mmmv_notes/blob/master/mmmv_notes/search_engine_seeds/seeds/mmmv_search_engine_scifi_seeds_t1.txt

I describe the conclusions of my search engine experimentation at my blog post at

https://martin.softf1.com/g/yellow_soap_opera_blog/some-thoughts-about-personalized-web-search-episode-0

If You want to test out an UNSTABLE (wastes memory and crashes after a while)
virtual machine with the old, leaky, flawed, Gigablast, then
You may use my GigaBlast virtual machine from

https://technology.softf1.com/mmmv_raspbian_t1/mmmv_gigablast_container_t1/

For more decent results You may want to use a blank 32bit Ubuntu VirtualBox VM from

https://technology.softf1.com/various_virtual_appliances/2016/

and build things from scratch.

from heritrix3.

anjackson commented on June 10, 2024

We are using Travis CI for fresh/untainted/clean builds: https://travis-ci.org/internetarchive/heritrix3

I believe we've fixed the build issues, and I'm working towards establishing binary releases.

One 'gotcha' is the tests involve running temporary servers on various ports, and so they can fail if those ports are already in use. I'll add this to the docs.

from heritrix3.

Heritrix3 Fails to Build from Source about heritrix3 HOT 11 CLOSED

Comments (11)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent