historyatstate / hsg-project Goto Github PK

View Code? Open in Web Editor NEW

14.0 14.0 12.0 662 KB

Get, build, and deploy hsg3

XQuery 46.72% Shell 17.67% JavaScript 19.38% XSLT 16.22%

hsg-project's People

Contributors

Stargazers

Watchers

Forkers

tuurma wolfgangmm dizzzz govtmirror joshuaeveleth windauer evolvedbinary audreyenergetique

hsg-project's Issues

Improved hsg setup steps on the wiki

Hi all,

If you weren't already aware of this, I've recently updated our wiki here on GitHub to reflect the new architecture for hsg (and moved the wiki entirely from the old "joewiz/frus-tei" repository). Several folks have already used these directions to set up their machines, namely, @seckroth, @mcdanielhn, and @awmarrs.

Even so, just today, when @machalou was setting up her computer using the directions, we encountered a couple of hiccups with the directions. I've now updated the directions to account for these kinks. I even added my first-ever self-produced animated gif, showing how to drag the workspace folder into the Finder sidebar—an action that is really hard to describe in words.

Please check the revised Setup directions out (and the other updated articles too) and let me know if you think anything else could be explained better, or if we need additional topics to be covered.

https://github.com/HistoryAtState/hsg-project/wiki/Setup
https://github.com/HistoryAtState/hsg-project/wiki/Version-control
https://github.com/HistoryAtState/hsg-project/wiki/Ebooks

Joe

p.s. Here's the gif:

New procedures for committing to HistoryAtState repositories

An important heads up to all @HistoryAtState/editors and @HistoryAtState/existsolutions folks:

This week I made some changes to our common oXygen configuration file (hsg-project.xpr) to ensure that our documents are formatted consistently. This will help in several ways, most notably, ensuring that our commits are atomic and reveal only the changes we made, not other incidental changes. As a result, I would like to request that everyone perform the "Fetch updates for all repositories" command from oXygen's External Tools menu to update your oXygen configuration file (letting me know if you see any errors in the console log as the updates are fetched), then quit and restart oXygen to ensure the new configuration is active.

Then, henceforth, please follow the following new procedure for committing your work (step 2 is the change):

Make any changes to your document(s).
Click the "Format and Indent" button in oXygen's toolbar (also accessible via the "Source" menu under "Document" > "Format and Indent", and save the document.
Commit the document.

If you have made changes to many files, you can apply "Format and Indent" on multiple files, doing the following instead of step 2 above):

2a. Format and indent all opened files: In the "Tools" menu select "Format and Indent files...", and change the "Scope" to "All opened files".
2b. Format and indent only certain files: In the "Project" pane, select the files, then right-click on one of the selected files and select "Format and Indent Files..." from the contextual menu. A dialog win
2c. Format and indent an entire folder's worth of documents: In the "Project" pane, right-click on a folder and select "Format and Indent Files..." from the contextual menu.

In the dialog box that appears after 2a, 2b, or 2c, be sure that the checkbox for "Make backup files with extension" is unchecked. Select OK to begin the operation. Here is what this dialog box looks like after 2a:

Prepare for migration to eXist 3.x

When eXist 3.1 is released, I would like to update hsg-project from the custom build of eXist 3.0RC1 circa May 2016 to the current release version of eXist, most importantly because the old version is incompatible with tei-publisher-lib, which our revised CMS apps are built on.

Changes I envision to build.xml and build.properties:

Pull eXide, shared-resources, and tei-simple-pm directly from the public-repo, instead of cloning and building them ourselves locally.
Add tei-publisher-lib to the list of apps to be installed via the public-repo.
Remove monex from the list of apps to be installed via the public-repo.

I've started a branch with some updated build files.

Manual steps I'm following to migrate:

Check out the new migrate-to-exist-3.0 branch
Delete the following directories from the repos directory: eXide, shared-resources, tei-simple-pm, and, if present, tei-publishing-lib
Copy production.instance.password from local.build.properties, then select (in oXygen's External Tools menu) "Enter server credentials", pasting in the copied password. This will refresh the list of cloned repos in local.build.properties.

@tuurma Could you please confer with the other @HistoryAtState/existsolutions devs and ponder what will be needed to migrate the hsg servers to eXist 3.x?

HSTS header is being suppressed

@tasmo (cc: @wolfgangmm) Could you please look into why the HSTS header is not being passed to clients? The Strict-Transport-Security header should be appearing; see the nginx configurations for both servers:

hsg-project/deploy/1861/etc/nginx/ssl/ssl.conf

Line 7 in d8349f1

add_header Strict-Transport-Security "max-age=7884000; includeSubdomains"; # 3 months
hsg-project/deploy/1991/etc/nginx/ssl/ssl.conf

Line 7 in d8349f1

add_header Strict-Transport-Security "max-age=7884000; includeSubdomains"; # 3 months

.

$ curl -I https://history.state.gov
HTTP/1.1 200 OK
Cache-Control: max-age=300
Cache-control: no-cache="set-cookie"
Content-Length: 23062
Content-Type: text/html;charset=UTF-8
Created: Thu, 26 May 2016 15:49:57 GMT
Date: Fri, 27 May 2016 11:45:25 GMT
Expires: Fri, 27 May 2016 11:50:25 GMT
Last-Modified: Thu, 26 May 2016 15:49:57 GMT
Server: nginx/1.8.1
Set-Cookie: JSESSIONID=1awavjfcnah5o4ynki5ufos0h;Path=/exist;Secure
Set-Cookie: AWSELB=DF3DF3131A3B5A346363EB1AB82654160644E8227C298C9EE89549313D0D91DE903E91ED1DA192BECC93A380DCC30525256BA2F6416763ADC2F553BFD3E4B5750299775BB7;PATH=/
X-Proxy-Cache: HIT
X-XQuery-Cached: true
Connection: keep-alive

$ curl -I https://1861.history.state.gov
HTTP/1.1 200 OK
Server: nginx/1.8.1
Date: Fri, 27 May 2016 11:49:30 GMT
Content-Type: text/html;charset=UTF-8
Content-Length: 23062
Connection: keep-alive
Set-Cookie: JSESSIONID=1awavjfcnah5o4ynki5ufos0h;Path=/exist;Secure
Expires: Fri, 27 May 2016 11:54:30 GMT
Last-Modified: Thu, 26 May 2016 15:49:57 GMT
Created: Thu, 26 May 2016 15:49:57 GMT
X-XQuery-Cached: true
Cache-Control: max-age=300
X-Proxy-Cache: HIT

$ curl -I https://1991.history.state.gov
HTTP/1.1 200 OK
Server: nginx/1.8.1
Date: Fri, 27 May 2016 11:50:03 GMT
Content-Type: text/html;charset=UTF-8
Content-Length: 23062
Connection: keep-alive
Set-Cookie: JSESSIONID=nja2c36zolzarear6gcay5e8;Path=/exist;Secure
Expires: Fri, 27 May 2016 11:55:03 GMT
Last-Modified: Thu, 26 May 2016 15:50:31 GMT
Created: Thu, 26 May 2016 15:50:31 GMT
X-XQuery-Cached: true
Cache-Control: max-age=300
X-Proxy-Cache: EXPIRED

default ant target should check build.properties for new repos to clone

when we add new repositories to build.properties, the default ant target does not clone them; it only does git pull on the already cloned repositories. please update the default target to clone any newly-added repos.

as a workaround until the default target is fixed, ant setup does have the effect of cloning any newly added repos.

Transfer repos & info to HistoryAtState

Transfer repos from joewiz and eXistSolutions to HistoryAtState
Move setup articles like https://github.com/joewiz/frus-tei/wiki/setup, etc.
Perhaps publication/dataset-specific articles (quarterly releases, etc.) should go into those repos

Add facility for local build properties file

Users currently need to enter secrets, such as the admin passwords for remote servers, into build.properties file. We want to avoid inadvertently committing these into source. Can you devise a method - such as reading in these properties from a local.build.properties file that is ignored by git, that we can use for this purpose?

Adapt oXygen schema validation scenarios to hsg-project.xpr

Have already done frus, need to do pocom and full survey...

A new wiki page - a Troubleshooting FAQ for hsg-project. Comments, suggestions?

Hi all @HistoryAtState/editors,

I've started a new page on the wiki, https://github.com/HistoryAtState/hsg-project/wiki/troubleshooting. It only has a few items now, but these are the tried-and-true solutions to common problems I and other hsg-project users have. Please check it out and reference it when you have problems. And if you have any comments or suggestions for new entries, please let me know.

Cheers,
Joe

Reviewing XML for frus1981-88v41

oXygen task fails to build hsg-shell xar on Mac

The build fails when "npm" cannot be found

The fix is to modify hsg-shell's build.properties file to be:

npm=/usr/local/bin/npm
gulp=/usr/local/bin/gulp

@wolfgangmm So that all of our users don't have to make this modification locally, is there some way to define these properties in hsg-project and have them propagate to hsg-shell? Or do we need a task to replace these properties (e.g., "prepare properties for mac hsg dev system")?

default ant target should clean xars folder

recently tei-simple v0.5 was updated to v0.6, and while the default ant target pulled the new changes, the old v0.5 xar file remained in the xars directory. i'd suggest adding a "clean" step to the default target which would wipe old xar files from the xars directory.

OpenVPN Connect v3.4.3 connection issue

After upgrading to OpenVPN Connect v3.4.3 (released on August 3), you may encounter the following error when trying to connect to our server (see screenshot):

Connection Failed
There was an error attempting to connect to the selected server.
Error message: option_error: sorry, unsupported options present in configuration:
UNKNOWN/UNSUPPORTED OPTIONS
Please refer to connection logs for more details.

Until a new version is released that fixes this, here's how to downgrade to the most recent version that works:

Locate the uninstaller in your Applications folder, in a subfolder called OpenVPN Connect. Within that folder, double-click on Uninstall OpenVPN Connect.app.
Download and install OpenVPN Connect v3.4.2 from https://swupdate.openvpn.net/downloads/connect/openvpn-connect-3.4.2.4547_signed.dmg.

Add deployment and configuration files

@tasmo Rather than creating a new repository for deployment files (my earlier idea), I think we should add the nginx.conf and other relevant files to a subdirectory of hsg-project, deploy.

I have a model in mind: https://github.com/18F/hub/tree/master/deploy. Notice that nginx, init.d, and logrotate.d are all stored in deploy/etc.

I realize we have two different nginx.conf files - one for each front end server - so we may need some additional subdirectories. Or perhaps you have a better idea for handling these parameters?

Remove "No log4j2 configuration file found" error

Tasks such as upload-current-file-to-localhost that use the xmldb ant tasks show the following (non-fatal) error in the console:

$ sh "/Applications/oxygen/tools/ant/bin/ant" upload-current-file-to-localhost -Darg1="/Users/joe/workspace/hsg-project/repos/hsg-shell/modules" -Darg2="app.xqm" -Dlog4j.configurationFile="/Users/joe/workspace/hsg-project/log4j2.xml"
Buildfile: /Users/joe/workspace/hsg-project/build.xml

deploy.init:
Trying to override old definition of task foreach

upload-current-file-to-localhost:
     [echo] Uploading app.xqm from /Users/joe/workspace/hsg-project/repos/hsg-shell/modules to eXist-db localhost
[xdb:store] ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
[xdb:store] Database driver registered.
[xdb:store] Found 0 directories and 1 files.
[xdb:store] Storing app.xqm ...

BUILD SUCCESSFUL
Total time: 1 second

Since ERROR suggests a problem to users, we should provide a configuration file.

bower install isn't running

The hsg-shell app uses bower for dependency management, but the build.sh script only runs ant in each project.

Revise ebook instructions to address Calibre problem

An email to the ebooks mailbox reported a problem opening the frus1941v01 epub in iBooks on macOS. Research into this revealed that the ebook opens fine on iBooks on iOS and in Murasaki on macOS, and the oddity about this volume, compared to others that open fine in iBooks is that it contains some Calibre metadata in the OEBPS/content.opf file. This appears to be added when opening an epub file in Calibre. We should probably remove any instructions which say to open an epub file in Calibre, such as in https://github.com/HistoryAtState/hsg-project/wiki/Publishing-New-Volumes-to-Website#create-ebooks. The original ebook instructions at https://github.com/HistoryAtState/hsg-project/wiki/ebooks could be a model. It shouldn't be necessary to open epubs or mobis in Calibre at all; the ebook batch helper produces the mobis. Any time we open an epub or mobi in an external ereader for proofing we should do this on a copy of the file; and only the original files should be uploaded to S3.

eXist installer comes with extra, conflicting jars

@HistoryAtState/existsolutions In the next build of eXist for hsg development, please remove the extra jars in the extensions/modules/lib folder:

$ cd /Applications/eXist-db.app/Contents/Resources/eXist-db/extensions/modules/lib 
$ ls -1
avalon-framework-4.2.0.jar
avalon-framework-api-4.3.1.jar
avalon-framework-impl-4.3.1.jar
batik-all-1.8.jar
cssparser-0.9.5.jar
fontbox-1.8.5.jar
fop-2.1.jar
sac-1.3.jar
xmlgraphics-commons-1.5.jar
xmlgraphics-commons-2.1.jar

Specifically, I believe these should be deleted:

avalon-framework-4.2.0.jar
xmlgraphics-commons-1.5.jar

The presence of these extra jars causes errors when using the TEI Simple PM app to generate PDFs that I do not see when using a direct checkout of eXist develop.

This is a similar phenomenon to eXist-db/exist#966 (comment) - perhaps a similar artifact left over from a previous build that needs to be cleared before rebuilding.

node@6 no longer available via Homebrew

The HSG environment currently utilizes node@6, but node@6 is no longer available via Homebrew. The available versions are node@8 and node@10 [see https://formulae.brew.sh/formula/node].

As a result, users newly establishing an HSG environment on their local systems will receive a build fail for the "4. Deploy all repositories to localhost" step in the oXygenXML Editor tools menu.

Per @joewiz, if node@8 (or newer) is compatible with hsg-shell, could we migrate to the newer version?

Southeast Asia XML Review

Docker/Vagrant plans?

Is there any plan to create a Docker of Vagrant box for this? It would be nice to be able to easily spin up a stress test of https://github.com/joewiz/hsg-test/blob/master/src/test/jmeter/combined.jmx against this.

Prevent guest access to eXide

Problem

Currently configuring eXide to prevent guest access is manual - eXide/configuration.xml must be edited to read:

<configuration>
    <restrictions execute-query="no" guest="no">
        <!-- 
            Disallow access to certain collections. When using this,
            you always (!) want to deny access to the eXide collection as
            well.
        -->
        <deny collection="/db"/>
    </restrictions>
</configuration>

Since this doesn't happen automatically during deployment, the database remains open to read-only during the period before this change is applied.

Requirement

Automate this step as part of the deployment process, especially on the production servers, so that eXide requires credentials immediately upon installation.

Approach

@wolfgangmm suggested:

keep a copy of configuration.xml in hsg-project and use ant to copy it into eXide before build

Errors with upload-current-file tasks on fresh system

When setting up @awmarrs with hsg-project, the first time we called the upload-current-file-to-production task (from oXygen), I got errors indicating that the ivy libs weren't in place. So I re-added a @depends entry for ivy.download (see forthcoming branch/PR). Then I re-ran the task, and got this error. I tried again, and it completed successfully. So, my question to @wolfgangmm or other @HistoryAtState/existsolutions ant wizards is:

What does this error mean? Was this just a network glitch, or is this going to happen to every 1st time user of hsg-project? How do we avoid this error on systems where we are setting this up for the first time?

Started: sh "/Applications/oxygen/tools/ant/bin/ant" upload-current-file-to-production -Darg1="/Users/Aaron/workspace/hsg-project/repos/pocom/people/b" -Darg2="bader-william-b.xml"
Buildfile: /Users/Aaron/workspace/hsg-project/build.xml

prepare:

ivy.setup:

ivy.download:
[ivy:retrieve] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:retrieve] :: loading settings :: file = /Users/Aaron/workspace/hsg-project/ivysettings.xml
[ivy:retrieve] :: resolving dependencies :: org.exist#hsg;[email protected]
[ivy:retrieve] confs: [default]
[ivy:retrieve] found exist-db#exist-core;3.0.RC1 in exist
[ivy:retrieve] found exist-db#exist-optional;3.0.RC1 in exist
[ivy:retrieve] found exist-db#xmldb-api;1.0-patched in exist
[ivy:retrieve] found org.apache.logging.log4j#log4j-core;2.3 in ibiblio-maven2
[ivy:retrieve] found org.osgi#org.osgi.core;4.3.1 in ibiblio-maven2
[ivy:retrieve] found com.lmax#disruptor;3.3.2 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.core#jackson-core;2.5.3 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.core#jackson-databind;2.5.3 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.core#jackson-annotations;2.5.0 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.dataformat#jackson-dataformat-yaml;2.5.3 in ibiblio-maven2
[ivy:retrieve] found org.yaml#snakeyaml;1.12 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.dataformat#jackson-dataformat-xml;2.5.3 in ibiblio-maven2
[ivy:retrieve] found com.fasterxml.jackson.module#jackson-module-jaxb-annotations;2.5.3 in ibiblio-maven2
[ivy:retrieve] found org.codehaus.woodstox#stax2-api;3.1.4 in ibiblio-maven2
[ivy:retrieve] found org.codehaus.woodstox#woodstox-core-asl;4.3.0 in ibiblio-maven2
[ivy:retrieve] found javax.xml.stream#stax-api;1.0-2 in ibiblio-maven2
[ivy:retrieve] found org.fusesource.jansi#jansi;1.11 in ibiblio-maven2
[ivy:retrieve] found com.sun.mail#javax.mail;1.5.2 in ibiblio-maven2
[ivy:retrieve] found javax.activation#activation;1.1 in ibiblio-maven2
[ivy:retrieve] found org.eclipse.persistence#javax.persistence;2.1.0 in ibiblio-maven2
[ivy:retrieve] found org.jboss.spec.javax.jms#jboss-jms-api_1.1_spec;1.0.1.Final in ibiblio-maven2
[ivy:retrieve] found commons-logging#commons-logging;1.2 in ibiblio-maven2
[ivy:retrieve] found logkit#logkit;1.0.1 in ibiblio-maven2
[ivy:retrieve] found javax.servlet#servlet-api;2.3 in ibiblio-maven2
[ivy:retrieve] found commons-io#commons-io;2.4 in ibiblio-maven2
[ivy:retrieve] found antlr#antlr;2.7.7 in ibiblio-maven2
[ivy:retrieve] found org.apache.xmlrpc#xmlrpc-client;3.1.3 in ibiblio-maven2
[ivy:retrieve] found org.apache.xmlrpc#xmlrpc-common;3.1.3 in ibiblio-maven2
[ivy:retrieve] found org.apache.ws.commons.util#ws-commons-util;1.0.2 in ibiblio-maven2
[ivy:retrieve] found junit#junit;3.8.1 in ibiblio-maven2
[ivy:retrieve] found xml-apis#xml-apis;1.0.b2 in ibiblio-maven2
[ivy:retrieve] found commons-httpclient#commons-httpclient;3.0.1 in ibiblio-maven2
[ivy:retrieve] found commons-codec#commons-codec;1.2 in ibiblio-maven2
[ivy:retrieve] found ant-contrib#ant-contrib;1.0b3 in ibiblio-maven2
[ivy:retrieve] found ant#ant;1.5 in ibiblio-maven2
[ivy:retrieve] downloading https://raw.github.com/eXist-db/mvn-repo/master/org/exist-db/exist-core/3.0.RC1/exist-core-3.0.RC1.jar ...
[ivy:retrieve] ................................................................................................................................................................................................................................................................................... (4382kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] exist-db#exist-core;3.0.RC1!exist-core.jar (3361ms)
[ivy:retrieve] downloading https://raw.github.com/eXist-db/mvn-repo/master/org/exist-db/thirdparty/org/xmldb/xmldb-api/1.0-patched/xmldb-api-1.0-patched.jar ...
[ivy:retrieve] .. (12kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] exist-db#xmldb-api;1.0-patched!xmldb-api.jar (1356ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.3/log4j-core-2.3-sources.jar ...
[ivy:retrieve] ............................................ (685kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.3/log4j-core-2.3.jar ...
[ivy:retrieve] .................................................... (807kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.apache.logging.log4j#log4j-core;2.3!log4j-core.jar (414ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2-sources.jar ...
[ivy:retrieve] ...... (71kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-logging#commons-logging;1.2!commons-logging.jar(source) (171ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2-javadoc.jar ...
[ivy:retrieve] ........... (154kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-logging#commons-logging;1.2!commons-logging.jar(javadoc) (173ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar ...
[ivy:retrieve] ..... (60kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-logging#commons-logging;1.2!commons-logging.jar (170ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-io/commons-io/2.4/commons-io-2.4-sources.jar ...
[ivy:retrieve] ................. (240kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-io#commons-io;2.4!commons-io.jar(source) (213ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar ...
[ivy:retrieve] ............. (180kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-io#commons-io;2.4!commons-io.jar (182ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/commons-io/commons-io/2.4/commons-io-2.4-javadoc.jar ...
[ivy:retrieve] .............................................. (707kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] commons-io#commons-io;2.4!commons-io.jar(javadoc) (310ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/apache/xmlrpc/xmlrpc-client/3.1.3/xmlrpc-client-3.1.3.jar ...
[ivy:retrieve] ..... (57kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.apache.xmlrpc#xmlrpc-client;3.1.3!xmlrpc-client.jar (178ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/ant-contrib/ant-contrib/1.0b3/ant-contrib-1.0b3.jar ...
[ivy:retrieve] ............... (219kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] ant-contrib#ant-contrib;1.0b3!ant-contrib.jar (205ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/osgi/org.osgi.core/4.3.1/org.osgi.core-4.3.1.jar ...
[ivy:retrieve] ....................... (341kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.osgi#org.osgi.core;4.3.1!org.osgi.core.jar (497ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-core/2.5.3/jackson-core-2.5.3.jar ...
[ivy:retrieve] ................ (224kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.5.3/jackson-databind-2.5.3.jar ...
[ivy:retrieve] ....................................................................... (1116kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-yaml/2.5.3/jackson-dataformat-yaml-2.5.3.jar ...
[ivy:retrieve] ..................... (314kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] com.fasterxml.jackson.dataformat#jackson-dataformat-yaml;2.5.3!jackson-dataformat-yaml.jar(bundle) (248ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-xml/2.5.3/jackson-dataformat-xml-2.5.3.jar ...
[ivy:retrieve] ....... (90kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] com.fasterxml.jackson.dataformat#jackson-dataformat-xml;2.5.3!jackson-dataformat-xml.jar(bundle) (219ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.jar ...
[ivy:retrieve] ......... (111kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/sun/mail/javax.mail/1.5.2/javax.mail-1.5.2.jar ...
[ivy:retrieve] .................................... (557kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/eclipse/persistence/javax.persistence/2.1.0/javax.persistence-2.1.0.jar ...
[ivy:retrieve] ........... (158kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/jboss/spec/javax/jms/jboss-jms-api_1.1_spec/1.0.1.Final/jboss-jms-api_1.1_spec-1.0.1.Final.jar ...
[ivy:retrieve] .... (36kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.jboss.spec.javax.jms#jboss-jms-api_1.1_spec;1.0.1.Final!jboss-jms-api_1.1_spec.jar (208ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.5.0/jackson-annotations-2.5.0.jar ...
[ivy:retrieve] .... (38kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] com.fasterxml.jackson.core#jackson-annotations;2.5.0!jackson-annotations.jar(bundle) (216ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/com/fasterxml/jackson/module/jackson-module-jaxb-annotations/2.5.3/jackson-module-jaxb-annotations-2.5.3.jar ...
[ivy:retrieve] .... (31kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/codehaus/woodstox/stax2-api/3.1.4/stax2-api-3.1.4.jar ...
[ivy:retrieve] ........... (158kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar ...
[ivy:retrieve] ... (22kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] javax.xml.stream#stax-api;1.0-2!stax-api.jar (205ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/javax/activation/activation/1.1/activation-1.1.jar ...
[ivy:retrieve] ..... (61kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] javax.activation#activation;1.1!activation.jar (207ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/logkit/logkit/1.0.1/logkit-1.0.1.jar ...
[ivy:retrieve] ...... (70kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] logkit#logkit;1.0.1!logkit.jar (167ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/javax/servlet/servlet-api/2.3/servlet-api-2.3.jar ...
[ivy:retrieve] ....... (76kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] javax.servlet#servlet-api;2.3!servlet-api.jar (169ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/apache/xmlrpc/xmlrpc-common/3.1.3/xmlrpc-common-3.1.3.jar ...
[ivy:retrieve] ........ (106kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.apache.xmlrpc#xmlrpc-common;3.1.3!xmlrpc-common.jar (182ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/org/apache/ws/commons/util/ws-commons-util/1.0.2/ws-commons-util-1.0.2.jar ...
[ivy:retrieve] .... (33kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] org.apache.ws.commons.util#ws-commons-util;1.0.2!ws-commons-util.jar (169ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar ...
[ivy:retrieve] ......... (118kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/xml-apis/xml-apis/1.0.b2/xml-apis-1.0.b2.jar ...
[ivy:retrieve] ........ (106kB)
[ivy:retrieve] .. (0kB)
[ivy:retrieve] [SUCCESSFUL ] xml-apis#xml-apis;1.0.b2!xml-apis.jar (194ms)
[ivy:retrieve] downloading https://repo1.maven.org/maven2/ant/ant/1.5/ant-1.5.jar ...
[ivy:retrieve] ............................................. (699kB)
[ivy:retrieve] :: resolution report :: resolve 20770ms :: artifacts dl 11962ms
[ivy:retrieve] :: evicted modules:
[ivy:retrieve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.2] in [default]
---------------------------------------------------------------------
|                  |            modules            ||   artifacts   |
|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
|      default     |   39  |   15  |   14  |   1   ||   43  |   23  |
---------------------------------------------------------------------
[ivy:retrieve] 
[ivy:retrieve] :: problems summary ::
[ivy:retrieve] :::: WARNINGS
[ivy:retrieve] problem while downloading module descriptor: https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-api/2.3/log4j-api-2.3.pom: /Users/Aaron/.ivy2/cache/org.apache.logging.log4j/log4j-api/ivy-2.3.xml.original.part (No such file or directory) (166ms)
[ivy:retrieve] module not found: org.apache.logging.log4j#log4j-api;2.3
[ivy:retrieve] ==== maven: tried
[ivy:retrieve]   http://mvnrepository.com/artifact/org/apache/logging/log4j/log4j-api/2.3/log4j-api-2.3.pom
[ivy:retrieve]   -- artifact org.apache.logging.log4j#log4j-api;2.3!log4j-api.jar:
[ivy:retrieve]   http://mvnrepository.com/artifact/org/apache/logging/log4j/log4j-api/2.3/log4j-api-2.3.jar
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-api/2.3/log4j-api-2.3.pom
[ivy:retrieve] ==== exist: tried
[ivy:retrieve]   -- artifact org.apache.logging.log4j#log4j-api;2.3!log4j-api.jar:
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/org.apache.logging.log4j/log4j-api/2.3/log4j-api-2.3.jar
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/org.apache.logging.log4j/thirdparty/org/xmldb/xmldb-api/2.3/log4j-api-2.3.jar
[ivy:retrieve] problem while downloading module descriptor: https://repo1.maven.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom: impossible to move part file to definitive one: /Users/Aaron/.ivy2/cache/log4j/log4j/ivy-1.2.17.xml.original.part -> /Users/Aaron/.ivy2/cache/log4j/log4j/ivy-1.2.17.xml.original (249ms)
[ivy:retrieve] module not found: log4j#log4j;1.2.17
[ivy:retrieve] ==== maven: tried
[ivy:retrieve]   http://mvnrepository.com/artifact/log4j/log4j/1.2.17/log4j-1.2.17.pom
[ivy:retrieve]   -- artifact log4j#log4j;1.2.17!log4j.jar:
[ivy:retrieve]   http://mvnrepository.com/artifact/log4j/log4j/1.2.17/log4j-1.2.17.jar
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom
[ivy:retrieve] ==== exist: tried
[ivy:retrieve]   -- artifact log4j#log4j;1.2.17!log4j.jar:
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/log4j/log4j/1.2.17/log4j-1.2.17.jar
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/log4j/thirdparty/org/xmldb/xmldb-api/1.2.17/log4j-1.2.17.jar
[ivy:retrieve] problem while downloading module descriptor: https://repo1.maven.org/maven2/avalon-framework/avalon-framework/4.1.5/avalon-framework-4.1.5.pom: /Users/Aaron/.ivy2/cache/avalon-framework/avalon-framework/ivy-4.1.5.xml.original.part (No such file or directory) (162ms)
[ivy:retrieve] module not found: avalon-framework#avalon-framework;4.1.5
[ivy:retrieve] ==== maven: tried
[ivy:retrieve]   http://mvnrepository.com/artifact/avalon-framework/avalon-framework/4.1.5/avalon-framework-4.1.5.pom
[ivy:retrieve]   -- artifact avalon-framework#avalon-framework;4.1.5!avalon-framework.jar:
[ivy:retrieve]   http://mvnrepository.com/artifact/avalon-framework/avalon-framework/4.1.5/avalon-framework-4.1.5.jar
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/avalon-framework/avalon-framework/4.1.5/avalon-framework-4.1.5.pom
[ivy:retrieve] ==== exist: tried
[ivy:retrieve]   -- artifact avalon-framework#avalon-framework;4.1.5!avalon-framework.jar:
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/avalon-framework/avalon-framework/4.1.5/avalon-framework-4.1.5.jar
[ivy:retrieve]   https://raw.github.com/eXist-db/mvn-repo/master/org/avalon-framework/thirdparty/org/xmldb/xmldb-api/4.1.5/avalon-framework-4.1.5.jar
[ivy:retrieve] [FAILED     ] org.apache.logging.log4j#log4j-core;2.3!log4j-core.jar(source): Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.3/log4j-core-2.3-sources.jar. Please retry. (511ms)
[ivy:retrieve] [FAILED     ] org.apache.logging.log4j#log4j-core;2.3!log4j-core.jar(source): Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.3/log4j-core-2.3-sources.jar. Please retry. (511ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.3/log4j-core-2.3-sources.jar
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.core#jackson-core;2.5.3!jackson-core.jar(bundle): /Users/Aaron/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.5.3.jar.part (No such file or directory) (271ms)
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.core#jackson-core;2.5.3!jackson-core.jar(bundle): /Users/Aaron/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.5.3.jar.part (No such file or directory) (271ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-core/2.5.3/jackson-core-2.5.3.jar
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.core#jackson-databind;2.5.3!jackson-databind.jar(bundle): Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.5.3/jackson-databind-2.5.3.jar. Please retry. (307ms)
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.core#jackson-databind;2.5.3!jackson-databind.jar(bundle): Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.5.3/jackson-databind-2.5.3.jar. Please retry. (307ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.5.3/jackson-databind-2.5.3.jar
[ivy:retrieve] [FAILED     ] org.fusesource.jansi#jansi;1.11!jansi.jar: /Users/Aaron/.ivy2/cache/org.fusesource.jansi/jansi/jars/jansi-1.11.jar.part (No such file or directory) (230ms)
[ivy:retrieve] [FAILED     ] org.fusesource.jansi#jansi;1.11!jansi.jar: /Users/Aaron/.ivy2/cache/org.fusesource.jansi/jansi/jars/jansi-1.11.jar.part (No such file or directory) (230ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.jar
[ivy:retrieve] [FAILED     ] com.sun.mail#javax.mail;1.5.2!javax.mail.jar: /Users/Aaron/.ivy2/cache/com.sun.mail/javax.mail/jars/javax.mail-1.5.2.jar.part (No such file or directory) (264ms)
[ivy:retrieve] [FAILED     ] com.sun.mail#javax.mail;1.5.2!javax.mail.jar: /Users/Aaron/.ivy2/cache/com.sun.mail/javax.mail/jars/javax.mail-1.5.2.jar.part (No such file or directory) (264ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/com/sun/mail/javax.mail/1.5.2/javax.mail-1.5.2.jar
[ivy:retrieve] [FAILED     ] org.eclipse.persistence#javax.persistence;2.1.0!javax.persistence.jar: /Users/Aaron/.ivy2/cache/org.eclipse.persistence/javax.persistence/jars/javax.persistence-2.1.0.jar.part (No such file or directory) (172ms)
[ivy:retrieve] [FAILED     ] org.eclipse.persistence#javax.persistence;2.1.0!javax.persistence.jar: /Users/Aaron/.ivy2/cache/org.eclipse.persistence/javax.persistence/jars/javax.persistence-2.1.0.jar.part (No such file or directory) (172ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/org/eclipse/persistence/javax.persistence/2.1.0/javax.persistence-2.1.0.jar
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.module#jackson-module-jaxb-annotations;2.5.3!jackson-module-jaxb-annotations.jar(bundle): /Users/Aaron/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/bundles/jackson-module-jaxb-annotations-2.5.3.jar.part (No such file or directory) (222ms)
[ivy:retrieve] [FAILED     ] com.fasterxml.jackson.module#jackson-module-jaxb-annotations;2.5.3!jackson-module-jaxb-annotations.jar(bundle): /Users/Aaron/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/bundles/jackson-module-jaxb-annotations-2.5.3.jar.part (No such file or directory) (222ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/com/fasterxml/jackson/module/jackson-module-jaxb-annotations/2.5.3/jackson-module-jaxb-annotations-2.5.3.jar
[ivy:retrieve] [FAILED     ] org.codehaus.woodstox#stax2-api;3.1.4!stax2-api.jar(bundle): /Users/Aaron/.ivy2/cache/org.codehaus.woodstox/stax2-api/bundles/stax2-api-3.1.4.jar.part (No such file or directory) (213ms)
[ivy:retrieve] [FAILED     ] org.codehaus.woodstox#stax2-api;3.1.4!stax2-api.jar(bundle): /Users/Aaron/.ivy2/cache/org.codehaus.woodstox/stax2-api/bundles/stax2-api-3.1.4.jar.part (No such file or directory) (213ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/org/codehaus/woodstox/stax2-api/3.1.4/stax2-api-3.1.4.jar
[ivy:retrieve] [FAILED     ] junit#junit;3.8.1!junit.jar: /Users/Aaron/.ivy2/cache/junit/junit/jars/junit-3.8.1.jar.part (No such file or directory) (168ms)
[ivy:retrieve] [FAILED     ] junit#junit;3.8.1!junit.jar: /Users/Aaron/.ivy2/cache/junit/junit/jars/junit-3.8.1.jar.part (No such file or directory) (168ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar
[ivy:retrieve] [FAILED     ] ant#ant;1.5!ant.jar: Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/ant/ant/1.5/ant-1.5.jar. Please retry. (152ms)
[ivy:retrieve] [FAILED     ] ant#ant;1.5!ant.jar: Downloaded file size doesn't match expected Content Length for https://repo1.maven.org/maven2/ant/ant/1.5/ant-1.5.jar. Please retry. (152ms)
[ivy:retrieve] ==== ibiblio-maven2: tried
[ivy:retrieve]   https://repo1.maven.org/maven2/ant/ant/1.5/ant-1.5.jar
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] ::          UNRESOLVED DEPENDENCIES         ::
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] :: org.apache.logging.log4j#log4j-api;2.3: not found
[ivy:retrieve] :: log4j#log4j;1.2.17: not found
[ivy:retrieve] :: avalon-framework#avalon-framework;4.1.5: not found
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] ::              FAILED DOWNLOADS            ::
[ivy:retrieve] :: ^ see resolution messages for details  ^ ::
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] :: org.apache.logging.log4j#log4j-core;2.3!log4j-core.jar(source)
[ivy:retrieve] :: com.fasterxml.jackson.core#jackson-core;2.5.3!jackson-core.jar(bundle)
[ivy:retrieve] :: com.fasterxml.jackson.core#jackson-databind;2.5.3!jackson-databind.jar(bundle)
[ivy:retrieve] :: com.fasterxml.jackson.module#jackson-module-jaxb-annotations;2.5.3!jackson-module-jaxb-annotations.jar(bundle)
[ivy:retrieve] :: org.codehaus.woodstox#stax2-api;3.1.4!stax2-api.jar(bundle)
[ivy:retrieve] :: org.fusesource.jansi#jansi;1.11!jansi.jar
[ivy:retrieve] :: com.sun.mail#javax.mail;1.5.2!javax.mail.jar
[ivy:retrieve] :: org.eclipse.persistence#javax.persistence;2.1.0!javax.persistence.jar
[ivy:retrieve] :: junit#junit;3.8.1!junit.jar
[ivy:retrieve] :: ant#ant;1.5!ant.jar
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] 
[ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

BUILD FAILED
/Users/Aaron/workspace/hsg-project/build.xml:255: impossible to resolve dependencies:
resolve failed - see output for details

Total time: 33 seconds
Process ended with exit code: 1

401 prompts seem to be cached

@joewiz wrote:

... The homepages were both giving authentication prompts; canceling these returned a 401. Then I tried the /test endpoint and got through. Returning to /, I got the same authentication response. Adding ?blah=1 to the requested URL avoided the error. We still don't know what is causing the 401 prompts (except that we know eXist is issuing them in the first place). But based on what I saw just just now, could it be that 401 responses are being cached by nginx. ...

Reviewing for XML 40029

A heads up and a request

Dear @HistoryAtState/editors,

If your computer with hsg-project is working fine, please skip the "heads up" section and read on to the "request" section. But if you're setting up a new machine or you encounter a problem and you need to troubleshoot it, please read the "heads up" so the problems that have bitten a few of us don't bite you.

A heads up

Several pieces of open source software that our hsg-project infrastructure depends on have issued major updates with breaking changes. The eXist team and I are researching the necessary updates and fixes. Until those fixes are ready, please do not follow either the "first time setup" or the "updating from an old system" directions on the hsg-project setup page. I will be issuing a new set of instructions once we will the changes wrapped up, tested, and ready to roll out—likely in the next week or so.

If you need help with your system, just drop me a note, and I'll guide you individually.

A request

Also, if you ever spot a problem with our directions in the hsg-project wiki or have an idea for improving them, please let me know. Everyone's welcome to edit the wiki pages—there is always room for improvement! When you do, please be sure to drop me a note so I can review them. In particular, I need to test changes to updated procedures, however minor, since everyone depends on these directions for their work. (Unlike our regular repositories, edits to the wiki don't generate email notifications, so it's easy for me to miss these edits.)

I'll let you know when the new hsg-project setup directions are ready. In the meantime, please let me know if you have any questions.

XML Review Soviet Volume 86-88

[DEV] Update doc

When building hsg-project and following the described steps in the Readme, there is one step missing in the documentation for installing S3 Helper, which is documented only in the S3 Repo's readme.

Including this step in an automation could also be helpful. Possibly by providing a local.build.properties.example file with a description of inserting credentials and including copying and renaming the module as an ant task.

Issue to test rocket chat integration.

Include build step for subprojects

After HistoryAtState/hsg-shell#106 is merged, it is necessary to include the build step when installing and updating hsg-shell.
Currently only bower install runs whenever a bower.json is found. However, this does not compile the CSS file that is needed in order to style the site.
The decision to use a CSS-Preprocessor, being it less or sass, is the reason for this.
Otherwise this has to be done manually.

I would propose to agree on a more automatic process. The hsg-shell project could provide an npm script, for instance npm start, that does all of the above.
The hsg-project build script then checks not only for a bower.json but a second marker that will tell it to run npm start (instead). package.json will likely give too many false positives as any project dependent on bower includes that file as well.

Document production deployment steps

conf.xml (and other configuration files) for master vs. slave instances
nginx.conf for web servers
where each secret needs to be entered for API calls and Ant scripts to function (#54)
how to connect to master to run app deployment steps

The README.md at https://github.com/18F/hub/tree/master/deploy could be a good model for this.

Add "Delete current file" commands for oXygen

Adapt from the old project-unix.xpr file, which had these.

NPE when running ant over existing install

Using hsg-shell branch of eXist-LTS (basically up to date with the eXist develop branch), I get an NPE when running ant from this project over an existing installation at the point when monex is installed. If monex is not yet installed (i.e., if you've run build.sh clean-default-data-dir in $EXIST_HOME, monex installs without error.

Steps to reproduce:

clone eXist develop branch. (or, if you already have it, run build.sh clean-default-data-dir to wipe your db.)
clone this repo. run ant setup to clone subrepositories.
start eXist
run ant in this project to build the xars and deploy to eXist
this should complete without error
run ant again
the script breaks at the point when deploying monex.

Below is the log information I've collected:

Here is the console output where ant begins to show problems:

deploy.install-monex:
     [echo] Installing monex ...

BUILD FAILED
/Users/joe/workspace/hsg-project/build.xml:68: XMLDB exception caught while executing query: Failed to invoke method queryP in class org.exist.xmlrpc.RpcConnection: null

Here is the relevant portion of build.xml is where we fetch and deploy monex:

<target name="deploy.install-monex">
    <echo message="Installing monex ..."/>
    <xdb:xquery uri="${instance.temp}" user="${instance.user}" password="${instance.password}"
                query="repo:install-and-deploy('http://exist-db.org/apps/monex', 'http://demo.exist-db.org/exist/apps/public-repo/modules/find.xql')"/>
</target>

Nothing shows in exist.log except this:

2015-11-29 17:55:30,777 [eXistThread-41] INFO  (Deploy.java [load]:274) - Retrieving package from http://demo.exist-db.org/exist/apps/public-repo/modules/find.xql?name=http%3A%2F%2Fexist-db.org%2Fapps%2Fmonex&processor=3.0.0

But I do see the following NPE in xmlrpc.log:

2015-11-29 17:55:30,393 [eXistThread-43] INFO  (RpcConnection.java [createCollection]:180) - collection /db/hsg-temp has been created 
2015-11-29 17:55:32,824 [eXistThread-41] ERROR (XmlRpcErrorLogger.java [log]:36) - Failed to invoke method queryP in class org.exist.xmlrpc.RpcConnection: null 
org.apache.xmlrpc.common.XmlRpcInvocationException: Failed to invoke method queryP in class org.exist.xmlrpc.RpcConnection: null
    at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:129) ~[xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRpcHandler.java:106) ~[xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.java:46) ~[xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86) ~[xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.java:200) [xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletServer.java:112) [xmlrpc-server-3.1.3.jar:3.1.3]
    at org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196) [xmlrpc-server-3.1.3.jar:3.1.3]
    at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:67) [exist.jar:?]
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:755) [servlet-api-3.0.jar:?]
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) [servlet-api-3.0.jar:?]
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:575) [jetty-security-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:229) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:103) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:50) [exist-optional.jar:?]
    at org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:221) [exist-optional.jar:?]
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) [servlet-api-3.0.jar:?]
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:533) [jetty-security-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) [jetty-servlet-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.Server.handle(Server.java:370) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) [jetty-http-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) [jetty-http-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) [jetty-server-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) [jetty-io-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) [jetty-io-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) [jetty-util-8.1.17.v20150415.jar:8.1.17.v20150415]
    at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) [jetty-util-8.1.17.v20150415.jar:8.1.17.v20150415]
    at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45]
Caused by: java.lang.NullPointerException
    at org.exist.xquery.modules.expathrepo.Deploy.eval(Deploy.java:173) ~[exist-modules.jar:?]
    at org.exist.xquery.BasicFunction.eval(BasicFunction.java:70) ~[exist.jar:?]
    at org.exist.xquery.InternalFunctionCall.eval(InternalFunctionCall.java:56) ~[exist.jar:?]
    at org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71) ~[exist.jar:?]
    at org.exist.xquery.PathExpr.eval(PathExpr.java:267) ~[exist.jar:?]
    at org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71) ~[exist.jar:?]
    at org.exist.xquery.XQuery.execute(XQuery.java:279) ~[exist.jar:?]
    at org.exist.xquery.XQuery.execute(XQuery.java:199) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.doQuery(RpcConnection.java:250) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.lambda$null$368(RpcConnection.java:1692) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection$$Lambda$141/1144117595.applyXmlRpc(Unknown Source) ~[?:?]
    at org.exist.xmlrpc.function.XmlRpcCompiledXQueryFunction.apply(XmlRpcCompiledXQueryFunction.java:41) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.lambda$compileQuery$429(RpcConnection.java:3509) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection$$Lambda$140/1653329033.apply(Unknown Source) ~[?:?]
    at org.exist.xmlrpc.RpcConnection.lambda$queryP$369(RpcConnection.java:1692) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection$$Lambda$139/1824893659.applyXmlRpc(Unknown Source) ~[?:?]
    at org.exist.xmlrpc.function.XmlRpcFunction.apply(XmlRpcFunction.java:45) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.withDb(RpcConnection.java:3764) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.withDb(RpcConnection.java:3748) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.queryP(RpcConnection.java:1662) ~[exist.jar:?]
    at org.exist.xmlrpc.RpcConnection.queryP(RpcConnection.java:3387) ~[exist.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_45]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_45]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_45]
    at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_45]
    at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpcHandler.java:115) ~[xmlrpc-server-3.1.3.jar:3.1.3]
    ... 48 more