VIVO Harvester (xsltranslator issue) about vivo-harvester HOT 5 CLOSED

raw-records or raw-data? If it's not that simple, you can email me ([email protected]) and I'll try to help.

from vivo-harvester.

The files are in raw-records

from vivo-harvester.

The files in raw-records are the result of the first step in the harvest pipeline from running the OAIFetch tool. They don't have file extensions, but are basically xml files. Each file corresponds to one article. The harvester-xsltranslator tool will transform the xml (using the xsl file defined in xsltranslator.config.xml) to transform the oai-pmh result into vivo compliant RDF. While all of the harvester tools can be run with command line options, the examples use {toolname}.config.xml files to define all the parameters. The "Wordiness" parameter is basically a log level and you can try changing it to DEBUG to get more info. The xsltranslator.config.xml file has a "force" parameter set to true (unless you've changed it). Unless you clean out the data directory, it won't transform data in the raw-records file if there are transformed files in the data/translated-records directory.

from vivo-harvester.

The data/translated-records folder is empty, before I run the script I delete the data folder and sub-folders. Even after I run the script the data/translated-records folder is empty.
In the terminal output I pasted on the original issue, translator is on debug.
The force parameter I didn't add or change, since I copied the example-oaifetch I only modified certain parts, but that parameter I haven't touched.

from vivo-harvester.

After many tests I have figured out that the raw-data had 2 inconsistencies:

1. It was being download into another subfolder, so I had to copy the file from raw-data/reposiroty to raw-data
2. The files had special chacarters so I added a line to the bash to remove that string.

Now I'm score-pub.conf.xml since it outpus:

2018-05-28 10:45:21.849 INFO  [o.v.h.s.Score] Score: Start
2018-05-28 10:47:36.326 INFO  [o.v.h.s.Score] No Results Found
2018-05-28 10:47:36.340 INFO  [o.v.h.s.Score] Finished building Record Set
2018-05-28 10:47:36.340 INFO  [o.v.h.s.Score] Added this many records: 0
2018-05-28 10:47:36.341 INFO  [o.v.h.s.Score] Score: End

from vivo-harvester.