baryonsoft / dspace Goto Github PK

deploy the maven package, see https://github.com/actions/starter-workflows/blob/main/ci/maven-publish.yml

30 records/min is too slow for a large metadata import

when replacements, it deletes all the dc meta fields and does not recreate ones not in the arxiv oai-pmh;

should preserve dc.date.accessioned, dc.date.available etc. which are created by baryonics when creating the new arxiv items

e.g. [dspace]/bin/dspace harvest -r -c collection -e eperson --recent 7 will only harvest metadata in the past 7 days.

Use Kong to set up an API Gateway enabling better management and versioning of APIs.

api.baryonics.org is the endpoint for all bib-core API resources, also the entry point at Kong.

api.baryonics.org/prod/v1/ is the production release of the API version-1.x that proxies to v1.prod.baryonics.org

api.baryonics.org/beta/v2/ is the beta release of the API version-2.x that proxies to v2.beta.baryonics.org

api.baryonics.org/staging/instanceID/ is the staging environment for the API version-3.x that proxies to instanceID.staging.baryonics.org

too many tags

new tags start from 0.2.4, bumping from v0.2.3 in the baryonics-invenio repo

If the arxiv paper replaces the previous submission, some metadata is lost.

For example, https://arxiv.org/abs/1906.04786 only has one author and two dates while the original one has 5 authors and 3 dates.

For instance, https://v1-prod.baryonics.org/api/discover/search/objects?sort=dc.date.accessioned,DESC&size=200&scope=2d83ccc9-ccde-4a35-885e-bded656abba1&dsoType=ITEM&page=0 only returns 100 results instead of 200 as requested.

Currently, the last Harvested time is always null. Setting it up could save harvesting time.

Codacy detected an issue:

Message: Found fs.open with non literal argument at index 0

Currently on:

• Commit: 747af9d
• File: dspace-rest/src/main/webapp/static/reports/restReport.js
• LineNum: 177

Normally, dspace.log receives logs rest api requests and others. However, when invoking a process in the web UI such as harvest, the process's log outputs to the dspace.log and the REST API requests are no longer logged. The dspace.log file does not get any new log entries even starting another process.

2021-11-04 20:55:30,689 INFO unknown unknown org.dspace.app.rest.scripts.handler.impl.RestDSpaceRunnableHandler @ Process id: 63, script name: harvest, message: Harvest started...

needs triage

• hep-ex
• math-ph
• cond-mat
• nucl-ex
• nucl-th

Daily ingest of new papers from arXiv

Codacy detected an issue:

Message: Generic Object Injection Sink

Occurred on:

• Commit: 5f5688e
• File: dspace-rest/src/main/webapp/static/reports/restCollReport.js
• LineNum: 464
• Code: td.append($("<div>"+fieldtext[j]+"</div>"));

Currently on:

• Commit: 747af9d
• File: dspace-rest/src/main/webapp/static/reports/restCollReport.js
• LineNum: 469

Tried to remove the affected commit but it still exists on github...

Tracking issue for:

• https://github.com/astrowq/baryonics-dspace/security/code-scanning/5