Code Monkey home page Code Monkey logo

feup-infolab / dendro Goto Github PK

View Code? Open in Web Editor NEW
28.0 13.0 3.0 116.16 MB

"Open-source Dropbox" with added description features. It is a data storage and description platform designed to help researchers and other users to describe their data files, built on Linked Open Data and ontologies. Users can use Dendro to publish data to CKAN, Zenodo, DSpace or EUDAT's B2Share and others.

Home Page: http://dendro.fe.up.pt

License: Other

JavaScript 91.42% HTML 7.01% CSS 0.92% Shell 0.26% R 0.01% Dockerfile 0.38%
dendro-platform dendro rdm research data linked-data infolab invenio

dendro's People

Contributors

brunobarros21 avatar bruunomarques avatar claudiolsmonteiro avatar dependabot[bot] avatar diasp-ppb avatar excelsi0r avatar feup-infolab-rdm avatar lazarocosta avatar mgpsp avatar nelsonpereira1991 avatar silvae86 avatar williamnf avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

dendro's Issues

Export to CKAN Fails

Please describe the expected behaviour

Dendro should export the current folder to the target CKAN Repository

Please describe the actual behaviour

Error occurs (see attached image)

14858763_1228340840561921_1651905327_o
14812853_1228340767228595_1471928793_o

What steps can be taken to reproduce the issue?

Try to export a folder into a CKAN Repository (tested with INESC Instance)

//cc @ylaleo

transferencia de todos os dados de projeto (até eliminados tambem)

explico: no dendro eu tinha projeto onde ja tinha mp3 depois eliminava depois tinha mais coisas depois eliminava depois tentava transferir para inesc. e entretanto agora no momento de teste da transferencia ele transferiu me e aqueles mp3 que no moemtno actual já nao existiam mais no projeto e ouros ficheiros que ja nao sei de onde foi buscar pois ja nao me lembro o que havia nesta pasta.
Tenho de vertificar mais ..

Add mandatory descriptors to a project to enable correct BagIt Exporting

We need to add these descriptors to the project on creation
see
project.js, line ~79

//TODO Add this information
var bagItOptions = {
cryptoMethod: 'sha256',
sourceOrganization: self.dcterms.publisher,
organizationAddress: '123 Street', <<<<<
contactName: 'Contact Name', <<<<<
contactPhone: '555-555-5555', <<<<<
contactEmail: '[email protected]', <<<<<
externalDescription: 'An example description' <<<<<
};

Add avatars to users via web service

  1. Make a web service to view and edit the user's avatar, for example on the route /user/dendrouser1/avatar (GET and POST)
  2. Change the user registration page to allow uploading avatar
  3. Change the user profile editing page in order to update the avatar.
  4. Change the navigation bar to display a tiny thumbnail next to the authenticated user's name with the appropriate avatar.

We cant upload files docx

  1. Trying to upload this type of files.

  2. Appear error
    erro de upload docx

  3. And after that - User automatically doing log-off of the Dendro

erro depois de erro de upload

Clicking on Select several files

Add possibility to choose folders and files clicking on the square. most of the people trying click on it, and cant choose folder..

Select is function only clicking on the name of folder or files..
3

Registration form

If user can not register the first time, all the information he filled is lost. I think we should add the possibility of not eliminate what is already filled, less clear password.

Dendro is not deleting past versions of resources

Dendro Version if known (or site URL)

0.2

Please describe the expected behaviour

Upon deleting a file definitively, the file and all its past versions should be deleted from the file storage (GridFS)

Please describe the actual behaviour

Only the last version of the file is deleted, creating garbage in the storage layer.

What steps can be taken to reproduce the issue?

Add a file and delete it. Check with RoboMongo if all the versions were deleted or not.

Possible ideas for solution (programming)

Need to patch the query that deletes the files in GridFS.

Add more time for warnings, or any whistle for user return to the page..

  1. If user waits much time for uplod or transfer to the ckan..can goes to see any page in his browser
    and when comes back to page dendro ..cant sees none warning, but, for exemple, transfer its not happened..and user doesnt know why? because could not sees warnings..or any whistle about the warning..

Popups prevent descriptor selection

Please describe the expected behaviour

Popup should not prevent user from selecting descriptor

Please describe the actual behaviour

Popup shows up on top of descriptor button

What steps can be taken to reproduce the issue?

Navigate to DC descriptors, hover over "Title" or "Author" and try to add it

CKAN Exporting fails

Please describe the expected behaviour

Datasets should be exported to CKAN

Please describe the actual behaviour

Folder is not exported, Error message:

`
Virtuoso server returned:

STATUS CODE 200

MESSAGE [TypeError: Path must be a string. Received undefined]

ERROR DESCRIPTION :

{ "head": { "link": [], "vars": ["uri", "type"] },
"results": { "distinct": false, "ordered": true, "bindings": [ ] } } RUNNING QUERY

SELECT ?uri ?type
FROM http://127.0.0.1:3001/dendro_graph
WHERE
{
{
http://127.0.0.1:3001/project/teste123456666/data/teste444/teste55555/teste2/teste45/teste2 nie:hasLogicalPart ?uri .
?uri rdf:type ?type .
?uri rdf:type nfo:Folder
} UNION {
http://127.0.0.1:3001/project/teste123456666/data/teste444/teste55555/teste2/teste45/teste2 nie:hasLogicalPart ?uri .
?uri rdf:type ?type .
?uri rdf:type nfo:FileDataObject
}
}
`

What steps can be taken to reproduce the issue?

Try to export a dataset to a CKAN instance

Duplicate text

On filed "Search" when i searching for exemple Temperature, after the finding description searched..text on the field "Search" will duplicate..
1

Registration form - add sugestion for field "Username" like field "Handle"(new project)

Or write text that appear on message the error. "Username can not include spaces or special characters..etc..

Because, many people try to register and have problem with choose username. As I told in the other sugestion, all information completed will eliminate. It is not very comfortable repeat to fill the information, for exemplo on the filed "description".

Dont work transfer to B2Share (Dendro-Inesc) with option use Dendro acount

According thesis the Fabio (pp 40-4.2. B2Share, the External Repository for Data and Metadata - If researchers wanted to deposit their data directly through B2Share’s webpage, they would have to create an account, download all their project from Dendro, upload it to B2Share and describe it all over again. However, that requires a lot of effort from them, which is not what we want and it is against the homogeneous process we are looking for. Therefore, our integration module connects the two ends and allows researchers to export their data directly via Dendro.....
All requests to the API require a token generated by B2Share. A B2Share account for Dendro
was created and the corresponding token is used for the communication. All records are deposited
into Dendro’s account, unless researchers have a B2Share account of their own. In that case,
they can use their token by the time of the deposit, and all data will go into their account.)

I tested to transfer dataset to B2Share (Dendro -Inesc) with Use Dendro acount - Sending...without stopping....and nothing transfered..
imagem

imagem

Juntar informaçao de dois description (no inesc)

Durante transferencia obrigatoriamente pede se adicionar description no Dendro (inesc) eu adicionei
e ele transferiu os dados, mas depois no datasets (no inesc) aparece mensagem This dataset has no description...mas dentro de dataset sim existe description..entao nao podiam juntar se essas dois description?

Search is not working

Please describe the expected behaviour

The search box should return some results when performing a free text search.

Please describe the actual behaviour

It is not currently working. No results are returned even though the metadata matches.

What steps can be taken to reproduce the issue?

Perform a free text search.

Handle edge case where there are two resources in different graphs with the same URI (Caching)

Dendro has a caching mechanism that relies on the URL of the resources as the Cache Database key. If a custom graph uri is passed to the Resource.findByUri method, it will try to fetch from cache first and save the returned object in cache if it has to go to the database.

If there are two calls with different graphs to get a resource with the same URI, the cache value will be returned on the second call, which may not be what we want.

For now this is handled by the code by specifying the criteria for the URL generation on every class...

Problem of layout when multiple files are selected

screen shot 2017-01-09 at 17 14 40

Dendro Version if known (or site URL)

Please describe the expected behaviour

Please describe the actual behaviour

What steps can be taken to reproduce the issue?

Possible ways to fix the problem (programmers)

Add FileVersion model to register file versioning in Dendro

Dendro Version if known (or site URL)

0.2

Objective

File uploads should be recorded in the Dendro graph, to keep track of file modifications.

How to do it

Create a file_versions.js file in the models/versions folder, which will represent the FileVersion class.

This model should record, as properties of the created FileVersion instances, all the fields currently present in the MongoDB record of the file.

An example of a record is:

{
    "_id" : ObjectId("54b03c94e94e9ea32d000001"),
    "filename" : "http://127.0.0.1:3001/project/datanotes2/data/Nielsen[1994].pdf",
    "contentType" : "binary/octet-stream",
    "length" : 259713,
    "chunkSize" : 262144,
    "uploadDate" : ISODate("2015-01-09T20:39:49.050Z"),
    "aliases" : null,
    "metadata" : {
        "project" : "http://127.0.0.1:3001/project/datanotes2",
        "type" : "nie:File"
    },
    "md5" : "b3bbe77e563bd4784c21db08bbc3066a"
}

It is necessary to map the values in these documents an ontology, except the id and alias . Maybe see in the NFO ontology or NIE ontology which properties can be used in each case (elements.js).

It is also necessary to add the creator of the file version to the metadata field of the MongoDB record.

Upon uploading a file (files.js controller), a new FileVersion should be created and saved in the graph with all the values of its properties coming from the result of the MongoDB operation (it makes no sense to save FileVersions for GFS uploads that fail).

Parent Folders will have to be updated as well on saving a file directly above them, meaning only the parent folder of the uploaded or updated file will have its nie.contentLastModified value updated with uploadDate value returned by the GFS operation.

What happens when a file of folder is updated

RFC

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.