Code Monkey home page Code Monkey logo

Comments (8)

arcade-player avatar arcade-player commented on June 11, 2024

Do you have any log from the server side too? or, can tou provide scripts to create a sample db of your data?

from arcadeanalytics.

terence-bigtt avatar terence-bigtt commented on June 11, 2024

Hello !
Same problem here.

The search typed request is

g.V().limit(5)

Nothing particular in the backend end log:

2020-03-23 08:24:03.925  INFO 7 --- [ XNIO-2 task-27] c.a.p.gremlin.GremlinDataProvider        : fetching data from '1354' with query 'g.V().limit(5)
arcadeanalytics-single_1  | ' 
arcadeanalytics-single_1  | 2020-03-23 08:24:04.285  INFO 7 --- [ XNIO-2 task-27] c.a.p.gremlin.GremlinDataProvider        : fetched 5 nodes and 0 edges 

The front end properly receives a result from the search call:

Request URL: http://localhost:8080/api/widgets/data/1452
Request Method: POST
Status Code: 200 OK

The response from this call is:

{"nodesClasses":{"Act":{"iid":"String","name":"String"},"Person":{"gender":"String","birthYear":"String"}},"edgesClasses":{},"nodes":[{"classes":"Act","group":"nodes","data":{"id":"1354_5128296","parent":"","source":"","target":"","record":{"@out":{},"@edgeCount":0,"iid":"1002578","@in":{},"name":"155735"}},"position":{},"selected":"","selectable":"","locked":"","grabbable":""},{"classes":"Act","group":"nodes","data":{"id":"1354_6119560","parent":"","source":"","target":"","record":{"@out":{},"@edgeCount":0,"iid":"1007404","@in":{},"name":"229073"}},"position":{},"selected":"","selectable":"","locked":"","grabbable":""},{"classes":"Act","group":"nodes","data":{"id":"1354_6652128","parent":"","source":"","target":"","record":{"@out":{},"@edgeCount":0,"iid":"1010940","@in":{},"name":"262500"}},"position":{},"selected":"","selectable":"","locked":"","grabbable":""},{"classes":"Person","group":"nodes","data":{"id":"1354_32288896","parent":"","source":"","target":"","record":{"@out":{},"@edgeCount":0,"gender":"M","birthYear":1982,"@in":{}}},"position":{},"selected":"","selectable":"","locked":"","grabbable":""},{"classes":"Act","group":"nodes","data":{"id":"1354_13488312","parent":"","source":"","target":"","record":{"@out":{},"@edgeCount":0,"iid":"1043282","@in":{},"name":"688133"}},"position":{},"selected":"","selectable":"","locked":"","grabbable":""}],"edges":[],"truncated":false}

This seems to be a front end issue ?
Any idea on how to fix ?
Thx

from arcadeanalytics.

terence-bigtt avatar terence-bigtt commented on June 11, 2024

Hi again !
After some times it works.
It takes some time to load the nodesClasses (12 min).
Is it aa problem specific to Janusgraph ?
Maybe the call to get the graph metadata could be optimized ?

from arcadeanalytics.

arcade-player avatar arcade-player commented on June 11, 2024

The metadata provider for Gremlin is here:

https://github.com/ArcadeData/arcade-connectors/blob/master/gremlin/src/main/kotlin/com/arcadeanalytics/provider/gremlin/GremlinMetadataProvider.kt

We developed and tested on small databases. How big is your db?

from arcadeanalytics.

terence-bigtt avatar terence-bigtt commented on June 11, 2024

Hi
Thx for the feedback.

My graph is not very big.. The order of magnitude is 100k vertices and edges.

Quickly looking at your code, it seems to me that the count methods on the node and edge counts might take longer, as it requires traversing the whole graph.
Actually counting nodes and edges in janus without relying on indexes is tricky from my (little) experience.

Could the counts be done asynchronously and update the meta when or if the result arrives?

Also I think the functions mapNodeClasses and mapEdgeClasses may take a while, again because of traversing the whole graph.

Maybe looking at the management Api might be relevant for getting the labels.

from arcadeanalytics.

terence-bigtt avatar terence-bigtt commented on June 11, 2024

Here for the management Api : https://stackoverflow.com/a/49404838/7634184

from arcadeanalytics.

arcade-player avatar arcade-player commented on June 11, 2024

Thanks for pointing us to that. This implies to write a dedicated MetadataProvider for Janus that uses the custom api.

from arcadeanalytics.

terence-bigtt avatar terence-bigtt commented on June 11, 2024

Actually this may be a generic issue related to gremlin servers, see for instance https://stackoverflow.com/a/48946734/7634184

The frustrating point is that the view won't work without the Metadata.

It would be nice if (part) of the widget could be used without completion of the Metadata call.. I'm thinking for instance to the custom query widget, that doesn't really need the Metadata to run..

from arcadeanalytics.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.