mneedham / neo4j-kubernetes Goto Github PK

After running through all the commands, I am getting:

Starting Neo4j.
2017-07-20 12:03:37.931+0000 INFO  No SSL certificate found, generating a self-signed certificate..
2017-07-20 12:03:39.663+0000 INFO  Starting...
2017-07-20 12:03:41.213+0000 INFO  Bolt enabled on 0.0.0.0:7687.
2017-07-20 12:03:41.228+0000 INFO  Initiating metrics...
2017-07-20 12:03:41.548+0000 INFO  Waiting for other members to join cluster before continuing...

Because of this, I can't seem to get the browser interface working and connect like: #1

Any advice?

UPDATE: It seems to be because some of the pods end up crashing, then get stuck trying to restart. It seems to work immediately after the first 3 steps (before the crashes).

$ ./neo4j.sh
$ kubectl create -f neo4j_svc.yaml
$ kubectl create -f neo4j_core.yaml
$ kubectl port-forward neo4j-core-0 7474:7474

Then going to http://localhost:7474 (turn off bolt to set password) works.

Am currently trying to find out exactly when it starts crashing.

@mneedham

Thanks for your efforts in getting this running. I wanted to test it out, but I've hit a few obstacles.
I think your README is slightly out-of-sync with your files in this repo, but I was able to get things going by running kubectl create -f neo4j_env.yml, which combines the core cluster statefulset and a service together.

As per these logs from one of the core pods, the cluster seems to form fine.

2017-02-09T13:20:13.558079356Z Starting Neo4j.
2017-02-09T13:20:14.882575065Z 2017-02-09 13:20:14.881+0000 INFO  No SSL certificate found, generating a self-signed certificate..
2017-02-09T13:20:16.123709705Z 2017-02-09 13:20:16.123+0000 INFO  Starting...
2017-02-09T13:20:18.015336265Z 2017-02-09 13:20:18.014+0000 INFO  Bolt enabled on 0.0.0.0:7687.
2017-02-09T13:20:18.042945087Z 2017-02-09 13:20:18.042+0000 INFO  Initiating metrics...
2017-02-09T13:20:18.363854719Z 2017-02-09 13:20:18.363+0000 INFO  Waiting for other members to join cluster before continuing...
2017-02-09T13:21:16.087812697Z 2017-02-09 13:21:16.087+0000 INFO  Started.
2017-02-09T13:21:16.531841102Z 2017-02-09 13:21:16.531+0000 INFO  Mounted REST API at: /db/manage
2017-02-09T13:21:19.500402108Z 2017-02-09 13:21:19.500+0000 INFO  Remote interface available at http://neo4j-core-0.neo4j.default.svc.cluster.local:7474/

However, in looking to interface with the installation, I ran kubectl port-forward neo4j-core-0 7474:7474, which forwards port 7474 from the cluster to my local browser. While this appears to partly work, it's not allowing me to enter the default neo4j password, so that I can set my own.

In the past, I've been able to get around this problem by adding an end-point for bolt. I modified the headless service as follows:

# Headless service to provide DNS lookup
apiVersion: v1
kind: Service
metadata:
  labels:
    app: neo4j
  name: neo4j
spec:
  clusterIP: None
  ports:
    - port: 7474
      name: http
      targetPort: 7474
    - port: 7687
      name: bolt
      targetPort: 7687  
  selector:
    app: neo4j

... hoping that that would allow me to feed either 0.0.0.0:7687 or neo4j-core-0.neo4j.default.svc.cluster.local:7687 into the bolt field in settings, but neither work. Can you suggest what I might be able to do to get this working? Is there another form/way of entering the bolt end-point? I see you have value: "bolt://@192.168.1.3:7687" at the bottom of the README, but I'm not sure in what context.

In terms of getting pre-existing data into this cluster, is there a recommended approach using kubectl exec to stop a neo4j process temporarily on one node and then kubectl cp to copy in a backup/zipped folder of a database, that can be used to seed the other nodes?

Neo4j stuck at " Attempting to connect to the other cluster members before continuing..." in K* Pod

Please let me know, where I a missing
Pod Log:

2017-10-04T05:22:19.869450675Z Starting Neo4j.
2017-10-04T05:22:20.700879487Z 2017-10-04 05:22:20.699+0000 INFO ======== Neo4j 3.2.3 ========
2017-10-04T05:22:20.741715691Z 2017-10-04 05:22:20.741+0000 INFO Starting...
2017-10-04T05:22:22.69240081Z 2017-10-04 05:22:22.692+0000 INFO Bolt enabled on 0.0.0.0:7687.
2017-10-04T05:22:22.720298001Z 2017-10-04 05:22:22.720+0000 INFO Initiating metrics...
2017-10-04T05:22:22.871594391Z 2017-10-04 05:22:22.871+0000 INFO Resolved initial host 'neo4j.default.svc.cluster.local:5000' to []
2017-10-04T05:22:22.923101349Z 2017-10-04 05:22:22.922+0000 INFO My connection info: [
2017-10-04T05:22:22.923128826Z Discovery: listen=0.0.0.0:5000, advertised=neo4jdev-0.neo4jdev.default.svc.cluster.local:5000,
2017-10-04T05:22:22.923133033Z Transaction: listen=0.0.0.0:6000, advertised=neo4jdev-0.neo4jdev.default.svc.cluster.local:6000,
2017-10-04T05:22:22.923145831Z Raft: listen=0.0.0.0:7000, advertised=neo4jdev-0.neo4jdev.default.svc.cluster.local:7000,
2017-10-04T05:22:22.923150015Z Client Connector Addresses: bolt://neo4jdev-0.neo4jdev.default.svc.cluster.local:7687,http://neo4jdev-0.neo4jdev.default.svc.cluster.local:7474,https://neo4jdev-0.neo4jdev.default.svc.cluster.local:7473
2017-10-04T05:22:22.92315428Z ]
2017-10-04T05:22:22.928242549Z 2017-10-04 05:22:22.927+0000 INFO Discovering cluster with initial members: [neo4j.default.svc.cluster.local:5000]
2017-10-04T05:22:22.930790799Z 2017-10-04 05:22:22.930+0000 INFO Attempting to connect to the other cluster members before continuing...
2017-10-09T06:32:19.459209874Z 2017-10-09 06:32:19.459+0000 INFO Attempting to connect to the other cluster members before continuing...
2017-10-09T06:37:52.502700794Z 2017-10-09 06:37:52.502+0000 ERROR Failed to start Neo4j: Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@24ca395c' was successfully initialized, but failed to start. Please see the attached cause exception "Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.". Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@24ca395c' was successfully initialized, but failed to start. Please see the attached cause exception "Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.".
2017-10-09T06:37:52.502732862Z org.neo4j.server.ServerStartupException: Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@24ca395c' was successfully initialized, but failed to start. Please see the attached cause exception "Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.".
2017-10-09T06:37:52.502738551Z at org.neo4j.server.exception.ServerStartupErrors.translateToServerStartupError(ServerStartupErrors.java:68)
2017-10-09T06:37:52.502743026Z at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:215)
2017-10-09T06:37:52.502746483Z at org.neo4j.server.ServerBootstrapper.start(ServerBootstrapper.java:107)
2017-10-09T06:37:52.502749847Z at org.neo4j.server.ServerBootstrapper.start(ServerBootstrapper.java:80)
2017-10-09T06:37:52.502753303Z at org.neo4j.server.enterprise.EnterpriseEntryPoint.main(EnterpriseEntryPoint.java:32)
2017-10-09T06:37:52.502756715Z Caused by: org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.server.database.LifecycleManagingDatabase@24ca395c' was successfully initialized, but failed to start. Please see the attached cause exception "Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.".
2017-10-09T06:37:52.502760685Z at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:444)
2017-10-09T06:37:52.50276361Z at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:107)
2017-10-09T06:37:52.502766645Z at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:207)
2017-10-09T06:37:52.502769662Z ... 3 more
2017-10-09T06:37:52.502780903Z Caused by: java.lang.RuntimeException: Error starting org.neo4j.kernel.impl.factory.GraphDatabaseFacadeFactory, /var/lib/neo4j/data/databases/graph.db
2017-10-09T06:37:52.502784384Z at org.neo4j.kernel.impl.factory.GraphDatabaseFacadeFactory.initFacade(GraphDatabaseFacadeFactory.java:209)
2017-10-09T06:37:52.502787208Z at org.neo4j.causalclustering.core.CoreGraphDatabase.(CoreGraphDatabase.java:49)
2017-10-09T06:37:52.502790312Z at org.neo4j.causalclustering.core.CoreGraphDatabase.(CoreGraphDatabase.java:41)
2017-10-09T06:37:52.502793357Z at org.neo4j.server.enterprise.EnterpriseNeoServer.lambda$static$2(EnterpriseNeoServer.java:80)
2017-10-09T06:37:52.502796239Z at org.neo4j.server.database.LifecycleManagingDatabase.start(LifecycleManagingDatabase.java:89)
2017-10-09T06:37:52.502799Z at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:434)
2017-10-09T06:37:52.502801894Z ... 5 more
2017-10-09T06:37:52.502804988Z Caused by: org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.causalclustering.core.state.CoreLife@20a2ffd8' was successfully initialized, but failed to start. Please see the attached cause exception "Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.".
2017-10-09T06:37:52.502808499Z at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:444)
2017-10-09T06:37:52.502811242Z at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:107)
2017-10-09T06:37:52.502813941Z at org.neo4j.kernel.impl.factory.GraphDatabaseFacadeFactory.initFacade(GraphDatabaseFacadeFactory.java:205)
2017-10-09T06:37:52.502816756Z ... 10 more
2017-10-09T06:37:52.502819813Z Caused by: java.util.concurrent.TimeoutException: Failed to join a cluster with members {clusterId=null, bootstrappable=false, coreMembers={}}. Another member should have published a clusterId but none was detected. Please restart the cluster.
2017-10-09T06:37:52.502823721Z at org.neo4j.causalclustering.identity.ClusterBinder.bindToCluster(ClusterBinder.java:110)
2017-10-09T06:37:52.502826532Z at org.neo4j.causalclustering.core.state.CoreLife.start(CoreLife.java:67)
2017-10-09T06:37:52.502839713Z at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:434)
2017-10-09T06:37:52.502842616Z ... 12 more
2017-10-09T06:37:52.503707776Z 2017-10-09 06:37:52.503+0000 INFO Neo4j Server shutdown initiated by request