Comments (25)
PaulZhangIsing
commented on May 28, 2024
1
@jkhenning Thanks for your help~
Hi @PaulZhangIsing , The UI looks like it simply cannot connect to the server (the behavior and also the log you shared). Can you simply try to browse to "http://localhost:8008" and to "http://localhost:8080/api"
localhost:8008 and 8080/api all gives the same response.
Any idea on how to solve it?
Finished and solved. just clear cache of the web browser
from clearml-server.
bmartinn
commented on May 28, 2024
Hi @sjiki , I assume the port forwarding on your machine is a way to increase security (such as SSH port forwarding, instead of opening your GCP instance to the world :)
If that is the case, just add port 8008 for the API server and port 8081 for your files server, it should work just fine.
That said, notice that if you are running experiments with Trains, using a similar setup and configuring the trains.conf with "localhost" the artifacts & debug images links, will point to "https://localhost:8081/", meaning you will only be able to access them with said port forwarding setup.
from clearml-server.
sjiki
commented on May 28, 2024
Thank you for answering question I examine the logger
following error occured
trains-apiserver | [2019-11-17 06:29:17,921] [18] [INFO] [trains.server] ################ API Server initializing #####################
trains-apiserver | [2019-11-17 06:29:17,921] [18] [INFO] [trains.database] Initializing database connections
trains-apiserver | [2019-11-17 06:29:17,922] [18] [INFO] [trains.database] Using override mongodb host mongo
trains-apiserver | [2019-11-17 06:29:17,924] [18] [INFO] [trains.database] Registering connection to auth-db (mongodb://mongo:27017/auth)
trains-apiserver | [2019-11-17 06:29:17,926] [18] [INFO] [trains.database] Registering connection to backend-db (mongodb://mongo:27017/backend)
trains-apiserver | [2019-11-17 06:29:17,927] [18] [INFO] [trains.init_data] Applying mappings to host: http://elasticsearch:9200
trains-apiserver | [2019-11-17 06:29:17,937] [18] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff9549189b0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /_template/events
trains-apiserver | [2019-11-17 06:29:17,943] [17] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff954918940>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /_template/events
trains-apiserver | [2019-11-17 06:29:17,948] [14] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff9549187f0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /_template/events
from clearml-server.
bmartinn
commented on May 28, 2024
Hi @sjiki ,
From the attached log it seems the elastic docker is not up (or at least the trains-apiserver cannot reach it). This looks unrelated to the port forwarding issue...
When you execute:
$ docker ps
Do you have all 6 dockers running ?
from clearml-server.
sjiki
commented on May 28, 2024
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
89ab2baab9d8 allegroai/trains:latest "/opt/trains/wrapper…" 33 hours ago Up About a minute 8008/tcp, 8080-8081/tcp, 0.0.0.0:8080->80/tcp trains-webserver
641546d02f05 allegroai/trains:latest "/bin/bash -c 'cd /o…" 33 hours ago Up 9 seconds 0.0.0.0:8008->8008/tcp, 8080-8081/tcp trains-apiserver
bbfcd6052e39 mongo:3.6.5 "docker-entrypoint.s…" 33 hours ago Up About a minute 0.0.0.0:27017->27017/tcp trains-mongo
28011e03aa2a allegroai/trains:latest "/opt/trains/wrapper…" 33 hours ago Up About a minute 8008/tcp, 8080/tcp, 0.0.0.0:8081->8081/tcp trains-fileserver
b1d585b84406 docker.elastic.co/elasticsearch/elasticsearch:5.6.16 "/bin/bash bin/es-do…" 33 hours ago Up 2 seconds 0.0.0.0:9200->9200/tcp, 9300/tcp trains-elastic
this is docker ps result
from clearml-server.
bmartinn
commented on May 28, 2024
Hi @sjiki
From the docker ps output it seems the elasticsearch container keeps restarting on some error.
Sometimes that could happen if another service on the machine will already use port 9200 (the elasticsearch port)
You can quickly verify that, first spin down the dockers:
$ docker-compose down
Then execute:
$ netstat -natp
You should not have any process listening on port 9200
If that is not the case, could you please send the full logs of the docker-compose?
from clearml-server.
sjiki
commented on May 28, 2024
this is a netstat -natp results
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
tcp 0 0 10.128.0.25:60120 169.254.169.254:80 ESTABLISHED -
tcp 0 0 10.128.0.25:60010 169.254.169.254:80 CLOSE_WAIT -
tcp 0 0 10.128.0.25:60118 169.254.169.254:80 ESTABLISHED -
tcp 0 0 10.128.0.25:60138 169.254.169.254:80 ESTABLISHED -
tcp 0 400 10.128.0.25:22 74.125.41.100:60880 ESTABLISHED -
tcp6 0 0 :::22 :::* LISTEN -
docker compose result
Creating network "trains-server_backend" with driver "bridge"
Creating trains-elastic ... done
Creating trains-fileserver ... done
Creating trains-mongo ... done
Creating trains-apiserver ... done
Creating trains-webserver ... done
Attaching to trains-mongo, trains-elastic, trains-fileserver, trains-apiserver, trains-webserver
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] MongoDB starting : pid=1 port=27017 dbpa
th=/data/db 64-bit host=b388963321f9
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] db version v3.6.5
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] git version: a20ecd3e3a174162052ff99913b
c2ca9a839d618
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1t 3 May 2
016
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] allocator: tcmalloc
trains-mongo | 2019-11-19T13:32:35.407+0000 I CONTROL [initandlisten] modules: none
trains-mongo | 2019-11-19T13:32:35.408+0000 I CONTROL [initandlisten] build environment:
trains-mongo | 2019-11-19T13:32:35.408+0000 I CONTROL [initandlisten] distmod: debian81
trains-mongo | 2019-11-19T13:32:35.408+0000 I CONTROL [initandlisten] distarch: x86_64
trains-mongo | 2019-11-19T13:32:35.408+0000 I CONTROL [initandlisten] target_arch: x86_64
trains-mongo | 2019-11-19T13:32:35.408+0000 I CONTROL [initandlisten] options: { net: { bindIpAll: true }, set
Parameter: { internalQueryExecMaxBlockingSortBytes: "196100200" } }
trains-mongo | 2019-11-19T13:32:35.409+0000 I - [initandlisten] Detected data files in /data/db created
by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
trains-mongo | 2019-11-19T13:32:35.409+0000 I STORAGE [initandlisten]
trains-mongo | 2019-11-19T13:32:35.409+0000 I STORAGE [initandlisten] ** WARNING: Using the XFS filesystem is
strongly recommended with the WiredTiger storage engine
trains-mongo | 2019-11-19T13:32:35.409+0000 I STORAGE [initandlisten] ** See http://dochub.mongodb.or
g/core/prodnotes-filesystem
trains-mongo | 2019-11-19T13:32:35.409+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_siz
e=3224M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),cache_cursors=
false,log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statisti
cs_log=(wait=0),verbose=(recovery_progress),
trains-mongo | 2019-11-19T13:32:36.301+0000 I STORAGE [initandlisten] WiredTiger message [1574170356:301121][1
:0x7f8015b76a00], txn-recover: Main recovery loop: starting at 14/4864
trains-mongo | 2019-11-19T13:32:36.514+0000 I STORAGE [initandlisten] WiredTiger message [1574170356:514880][1
:0x7f8015b76a00], txn-recover: Recovering log 14 through 15
trains-mongo | 2019-11-19T13:32:36.611+0000 I STORAGE [initandlisten] WiredTiger message [1574170356:610991][1
:0x7f8015b76a00], txn-recover: Recovering log 15 through 15
trains-mongo | 2019-11-19T13:32:36.726+0000 I STORAGE [initandlisten] WiredTiger message [1574170356:726008][1
:0x7f8015b76a00], txn-recover: Set global recovery timestamp: 0
trains-mongo | 2019-11-19T13:32:36.750+0000 I CONTROL [initandlisten]
trains-mongo | 2019-11-19T13:32:36.750+0000 I CONTROL [initandlisten] ** WARNING: Access control is not enable
d for the database.
trains-mongo | 2019-11-19T13:32:36.750+0000 I CONTROL [initandlisten] ** Read and write access to dat
a and configuration is unrestricted.
trains-mongo | 2019-11-19T13:32:36.750+0000 I CONTROL [initandlisten]
trains-mongo | 2019-11-19T13:32:36.773+0000 I FTDC [initandlisten] Initializing full-time diagnostic data c
apture with directory '/data/db/diagnostic.data'
trains-mongo | 2019-11-19T13:32:36.774+0000 I NETWORK [initandlisten] waiting for connections on port 27017
trains-apiserver | [2019-11-19 13:32:41 +0000] [7] [INFO] Starting gunicorn 19.9.0
trains-apiserver | [2019-11-19 13:32:41 +0000] [7] [INFO] Listening at: http://0.0.0.0:8008 (7)
trains-apiserver | [2019-11-19 13:32:41 +0000] [7] [INFO] Using worker: sync
trains-apiserver | [2019-11-19 13:32:41 +0000] [10] [INFO] Booting worker with pid: 10
trains-apiserver | [2019-11-19 13:32:41 +0000] [11] [INFO] Booting worker with pid: 11
trains-apiserver | [2019-11-19 13:32:41 +0000] [12] [INFO] Booting worker with pid: 12
trains-apiserver | [2019-11-19 13:32:41 +0000] [14] [INFO] Booting worker with pid: 14
trains-apiserver | [2019-11-19 13:32:41 +0000] [13] [INFO] Booting worker with pid: 13
trains-apiserver | [2019-11-19 13:32:41 +0000] [15] [INFO] Booting worker with pid: 15
trains-apiserver | [2019-11-19 13:32:41 +0000] [16] [INFO] Booting worker with pid: 16
trains-apiserver | [2019-11-19 13:32:41 +0000] [17] [INFO] Booting worker with pid: 17
trains-fileserver | Loading config from /opt/trains/fileserver/config/default
trains-fileserver | Loading config from file /opt/trains/fileserver/config/default/fileserver.conf
trains-fileserver | Loading config from file /opt/trains/fileserver/config/default/logging.conf
trains-fileserver | Loading config from /opt/trains/config
trains-fileserver | * Serving Flask app "fileserver" (lazy loading)
trains-fileserver | * Environment: production
trains-fileserver | WARNING: This is a development server. Do not use it in a production deployment.
trains-fileserver | Use a production WSGI server instead.
trains-fileserver | * Debug mode: off
trains-elastic | [2019-11-19T13:32:42,742][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:42,855][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught
exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create
node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearc
h-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~
[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch
-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.
6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.
6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.1
6.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.j
ar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.ja
r:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?
]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.1
6.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.j
ar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.ja
r:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-apiserver | [2019-11-19 13:32:50,342] [10] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,343] [15] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,345] [15] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,342] [10] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,470] [11] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,485] [11] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,578] [12] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,586] [12] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,638] [13] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,645] [13] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,830] [17] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,831] [17] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:50,878] [14] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:50,887] [14] [INFO] [trains.schema] regenerating schema cache
trains-apiserver | [2019-11-19 13:32:51,334] [16] [WARNING] [trains.schema] failed loading cache: [Errno 2] No such
file or directory: '/opt/trains/server/schema/services/_cache.json'
trains-apiserver | [2019-11-19 13:32:51,335] [16] [INFO] [trains.schema] regenerating schema cache
trains-elastic exited with code 1
trains-elastic | [2019-11-19T13:32:42,742][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:42,855][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught
exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create
node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearc
h-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~
[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch
-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.
6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.
6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.1
6.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.j
ar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.ja
r:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?
]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5
.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.1
6.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | [2019-11-19T13:32:51,298][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:51,362][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | [2019-11-19T13:32:59,631][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:59,737][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic exited with code 1
trains-elastic | [2019-11-19T13:32:42,742][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:42,855][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | [2019-11-19T13:32:51,298][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:51,362][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
trains-elastic | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
trains-elastic | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]
trains-elastic | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_201]
trains-elastic | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_201]
trains-elastic | at org.elasticsearch.env.NodeEnvironment.(NodeEnvironment.java:225) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | ... 6 more
trains-elastic | [2019-11-19T13:33:17,382][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:33:17,464][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | Caused by: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.node.Node.(Node.java:268) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.node.Node.(Node.java:245) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:233) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.16.ja
rains-apiserver | [2019-11-19 13:33:30,849] [11] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:30,851] [15] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:30,852] [12] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:31,202] [14] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:31,311] [13] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:31,324] [10] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:31,708] [17] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-apiserver | [2019-11-19 13:33:31,775] [16] [INFO] [trains.es_factory] Using override elastic host elasticsearch
trains-elastic | [2019-11-19T13:32:42,742][INFO ][o.e.n.Node ] [trains] initializing ...
trains-elastic | [2019-11-19T13:32:42,855][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [trains] uncaught exception in thread [main]
trains-elastic | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.16.jar:5.6.16]
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.
trains-apiserver | [2019-11-19 13:33:36,333] [16] [INFO] [trains.server] ################ API Server initializing #####################
trains-apiserver | [2019-11-19 13:33:36,335] [16] [INFO] [trains.database] Initializing database connections
trains-apiserver | [2019-11-19 13:33:36,336] [16] [INFO] [trains.database] Using override mongodb host mongo
trains-apiserver | [2019-11-19 13:33:36,337] [17] [INFO] [trains.server] ################ API Server initializing #####################
trains-apiserver | [2019-11-19 13:33:36,338] [17] [INFO] [trains.database] Initializing database connections
trains-apiserver | [2019-11-19 13:33:36,338] [17] [INFO] [trains.database] Using override mongodb host mongo
trains-apiserver | [2019-11-19 13:33:36,340] [17] [INFO] [trains.database] Registering connection to auth-db (mongodb://mongo:27017/auth)
trains-apiserver | [2019-11-19 13:33:36,340] [16] [INFO] [trains.database] Registering connection to auth-db (mongodb://mongo:27017/auth)
trains-apiserver | [2019-11-19 13:33:36,342] [17] [INFO] [trains.database] Registering connection to backend-db (mongodb://mongo:27017/backend)
trains-apiserver | [2019-11-19 13:33:36,343] [17] [INFO] [trains.init_data] Applying mappings to host: http://elasticsearch:9200
trains-apiserver | [2019-11-19 13:33:36,344] [16] [INFO] [trains.database] Registering connection to backend-db (mongodb://mongo:27017/backend)
trains-apiserver | [2019-11-19 13:33:36,346] [16] [INFO] [trains.init_data] Applying mappings to host: http://elasticsearch:9200
trains-apiserver | [2019-11-19 13:33:36,364] [16] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f431b1fd0>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:36,367] [17] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f43225fd0>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:36,791] [15] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f432e5630>: Failed to establish a new connection: [Errno 111] Connection refused',)
': /_template/events
trains-apiserver | [2019-11-19 13:33:36,796] [11] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f431b3748>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:36,859] [10] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f42e36e80>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:36,939] [12] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f432d5048>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:37,107] [14] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f432ec908>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:37,199] [13] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f43214240>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:37,369] [16] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f4439dc88>: Failed to establish a new connection: [Errno 111] Connection refused',)': /_template/events
trains-apiserver | [2019-11-19 13:33:37,370] [17] [WARNING] [urllib3.connectionpool] Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7f43225f98>: Failed to establish a new connection: [Errno 111] Connection refused',
from clearml-server.
bmartinn
commented on May 28, 2024
Hi @sjiki , from the full log it seems like a permission problem on the elastic data folder.
Specifically it is mounted externally to /opt/trains/data/elastic
I suggest to make sure we have all the directories and permission set:
sudo mkdir -p /opt/trains/data/elastic
sudo mkdir -p /opt/trains/data/mongo/db
sudo mkdir -p /opt/trains/data/mongo/configdb
sudo mkdir -p /opt/trains/data/redis
sudo mkdir -p /opt/trains/logs
sudo mkdir -p /opt/trains/data/fileserver
sudo mkdir -p /opt/trains/config
sudo chown -R 1000:1000 /opt/trains
Notice the last line will set permissions to the folders, so that the docker user could access them, once that's done, please try to spin the dockers again.
If the problem continues, please try the following command, and again spin the docker afterwards:
sudo chown -R $(whoami):$(whoami) /opt/trains
If that also fails, you could try:
sudo chmod 777 -R /opt/trains
🤞
from clearml-server.
sjiki
commented on May 28, 2024
I tried but following error occured
trains-apiserver | [2019-11-20 10:58:35,951] [10] [INFO] [trains.server] ################ API Server initializing #####################
trains-apiserver | [2019-11-20 10:58:35,971] [10] [INFO] [trains.database] Initializing database connections
trains-apiserver | [2019-11-20 10:58:35,972] [10] [INFO] [trains.database] Using override mongodb host mongo
trains-apiserver | [2019-11-20 10:58:35,975] [10] [INFO] [trains.database] Registering connection to auth-db (mongodb://mongo:27017/auth)
trains-apiserver | [2019-11-20 10:58:35,977] [10] [INFO] [trains.database] Registering connection to backend-db (mongodb://mongo:27017/backend)
trains-apiserver | [2019-11-20 10:58:35,983] [10] [INFO] [trains.init_data] Applying mappings to host: http://elasticsearch:9200
trains-apiserver | [2019-11-20 10:58:36,025] [11] [INFO] [trains.init_data] Fixed users mode is enabled
trains-apiserver | [2019-11-20 10:58:36 +0000] [11] [ERROR] Exception in worker process
trains-apiserver | Traceback (most recent call last):
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 539, in connect
trains-apiserver | sock = self._connect()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 596, in _connect
trains-apiserver | raise err
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 584, in _connect
trains-apiserver | sock.connect(socket_address)
trains-apiserver | ConnectionRefusedError: [Errno 111] Connection refused
trains-apiserver |
trains-apiserver | During handling of the above exception, another exception occurred:
trains-apiserver |
trains-apiserver | Traceback (most recent call last):
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
trains-apiserver | worker.init_process()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/workers/base.py", line 129, in init_process
trains-apiserver | self.load_wsgi()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/workers/base.py", line 138, in load_wsgi
trains-apiserver | self.wsgi = self.app.wsgi()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/app/base.py", line 67, in wsgi
trains-apiserver | self.callable = self.load()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 52, in load
trains-apiserver | return self.load_wsgiapp()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 41, in load_wsgiapp
trains-apiserver | return util.import_app(self.app_uri)
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/gunicorn/util.py", line 350, in import_app
trains-apiserver | import(module)
trains-apiserver | File "/opt/trains/server/server.py", line 36, in
trains-apiserver | ServiceRepo.load("services")
trains-apiserver | File "/opt/trains/server/service_repo/service_repo.py", line 89, in load
trains-apiserver | import_module(f"{root_module.stem}.{sub_module.stem}")
trains-apiserver | File "/usr/lib64/python3.6/importlib/init.py", line 126, in import_module
trains-apiserver | return _bootstrap._gcd_import(name[level:], package, level)
trains-apiserver | File "/opt/trains/server/services/queues.py", line 21, in
trains-apiserver | worker_bll = WorkerBLL()
trains-apiserver | File "/opt/trains/server/bll/workers/init.py", line 37, in init
trains-apiserver | self.redis = redis if redis is not None else redman.connection("workers")
trains-apiserver | File "/opt/trains/server/service_repo/redis_manager.py", line 174, in connection
trains-apiserver | obj.get("health")
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/client.py", line 1332, in get
trains-apiserver | return self.execute_command('GET', name)
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/client.py", line 836, in execute_command
trains-apiserver | conn = self.connection or pool.get_connection(command_name, **options)
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 1073, in get_connection
trains-apiserver | connection.connect()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 544, in connect
trains-apiserver | raise ConnectionError(self._error_message(e))
trains-apiserver | redis.exceptions.ConnectionError: Error 111 connecting to 127.0.0.1:6379. Connection refused.
trains-apiserver | [2019-11-20 10:58:36 +0000] [11] [INFO] Worker exiting (pid: 11)
trains-apiserver | Loading config from /opt/trains/server/config/default
trains-apiserver | Loading config from file /opt/trains/server/config/default/logging.conf
trains-apiserver | Loading config from file /opt/trains/server/config/default/hosts.conf
trains-apiserver | Loading config from file /opt/trains/server/config/default/secure.conf
trains-apiserver | Loading config from file /opt/trains/server/config/default/apiserver.conf
trains-apiserver | Loading config from file /opt/trains/server/config/default/services/tasks.conf
trains-apiserver | Loading config from file /opt/trains/server/config/default/services/events.conf
trains-apiserver | Loading config from /opt/trains/config
trains-apiserver | Loading config from file /opt/trains/config/services.conf
trains-apiserver | Loading config from file /opt/trains/config/apiserver.conf
trains-apiserver | [2019-11-20 10:58:36,311] [12] [INFO] [trains.server] ################ API Server initializing #####################
trains-apiserver | [2019-11-20 10:58:36,311] [12] [INFO] [trains.database] Initializing database connections
trains-apiserver | [2019-11-20 10:58:36,312] [12] [INFO] [trains.database] Using override mongodb host mongo
trains-apiserver | [2019-11-20 10:58:36,330] [12] [INFO] [trains.database] Registering connection to auth-db (mongodb://mongo:27017/auth)
trains-apiserver | [2019-11-20 10:58:36,333] [12] [INFO] [trains.database] Registering connection to backend-db (mongodb://mongo:27017/backend)
trains-apiserver | [2019-11-20 10:58:36,352] [10] [INFO] [trains.init_data] [{'mapping': 'events', 'result': '{"acknowledged":true}'}, {'mapping': 'worker_stats', 'result': '{"acknowledged":true}'}, {'mapping': 'queue_metrics', 'result': '{"acknowledged":true}'}, {'mapping': 'events_log', 'result': '{"acknowledged":true}'}, {'mapping': 'events_training_debug_image', 'result': '{"acknowledged":true}'}, {'mapping': 'events_plot', 'result': '{"acknowledged":true}'}]
trains-apiserver | [2019-11-20 10:58:36,361] [12] [INFO] [trains.init_data] Applying mappings to host: http://elasticsearch:9200
trains-apiserver | [2019-11-20 10:58:36,391] [10] [INFO] [trains.init_data] Fixed users mode is enabled
trains-apiserver | [2019-11-20 10:58:36 +0000] [10] [ERROR] Exception in worker process
trains-apiserver | Traceback (most recent call last):
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 539, in connect
trains-apiserver | sock = self._connect()
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 596, in _connect
trains-apiserver | raise err
trains-apiserver | File "/usr/local/lib/python3.6/site-packages/redis/connection.py", line 584, in _connect
trains-apiserver | sock.connect(socket_address)
trains-apiserver | ConnectionRefusedError: [Errno 111] Connection refused
trains-apiserver |
trains-apiserver | During handling of the above exception, another exception occurred:
from clearml-server.
bmartinn
commented on May 28, 2024
Good news @sjiki , it seems the Elastic problem was solved,
But now we have the Redis docker not connecting with the trains-server,
Could you please send the current full log?
from clearml-server.
sjiki
commented on May 28, 2024
Than you for reply.
This is the full log file.
command.log
from clearml-server.
bmartinn
commented on May 28, 2024
@sjiki , thanks for the full log.
It seems the trains-redis docker is not created/executed (the redis docker was added in v0.12)
I suspect you need to update the docker-compose.yml file:
curl https://raw.githubusercontent.com/allegroai/trains-server/master/docker-compose.yml -o docker-compose.yml
docker-compose -f docker-compose.yml pull
docker-compose -f docker-compose.yml up
Fingers crossed :)
from clearml-server.
sjiki
commented on May 28, 2024
Thank you for reply.
I establish the web-app and can make create credentials!
and, I work on google colab and trains init in google colab.
this is the log of google colab
TRAINS SDK setup process
Editing configuration file: /root/trains.conf
Enter the url of the trains-server's Web service, for example: http://localhost:8080
Web Application Host configured to: [] http://localhost:8080
API Host configured to: [http://localhost:8008] http://localhost:8008
File Store Host configured to: [http://localhost:8081] http://localhost:8081
TRAINS Hosts configuration:
API: http://localhost:8008
Web App: http://localhost:8080
File Store: http://localhost:8081
Please create new credentials using the web app: http://localhost:8080/profile
In the Admin page, press "Create new credentials", then press "Copy to clipboard"
Paste credentials here: credentials {"access_key" = "F8OAMLSMTTHOKO1VRT04", "secret_key" = "=j0L$8xVvZE&)4)whhDD=fOVguAip#bMalxtkmx3rK@7qxI)N^"}
Detected credentials key="F8OAMLSMTTHOKO1VRT04" secret="=j0L$8xVvZE&)4)whhDD=fOVguAip#bMalxtkmx3rK@7qxI)N^"
Verifying credentials ...
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
for a log time I waited, but this process did not finish,
I do not know how to train init
and attached file is the log for the google cloud VM instance docker container
[error.log](https://github.com/allegroai/trains-server/files/3872353/error.log)
from clearml-server.
sjiki
commented on May 28, 2024
from clearml-server.
bmartinn
commented on May 28, 2024
First of all, @sjiki congrats on getting the trains-server up and running 🎊
If you are using Google Colab, meaning there is no need for local configuration file, as the actual machine is a temporary machine allocated for the current notebook, and might change the next time we execute the notebook.
In order to pass the configuration to the Trains package, add the following lines at the beginning of your code.
Notice the first line sets the credentials, instead of the trains.conf file, and the second line will initialize a new experiment
# setup credentials and set trains-server host
Task.set_credentials(host='http://localhost:8008', key='my key', secret='my secret')
# start a new experiment
task = Task.init('examples', 'my colab trains test')from clearml-server.
sjiki
commented on May 28, 2024
Thank you for careful and helpful reply.
I tried the following comand in google colab.
!pip install trains
from trains import Task
Task.set_credentials(host='http://localhost:8008', key='my key', secret='my secret')
task = Task.init('examples', 'my colab trains test')
following error is observed.
Retrying (Retry(total=239, connect=239, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb3bd76eb8>: Failed to establish a new connection: [Errno 111] Connection refused',)': /auth.login
Retrying (Retry(total=238, connect=238, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb3bd0c160>: Failed to establish a new connection: [Errno 111] Connection refused',)': /auth.login
Retrying (Retry(total=237, connect=237, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb3bd0c240>: Failed to establish a new connection: [Errno 111] Connection refused',)': /auth.login
Retrying (Retry(total=236, connect=236, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb3bd0c3c8>: Failed to establish a new connection: [Errno 111] Connection refused',)': /auth.login
Retrying (Retry(total=235, connect=235, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb3bd0c748>: Failed to establish a new connection: [Errno 111] Connection refused',)': /auth.login
port forwarding like that
gcloud compute ssh --zone "us-central1-a" "instance-10" -- -N -L 8080:localhost:8080 -L 8008:localhost:8008 -L 8081:localhost:8081 -L 9200:localhost:9200 -L 27017:localhost:27017 -L 6379:localhost:6379
and google cloud docker log is attaced file
log.log
from clearml-server.
bmartinn
commented on May 28, 2024
I'm not sure what the setup is in relation to the google colab machine, but the thing is, it should be able to access the trains-server machine.
I'm assuming the ssh & port forwarding is from the GCP machine to your local machine not to the colab instance.
You need to do the same on the colab, so you can access the trains-server ports:
Maybe try to run the following inside the colab:
!gcloud compute ssh --zone "us-central1-a" "instance-10" -- -N -L 8080:localhost:8080 -L 8008:localhost:8008 -L 8081:localhost:8081 -L 9200:localhost:9200 -L 27017:localhost:27017 -L 6379:localhost:6379
Another solution is to try to access the trains-server directly.
Let's assume for example your GCP instance IP is 10.1.1.2, then you could do:
Task.set_credentials(host='http://10.1.1.2:8008', key='my key', secret='my secret')
p.s.
in my code example above, you should change key='my key', secret='my secret' to your actual trains credentials ;)
from clearml-server.
sjiki
commented on May 28, 2024
Thank you for the reply.
I tried to do in google colab.
!gcloud compute ssh --zone "us-central1-a" "instance-10" -- -N -L 8080:localhost:8080 -L 8008:localhost:8008 -L 8081:localhost:8081 -L 9200:localhost:9200 -L 27017:localhost:27017 -L 6379:localhost:6379
but [email protected]: Permission denied (publickey).
ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. error is occured.
It seems that google cloud ssh connection problem.
and I confirmed the local machine too. I can acsess the access the trains-server machine.
Thank you for the many helpful advice and gentle supprot.
I close this issue
from clearml-server.
columbo123
commented on May 28, 2024
I think I am facing a similar issue, when I enter name in beginning and press enter, nothing happens.
from clearml-server.
bmartinn
commented on May 28, 2024
@columbo123, do you mean when running the configuration wizard with trains init ?
What's the context for:
when I enter name in beginning and press enter, nothing happens.
from clearml-server.
columbo123
commented on May 28, 2024
Sorry for not making it clear, but the issue I was facing was I bind my local host's port of web server but earlier I didn't bind the web server. So the request of first page on UI where we enter name was not forwarded. I have solved this issue by binding the port of API server to my local host as well. Thanks a lot for giving such a great service and quick replies. I have successfully merged trains with my current pipeline and It is now working seamlessly.
from clearml-server.
bmartinn
commented on May 28, 2024
Glad to hear you managed to integrate it into your pipeline, and always happy to be of help 😄
from clearml-server.
PaulZhangIsing
commented on May 28, 2024
I have encountered similar errors.
Local server, cannot do clearml-init
I was able to do it once, maybe a week ago.
But I did add too much data to it, and then the system collapse.
So I have deleted some files and restart it all over again
Everything looks alright.
From F12 analysis
From the docker ps , it seems it does not have api-server keep restarting problem
7721543/185886537-0fecb9a0-bd50-43c0-aaf6-8dcdfdd1c36e.png)
from clearml-server.
jkhenning
commented on May 28, 2024
Hi @PaulZhangIsing ,
The UI looks like it simply cannot connect to the server (the behavior and also the log you shared).
Can you simply try to browse to "http://localhost:8008" and to "http://localhost:8080/api"
from clearml-server.
PaulZhangIsing
commented on May 28, 2024
@jkhenning Thanks for your help~
Hi @PaulZhangIsing , The UI looks like it simply cannot connect to the server (the behavior and also the log you shared). Can you simply try to browse to "http://localhost:8008" and to "http://localhost:8080/api"
localhost:8008 and 8080/api all gives the same response.
Any idea on how to solve it?
from clearml-server.
Related Issues (20)
- clearml-webserver crashes when IPv6 is disabled on a k8s node HOT 1
- Could not find host server definition HOT 5
- Feature Request: Get server configuration parameters from AWS Secrets Manager [security]
- [Customising web-ui] - Projects are loading tasks in web ui of self hosting server but i want them to show datasets HOT 3
- generating clearml-reports HOT 13
- How to write artifacts to S3 from server side? HOT 1
- Nginx Not Loading Plotly.js Resource: ClearML Self-Hosted Docker HOT 7
- Failed Navigate From Overview to Experiments Details HOT 4
- Async Delete Always Failed when Removing Experiments (using Minio)
- nginx 0.6.x < 1.20.1 1-Byte Memory Overwrite RCE vulnerability HOT 2
- ElasticSearch UI and Redis UI? HOT 2
- The problem with scalars HOT 12
- Curl 7.69 < 8.4.0 Heap Buffer Overflow vulnerability HOT 2
- OpenSSL 1.1.1 < 1.1.1x Vulnerability HOT 1
- Elasticsearch image tag 7.17 does not exist HOT 4
- Git package is not installed by default in node:20-bookworm-slim HOT 1
- SERVER UNAVAILABLE HOT 4
- APP Credentials disapper in webapp HOT 20
- Scalar graphs legend is too narrow for experiments with long names HOT 7
- Update from 1.14.1 to 1.15.0 leads to several fatal issues when booting HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clearml-server.