datawrangl3r / mongoes Goto Github PK

When I am trying to run the main script of this program getting below error:

R:\mongoes-master>python init.py

ConnectionError(Failed to parse: 'https://search-ahsw-nit-rfbqqq3bkl4cgg2jxivsg2q.us-2.es.amazonaws.com/_plugin/kibana', label empty or too long) caused by: Locat
ionParseError(Failed to parse: 'https://search-ahsw-nit-rfbqqq3bkl4cgg2jxivsg2q.us-2.es.amazonaws.com/_plugin/kibana', label empty or too long)

This https is from aws elasticsearch that is endpoint.

In json configuration file:
{
"EXTRACTION":
{
"HOST": "https://search-ahsw-nit-rfbqqq3bkl4cgg2jxivsg2q.us-2.es.amazonaws.com/_plugin/kibana",
"INDEX": "abcELKINDEX",
"DBENGINE": "elasticsearch"
},
"COMMIT":
{
"HOST": "localhost",
"DATABASE": "test",
"COLLECTION": "test",
"DBENGINE": "mongo",
"PORT":27017
}
}

Note this Host value is dummy just consider it long kind of string.

What is wrong in this.

Thanks,

C:\Users\Dell\AppData\Local\Programs\Python\Python39\lib\site-packages\elasticsearch\connection\base.py:208: ElasticsearchWarning: Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.14/security-minimal-setup.html to enable security.
warnings.warn(message, category=ElasticsearchWarning)
int() argument must be a string, a bytes-like object or a number, not 'dict'
0
int() argument must be a string, a bytes-like object or a number, not 'dict'
Transfer Completed!!!

Could you please help me to resolve the above issue?

Does the source data in elastic remain intact after the migration? Have an interesting use case whereby we want to continuously feed data from elastic into mongo. Most plugins I.e. mongo-connector, elasticsearch-river-mongodb, etc. are intended to stream data from mongo to elastic. Came across this plugin this afternoon and it is the only one of its kind. Thank you!