please can help some one about elasticsearch-river-mongodb HOT 18 CLOSED

Hi,

Next time, please provide details on the environment and how to river has been installed.
From ES log files it looks like mongodb-river has been correctly loaded: [plugins ] [Order] loaded [river-mongodb,
Did you create a river in ES using this plugin?

Like for example:
curl -XPUT "localhost:9200/_river/mongodb/_meta" -d '{
"type": "mongodb",
"mongodb": {
"db": "mydb",
"collection": "mycollec"
},
"index": {
"name": "mydb",
"type": "mycollec"
}
}'

See wiki pages for more details: https://github.com/richardwilly98/elasticsearch-river-mongodb/wiki

Then from MongoDB start to store document in the database mydb and in the collection mycollection

Thanks,
Richard.

from elasticsearch-river-mongodb.

am very new to elastic search am getting these type of exceptions

[2012-11-14 15:03:41,122][WARN ][bootstrap ] jvm uses the client vm, make sure to run java with the server vm for best performance by adding -server to the command line
[2012-11-14 15:03:41,130][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]: initializing ...
[2012-11-14 15:03:41,154][INFO ][plugins ] [Stane, Ezekiel] loaded [river-mongodb, mapper-attachments], sites []
[2012-11-14 15:03:43,481][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]: initialized
[2012-11-14 15:03:43,482][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]: starting ...
[2012-11-14 15:03:43,599][INFO ][transport ] [Stane, Ezekiel] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 15:03:46,919][INFO ][cluster.service ] [Stane, Ezekiel] new_master [Stane, Ezekiel][Gv8M0BuTQOiCnOI3U_KmrA][inet[/192.168.10.18:9300]], reason: zen-disco-join (elected_as_master)
[2012-11-14 15:03:47,023][INFO ][discovery ] [Stane, Ezekiel] elasticsearch/Gv8M0BuTQOiCnOI3U_KmrA
[2012-11-14 15:03:47,101][INFO ][http ] [Stane, Ezekiel] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:03:47,102][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]: started
[2012-11-14 15:03:48,381][INFO ][gateway ] [Stane, Ezekiel] recovered [2] indices into cluster_state
[2012-11-14 15:03:49,023][WARN ][river ] [Stane, Ezekiel] failed to create river [rs][rs]
org.elasticsearch.common.settings.NoClassSettingsException: Failed to load class with value [rs]
at org.elasticsearch.river.RiverModule.loadTypeModule(RiverModule.java:86)
at org.elasticsearch.river.RiverModule.spawnModules(RiverModule.java:57)
at org.elasticsearch.common.inject.ModulesBuilder.add(ModulesBuilder.java:44)
at org.elasticsearch.river.RiversService.createRiver(RiversService.java:135)
at org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:270)
at org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:264)
at org.elasticsearch.action.support.TransportAction$ThreadedActionListener$1.run(TransportAction.java:86)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException: rs
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
at org.elasticsearch.river.RiverModule.loadTypeModule(RiverModule.java:72)
... 9 more
[2012-11-14 15:03:49,140][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][MongoDB] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,142][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][MongoDB] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,167][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][rs0] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,172][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][rs0] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,181][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,184][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb1] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,192][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,198][INFO ][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,350][ERROR][river.mongodb ] [Stane, Ezekiel] [mongodb][MongoDB] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel] [mongodb][mongodb1] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel] [mongodb][rs0] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW

from elasticsearch-river-mongodb.

Hi,

I see 2 issues:

1. You have create many rivers: mondodb, MongoDB, mongodb1 and rs0. Please
   clean them up and use only one until you get it working.
   The log says that the river cannot find oplog.rs collection which menas
   that it cannot find a replica set in this MongoDB instance.
   Do you have a replica set created for the instance locahost:27017?

Thanks,
Richard.

On Wed, Nov 14, 2012 at 4:51 AM, umamaheshwar [email protected]:

am very new to elastic search am getting these type of exceptions

[2012-11-14 15:03:41,122][WARN ][bootstrap ] jvm uses the client vm, make
sure to run java with the server vm for best performance by adding -serverto the command line
[2012-11-14 15:03:41,130][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]:
initializing ...
[2012-11-14 15:03:41,154][INFO ][plugins ] [Stane, Ezekiel] loaded
[river-mongodb, mapper-attachments], sites []
[2012-11-14 15:03:43,481][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]:
initialized
[2012-11-14 15:03:43,482][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]:
starting ...
[2012-11-14 15:03:43,599][INFO ][transport ] [Stane, Ezekiel]
bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/
192.168.10.18:9300]}
[2012-11-14 15:03:46,919][INFO ][cluster.service ] [Stane, Ezekiel]
new_master [Stane, Ezekiel][Gv8M0BuTQOiCnOI3U_KmrA][inet[/192.168.10.18:9300]],
reason: zen-disco-join (elected_as_master)
[2012-11-14 15:03:47,023][INFO ][discovery ] [Stane, Ezekiel]
elasticsearch/Gv8M0BuTQOiCnOI3U_KmrA
[2012-11-14 15:03:47,101][INFO ][http ] [Stane, Ezekiel] bound_address
{inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:03:47,102][INFO ][node ] [Stane, Ezekiel] {0.19.9}[4484]:
started
[2012-11-14 15:03:48,381][INFO ][gateway ] [Stane, Ezekiel] recovered [2]
indices into cluster_state
[2012-11-14 15:03:49,023][WARN ][river ] [Stane, Ezekiel] failed to create
river [rs][rs]
org.elasticsearch.common.settings.NoClassSettingsException: Failed to load
class with value [rs]
at org.elasticsearch.river.RiverModule.loadTypeModule(RiverModule.java:86)
at org.elasticsearch.river.RiverModule.spawnModules(RiverModule.java:57)
at
org.elasticsearch.common.inject.ModulesBuilder.add(ModulesBuilder.java:44)
at
org.elasticsearch.river.RiversService.createRiver(RiversService.java:135)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:270)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:264)
at
org.elasticsearch.action.support.TransportAction$ThreadedActionListener$1.run(TransportAction.java:86)

at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.ClassNotFoundException: rs
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
at org.elasticsearch.river.RiverModule.loadTypeModule(RiverModule.java:72)
... 9 more
[2012-11-14 15:03:49,140][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][MongoDB] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,142][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][MongoDB] starting mongodb stream: options:
secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb],
indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,167][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][rs0] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,172][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][rs0] starting mongodb stream: options: secondaryreadpreference
[false], gridfs [false], filter [mydb], db [mydb], indexing to
[mycollec]/[{}]
[2012-11-14 15:03:49,181][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,184][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb1] starting mongodb stream: options:
secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb],
indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,192][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:03:49,198][INFO ][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb] starting mongodb stream: options:
secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb],
indexing to [mycollec]/[{}]
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb] Cannot find oplog.rs collection. Please use check this
link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,350][ERROR][river.mongodb ] [Stane, Ezekiel]
[mongodb][MongoDB] Cannot find oplog.rs collection. Please use check this
link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel]
[mongodb][mongodb1] Cannot find oplog.rs collection. Please use check
this link: http://goo.gl/2x5IW
[2012-11-14 15:03:49,349][ERROR][river.mongodb ] [Stane, Ezekiel]
[mongodb][rs0] Cannot find oplog.rs collection. Please use check this
link: http://goo.gl/2x5IW

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10360562.

from elasticsearch-river-mongodb.

how can i clean..?

i created replica set created for the instance locahost:27018

rivers: mondodb, MongoDB, mongodb1 and rs0

i given rivers: mondodb, MongoDB, mongodb1 and rs0 etc ..... because when i browse i saw. so am tried...

from elasticsearch-river-mongodb.

Hi,

See this link [1] to delete the rivers.

So replica set is created on localhost:27018 but the river uses
locahost:27017...

[1] - http://www.elasticsearch.org/guide/reference/river/

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:02 AM, umamaheshwar [email protected]:

how can i clean..?

i created replica set created for the instance locahost:27018

rivers: mondodb, MongoDB, mongodb1 and rs0

i given rivers: mondodb, MongoDB, mongodb1 and rs0 etc ..... because when
i browse i saw. so am tried...

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10360879.

from elasticsearch-river-mongodb.

i clean all the river then create 1 river wht u told 2 day back am getting these error

how can i run replica in 27017

[2012-11-14 15:45:33,059][WARN ][bootstrap ] jvm uses the client vm, make sure to run java with the server vm for best performance by adding -server to the command line
[2012-11-14 15:45:33,077][INFO ][node ] [Rafferty] {0.19.9}[4320]: initializing ...
[2012-11-14 15:45:33,105][INFO ][plugins ] [Rafferty] loaded [river-mongodb, mapper-attachments], sites []
[2012-11-14 15:45:36,192][INFO ][node ] [Rafferty] {0.19.9}[4320]: initialized
[2012-11-14 15:45:36,192][INFO ][node ] [Rafferty] {0.19.9}[4320]: starting ...
[2012-11-14 15:45:36,434][INFO ][transport ] [Rafferty] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 15:45:39,534][INFO ][cluster.service ] [Rafferty] new_master [Rafferty][RN1zsTjiRgiyGhPftQuL-w][inet[/192.168.10.18:9300]], reason: zen-disco-join (elected_as_master)
[2012-11-14 15:45:39,587][INFO ][discovery ] [Rafferty] elasticsearch/RN1zsTjiRgiyGhPftQuL-w
[2012-11-14 15:45:39,644][INFO ][http ] [Rafferty] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:45:39,648][INFO ][node ] [Rafferty] {0.19.9}[4320]: started
[2012-11-14 15:45:41,075][INFO ][gateway ] [Rafferty] recovered [2] indices into cluster_state
[2012-11-14 15:46:31,060][INFO ][cluster.metadata ] [Rafferty] [_river] update_mapping mongodb1
[2012-11-14 15:46:31,085][INFO ][river.mongodb ] [Rafferty] [mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:46:31,086][INFO ][river.mongodb ] [Rafferty] [mongodb][mongodb1] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 15:46:32,118][INFO ][cluster.metadata ] [Rafferty] [_river] update_mapping mongodb1
[2012-11-14 15:46:32,159][ERROR][river.mongodb ] [Rafferty] [mongodb][mongodb1] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW

from elasticsearch-river-mongodb.

Hi,

You can change the port in mongoDB. They must match between ES and mongoDB.

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:19 AM, umamaheshwar [email protected]:

i clean all the river then create 1 river wht u told 2 day back am getting
these error

how can i run replica in 27017

[2012-11-14 15:45:33,059][WARN ][bootstrap ] jvm uses the client vm, make
sure to run java with the server vm for best performance by adding -serverto the command line
[2012-11-14 15:45:33,077][INFO ][node ] [Rafferty] {0.19.9}[4320]:
initializing ...
[2012-11-14 15:45:33,105][INFO ][plugins ] [Rafferty] loaded
[river-mongodb, mapper-attachments], sites []
[2012-11-14 15:45:36,192][INFO ][node ] [Rafferty] {0.19.9}[4320]:
initialized
[2012-11-14 15:45:36,192][INFO ][node ] [Rafferty] {0.19.9}[4320]:
starting ...
[2012-11-14 15:45:36,434][INFO ][transport ] [Rafferty] bound_address
{inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 15:45:39,534][INFO ][cluster.service ] [Rafferty] new_master
[Rafferty][RN1zsTjiRgiyGhPftQuL-w][inet[/192.168.10.18:9300]], reason:
zen-disco-join (elected_as_master)
[2012-11-14 15:45:39,587][INFO ][discovery ] [Rafferty]
elasticsearch/RN1zsTjiRgiyGhPftQuL-w
[2012-11-14 15:45:39,644][INFO ][http ] [Rafferty] bound_address
{inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:45:39,648][INFO ][node ] [Rafferty] {0.19.9}[4320]: started
[2012-11-14 15:45:41,075][INFO ][gateway ] [Rafferty] recovered [2]
indices into cluster_state
[2012-11-14 15:46:31,060][INFO ][cluster.metadata ] [Rafferty] [_river]
update_mapping mongodb1 http://dynamic
[2012-11-14 15:46:31,085][INFO ][river.mongodb ] [Rafferty]
[mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 15:46:31,086][INFO ][river.mongodb ] [Rafferty]
[mongodb][mongodb1] starting mongodb stream: options:
secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb],
indexing to [mycollec]/[{}]
[2012-11-14 15:46:32,118][INFO ][cluster.metadata ] [Rafferty] [_river]
update_mapping mongodb1 http://dynamic
[2012-11-14 15:46:32,159][ERROR][river.mongodb ] [Rafferty]
[mongodb][mongodb1] Cannot find oplog.rs collection. Please use check
this link: http://goo.gl/2x5IW

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10361302.

from elasticsearch-river-mongodb.

sorry i clean my rivers and start the replica set

elastic search log:

[2012-11-14 15:52:48,562][WARN ][bootstrap ] jvm uses the client vm, make sure to run java with the server vm for best performance by adding -server to the command line
[2012-11-14 15:52:48,567][INFO ][node ] [Brother Tode] {0.19.9}[5048]: initializing ...
[2012-11-14 15:52:48,590][INFO ][plugins ] [Brother Tode] loaded [river-mongodb, mapper-attachments], sites []
[2012-11-14 15:52:51,748][INFO ][node ] [Brother Tode] {0.19.9}[5048]: initialized
[2012-11-14 15:52:51,749][INFO ][node ] [Brother Tode] {0.19.9}[5048]: starting ...
[2012-11-14 15:52:52,219][INFO ][transport ] [Brother Tode] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 15:52:55,324][INFO ][cluster.service ] [Brother Tode] new_master [Brother Tode][-c04Qp_nSDO5Y5X5ZSkCXw][inet[/192.168.10.18:9300]], reason: zen-disco-join (elected_as_master)
[2012-11-14 15:52:55,385][INFO ][discovery ] [Brother Tode] elasticsearch/-c04Qp_nSDO5Y5X5ZSkCXw
[2012-11-14 15:52:55,445][INFO ][http ] [Brother Tode] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:52:55,446][INFO ][node ] [Brother Tode] {0.19.9}[5048]: started
[2012-11-14 15:52:56,080][INFO ][gateway ] [Brother Tode] recovered [2] indices into cluster_state

this is search output

{"took":752,"timed_out":false,"_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":0,"max_score":null,"hits":[]}}

how can i get actual output?

from elasticsearch-river-mongodb.

Hi,

I do not see anymore the river loaded in ES log file...

Did you recreate one with the correct settings?

What was the query executed for that search output?

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:29 AM, umamaheshwar [email protected]:

sorry i clean my rivers and start the replica set
elastic search log:

[2012-11-14 15:52:48,562][WARN ][bootstrap ] jvm uses the client vm, make
sure to run java with the server vm for best performance by adding -serverto the command line
[2012-11-14 15:52:48,567][INFO ][node ] [Brother Tode] {0.19.9}[5048]:
initializing ...
[2012-11-14 15:52:48,590][INFO ][plugins ] [Brother Tode] loaded
[river-mongodb, mapper-attachments], sites []
[2012-11-14 15:52:51,748][INFO ][node ] [Brother Tode] {0.19.9}[5048]:
initialized
[2012-11-14 15:52:51,749][INFO ][node ] [Brother Tode] {0.19.9}[5048]:
starting ...
[2012-11-14 15:52:52,219][INFO ][transport ] [Brother Tode] bound_address
{inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 15:52:55,324][INFO ][cluster.service ] [Brother Tode]
new_master [Brother Tode][-c04Qp_nSDO5Y5X5ZSkCXw][inet[/192.168.10.18:9300]],
reason: zen-disco-join (elected_as_master)
[2012-11-14 15:52:55,385][INFO ][discovery ] [Brother Tode]
elasticsearch/-c04Qp_nSDO5Y5X5ZSkCXw
[2012-11-14 15:52:55,445][INFO ][http ] [Brother Tode] bound_address
{inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 15:52:55,446][INFO ][node ] [Brother Tode] {0.19.9}[5048]:
started
[2012-11-14 15:52:56,080][INFO ][gateway ] [Brother Tode] recovered [2]

indices into cluster_state

this is search output

{"took":752,"timed_out":false,"_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":0,"max_score":null,"hits":[]}}

how can i get actual output?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10361612.

from elasticsearch-river-mongodb.

i clean all the rivers.
create river based on issue #26 like

curl -XPUT "http://localhost:9200/_river/mongodb1/_meta" -d @mongodb-river-simple.json

mongodb-river-simple.json

{
"type": "mongodb",
"mongodb": {
"db": "mydb",
"collection": "mycollec"
},
"index": {
"name": "mydb",
"type": "mycollec"
}
}

for search output:

curl -XGET "http://localhost:9200/mydb/_search?q=firstName:John"

like this

from elasticsearch-river-mongodb.

Hi,

Did you import data in mongoDB mydb / mycollec?

What is the output of db.mycollec.count() in mydb?

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:41 AM, umamaheshwar [email protected]:

i clean all the rivers.
create river based on issue #26https://github.com/richardwilly98/elasticsearch-river-mongodb/issues/26like

curl -XPUT "http://localhost:9200/_river/mongodb1/_meta" -d
@mongodb-river-simple.json
mongodb-river-simple.json

{
"type": "mongodb",
"mongodb": {
"db": "mydb",
"collection": "mycollec"
},
"index": {
"name": "mydb",
"type": "mycollec"
}
}
for search output:

curl -XGET "http://localhost:9200/mydb/_search?q=firstName:John"

like this

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10361921.

from elasticsearch-river-mongodb.

db.mycollec.count() in mydb

1

thanks
umamaheshwar.

from elasticsearch-river-mongodb.

Hi,

Please show the data imported in mycollec.
And the full ES log file.

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:50 AM, umamaheshwar [email protected]:

db.mycollec.count() in mydb?

1

thanks
umamaheshwar.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10362136.

from elasticsearch-river-mongodb.

Data:

PRIMARY> db.mycollec.find();
{ "_id" : ObjectId("50a34e00ba1efec0a3beb8bf"), "firstName" : "John", "lastName" : "Doe" }

ES log file:

[2012-11-14 16:26:19,958][WARN ][bootstrap ] jvm uses the client vm, make sure to run java with the server vm for best performance by adding -server to the command line
[2012-11-14 16:26:19,966][INFO ][node ] [Centurious‎] {0.19.9}[308]: initializing ...
[2012-11-14 16:26:19,991][INFO ][plugins ] [Centurious‎] loaded [river-mongodb, mapper-attachments], sites []
[2012-11-14 16:26:23,183][INFO ][node ] [Centurious‎] {0.19.9}[308]: initialized
[2012-11-14 16:26:23,184][INFO ][node ] [Centurious‎] {0.19.9}[308]: starting ...
[2012-11-14 16:26:23,303][INFO ][transport ] [Centurious‎] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 16:26:26,426][INFO ][cluster.service ] [Centurious‎] new_master [Centurious‎][YfCUhjzERVionb-TXpEqCw][inet[/192.168.10.18:9300]], reason: zen-disco-join (elected_as_master)
[2012-11-14 16:26:26,511][INFO ][discovery ] [Centurious‎] elasticsearch/YfCUhjzERVionb-TXpEqCw
[2012-11-14 16:26:26,588][INFO ][http ] [Centurious‎] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 16:26:26,589][INFO ][node ] [Centurious‎] {0.19.9}[308]: started
[2012-11-14 16:26:27,354][INFO ][gateway ] [Centurious‎] recovered [2] indices into cluster_state
[2012-11-14 16:26:27,767][INFO ][river.mongodb ] [Centurious‎] [mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 16:26:27,770][INFO ][river.mongodb ] [Centurious‎] [mongodb][mongodb1] starting mongodb stream: options: secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb], indexing to [mycollec]/[{}]
[2012-11-14 16:26:28,077][ERROR][river.mongodb ] [Centurious‎] [mongodb][mongodb1] Cannot find oplog.rs collection. Please use check this link: http://goo.gl/2x5IW

still am using 27018 port for replica

thanks
umamaheshwar

from elasticsearch-river-mongodb.

Hi,

Do you still have the replica set setup?

ES log says it is not... Cannot find oplog.rs collection. Please use check
this link: http://goo.gl/2x5IW

Thanks,
Richard.

On Wed, Nov 14, 2012 at 5:57 AM, umamaheshwar [email protected]:

Data:

PRIMARY> db.mycollec.find();
{ "_id" : ObjectId("50a34e00ba1efec0a3beb8bf"), "firstName" : "John",
"lastName" : "Doe" }
ES log file:

[2012-11-14 16:26:19,958][WARN ][bootstrap ] jvm uses the client vm, make
sure to run java with the server vm for best performance by adding -serverto the command line
[2012-11-14 16:26:19,966][INFO ][node ] [Centurious‎] {0.19.9}[308]:
initializing ...
[2012-11-14 16:26:19,991][INFO ][plugins ] [Centurious‎] loaded
[river-mongodb, mapper-attachments], sites []
[2012-11-14 16:26:23,183][INFO ][node ] [Centurious‎] {0.19.9}[308]:
initialized
[2012-11-14 16:26:23,184][INFO ][node ] [Centurious‎] {0.19.9}[308]:
starting ...
[2012-11-14 16:26:23,303][INFO ][transport ] [Centurious‎] bound_address
{inet[/0.0.0.0:9300]}, publish_address {inet[/192.168.10.18:9300]}
[2012-11-14 16:26:26,426][INFO ][cluster.service ] [Centurious‎]
new_master [Centurious‎][YfCUhjzERVionb-TXpEqCw][inet[/192.168.10.18:9300]],
reason: zen-disco-join (elected_as_master)
[2012-11-14 16:26:26,511][INFO ][discovery ] [Centurious‎]
elasticsearch/YfCUhjzERVionb-TXpEqCw
[2012-11-14 16:26:26,588][INFO ][http ] [Centurious‎] bound_address
{inet[/0.0.0.0:9200]}, publish_address {inet[/192.168.10.18:9200]}
[2012-11-14 16:26:26,589][INFO ][node ] [Centurious‎] {0.19.9}[308]:
started
[2012-11-14 16:26:27,354][INFO ][gateway ] [Centurious‎] recovered [2]
indices into cluster_state
[2012-11-14 16:26:27,767][INFO ][river.mongodb ] [Centurious‎]
[mongodb][mongodb1] Using mongodb server(s): host [localhost], port [27017]
[2012-11-14 16:26:27,770][INFO ][river.mongodb ] [Centurious‎]
[mongodb][mongodb1] starting mongodb stream: options:
secondaryreadpreference [false], gridfs [false], filter [mydb], db [mydb],
indexing to [mycollec]/[{}]
[2012-11-14 16:26:28,077][ERROR][river.mongodb ] [Centurious‎]
[mongodb][mongodb1] Cannot find oplog.rs collection. Please use check
this link: http://goo.gl/2x5IW

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10362320.

from elasticsearch-river-mongodb.

when am trying to add replicaset with port 27017 please some one help

Set rs0
Wed Nov 14 17:12:57 [initandlisten] MongoDB starting : pid=5108 port=27017 dbpath=D:\wamp\bin\mongodb\mongodb-win32-x86_64-2.0.7\rs0-0 6
it host=TSBCorporation
Wed Nov 14 17:12:57 [initandlisten] db version v2.0.7, pdfile version 4.5
Wed Nov 14 17:12:57 [initandlisten] git version: 875033920e8869d284f32119413543fa475227bf
Wed Nov 14 17:12:57 [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Se
ce Pack 1') BOOST_LIB_VERSION=1_42
Wed Nov 14 17:12:57 [initandlisten] options: { dbpath: "D:\wamp\bin\mongodb\mongodb-win32-x86_64-2.0.7\rs0-0", port: 27017, replSet: "rs
}
Wed Nov 14 17:12:57 [initandlisten] journal dir=D:/wamp/bin/mongodb/mongodb-win32-x86_64-2.0.7/rs0-0/journal
Wed Nov 14 17:12:57 [initandlisten] recover : no journal files present, no recovery needed
Wed Nov 14 17:12:57 [initandlisten] ERROR: listen(): bind() failed errno:10048 Only one usage of each socket address (protocol/network a
ess/port) is normally permitted. for socket: 0.0.0.0:27017
Wed Nov 14 17:12:57 [initandlisten] now exiting
Wed Nov 14 17:12:57 [rsStart] trying to contact localhost:27017
Wed Nov 14 17:12:57 dbexit:
Wed Nov 14 17:12:57 [websvr] ERROR: listen(): bind() failed errno:10048 Only one usage of each socket address (protocol/network address/
t) is normally permitted. for socket: 0.0.0.0:28017
Wed Nov 14 17:12:57 [rsStart] replSet TEMP !ok heartbeating localhost:27017 on cfg load
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to close listening sockets...
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to flush diaglog...
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to close sockets...
Wed Nov 14 17:12:57 [initandlisten] shutdown: waiting for fs preallocator...
Wed Nov 14 17:12:57 [initandlisten] shutdown: lock for final commit...
Wed Nov 14 17:12:57 [initandlisten] shutdown: final commit...
Wed Nov 14 17:12:57 [initandlisten] shutdown: closing all files...
Wed Nov 14 17:12:57 [initandlisten] closeAllFiles() finished
Wed Nov 14 17:12:57 [initandlisten] journalCleanup...
Wed Nov 14 17:12:57 [rsStart] replSet info localhost:27017 : { errmsg: "not running with --replSet", ok: 0.0 }
Wed Nov 14 17:12:57 [rsStart] replSet can't get local.system.replset config from self or any seed (yet)
Wed Nov 14 17:12:57 [initandlisten] removeJournalFiles
Wed Nov 14 17:12:57 [initandlisten] shutdown: removing fs lock...
Wed Nov 14 17:12:57 dbexit: really exiting now

from elasticsearch-river-mongodb.

Hi,

It seems that port 27017 and 27018 are not available. Please check your
environment or change to use available ports.

Thanks,
Richard.

On Wed, Nov 14, 2012 at 6:48 AM, umamaheshwar [email protected]:

when am trying to add replicaset with port 27017 please some one help

Set rs0
Wed Nov 14 17:12:57 [initandlisten] MongoDB starting : pid=5108 port=27017
dbpath=D:\wamp\bin\mongodb\mongodb-win32-x86_64-2.0.7\rs0-0 6
it host=TSBCorporation
Wed Nov 14 17:12:57 [initandlisten] db version v2.0.7, pdfile version 4.5
Wed Nov 14 17:12:57 [initandlisten] git version: 87503398750339
Wed Nov 14 17:12:57 [initandlisten] build info: windows
sys.getwindowsversion(major=6, minor=1, build=7601, platform=2,
service_pack='Se
ce Pack 1') BOOST_LIB_VERSION=1_42
Wed Nov 14 17:12:57 [initandlisten] options: { dbpath:
"D:\wamp\bin\mongodb\mongodb-win32-x86_64-2.0.7\rs0-0", port: 27017,
replSet: "rs
}
Wed Nov 14 17:12:57 [initandlisten] journal
dir=D:/wamp/bin/mongodb/mongodb-win32-x86_64-2.0.7/rs0-0/journal
Wed Nov 14 17:12:57 [initandlisten] recover : no journal files present, no
recovery needed
Wed Nov 14 17:12:57 [initandlisten] ERROR: listen(): bind() failed
errno:10048 Only one usage of each socket address (protocol/network a
ess/port) is normally permitted. for socket: 0.0.0.0:27017
Wed Nov 14 17:12:57 [initandlisten] now exiting
Wed Nov 14 17:12:57 [rsStart] trying to contact localhost:27017
Wed Nov 14 17:12:57 dbexit:
Wed Nov 14 17:12:57 [websvr] ERROR: listen(): bind() failed errno:10048
Only one usage of each socket address (protocol/network address/
t) is normally permitted. for socket: 0.0.0.0:28017
Wed Nov 14 17:12:57 [rsStart] replSet TEMP !ok heartbeating
localhost:27017 on cfg load
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to close listening
sockets...
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to flush diaglog...
Wed Nov 14 17:12:57 [initandlisten] shutdown: going to close sockets...
Wed Nov 14 17:12:57 [initandlisten] shutdown: waiting for fs
preallocator...
Wed Nov 14 17:12:57 [initandlisten] shutdown: lock for final commit...
Wed Nov 14 17:12:57 [initandlisten] shutdown: final commit...
Wed Nov 14 17:12:57 [initandlisten] shutdown: closing all files...
Wed Nov 14 17:12:57 [initandlisten] closeAllFiles() finished
Wed Nov 14 17:12:57 [initandlisten] journalCleanup...
Wed Nov 14 17:12:57 [rsStart] replSet info localhost:27017 : { errmsg:
"not running with --replSet", ok: 0.0 }
Wed Nov 14 17:12:57 [rsStart] replSet can't get local.system.replset
config from self or any seed (yet)
Wed Nov 14 17:12:57 [initandlisten] removeJournalFiles
Wed Nov 14 17:12:57 [initandlisten] shutdown: removing fs lock...
Wed Nov 14 17:12:57 dbexit: really exiting now

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/39#issuecomment-10363471.

from elasticsearch-river-mongodb.

thanx alot richard..

now its wrking i reinstall mongodb

thanx

Thanks

Umamaheshwar

from elasticsearch-river-mongodb.