siddhi-io / siddhi-store-mongodb Goto Github PK

View Code? Open in Web Editor NEW

4.0 28.0 21.0 1.59 MB

Extension that can be used to perform DB operations with Mongo DB

Home Page: https://siddhi-io.github.io/siddhi-store-mongodb/

License: Apache License 2.0

Java 100.00%

siddhi mongodb nosql database extension store

siddhi-store-mongodb's Introduction

Siddhi Store MongoDB

The siddhi-store-mongodb extension is an extension to Siddhi that persist and retrieve events to/from MongoDB

For information on Siddhi and it's features refer Siddhi Documentation.

Download

Versions 2.x and above with group id io.siddhi.extension.* from here.
Versions 1.x and lower with group id org.wso2.extension.siddhi.* from here.

Latest API Docs

Latest API Docs is 2.1.4.

Features

mongodb (Store)

Using this extension a MongoDB Event Table can be configured to persist events in a MongoDB of user's choice.

Dependencies

MongoDB connector jar and its dependencies should be added to the runtime (mongodb-java-driver-3.4.2, includes all the dependencies). For installing third party connectors on various Siddhi execution environments refer Siddhi documentation section on adding third party libraries.

Installation

For installing this extension on various Siddhi execution environments refer Siddhi documentation section on adding extensions.

Running Integration tests in docker containers(Optional)

The MongoDB functionality are tested with the docker base integration test framework. The test framework initializes the docker container according to the given profile before executing the test suite.

Install and run docker in daemon mode.
- Installing docker on Linux,
  Note:
  These commands retrieve content from get.docker.com web in a quiet output-document mode and install.Then we need to stop docker service as it needs to restart docker in daemon mode. After that, we need to export docker daemon host.
```
 wget -qO- https://get.docker.com/ | sh
 sudo service dockerd stop
 export DOCKER_HOST=tcp://172.17.0.1:4326
 docker daemon -H tcp://172.17.0.1:4326
```
- On installing docker on Mac, see Get started with Docker for Mac
- On installing docker on Windows, see Get started with Docker for Windows
To run the integration tests, issue the following commands.
- MongoDB 3.4 without SSL connection
```
  mvn verify -P mongod -Ddocker.removeVolumes=true
```
- MongoDB 3.4 with SSL connection
```
  mvn verify -P mongod-ssl -Ddocker.removeVolumes=true
```
- MongoDB 4.2 mvn verify -P mongod4 -Ddocker.removeVolumes=true

Support and Contribution

We encourage users to ask questions and get support via StackOverflow, make sure to add the siddhi tag to the issue for better response.
If you find any issues related to the extension please report them on the issue tracker.
For production support and other contribution related information refer Siddhi Community documentation.

siddhi-store-mongodb's People

Contributors

Stargazers

Watchers

siddhi-store-mongodb's Issues

DB connection is made at the init method it self

Description:
$subject. As the connection is made as soon as the pool object is created, this should be created at the connect method.

Affected Product Version:
siddhi-store-mongodb-1.x.x

Steps to reproduce:

Stop mongo DB service is it is running
Start SP editor
Import and save mongo DB sample.

Join query with objectID in Mongo document _ID

I've tried to get the whole document related to the update event by using a join query with objectID but it's not success:

from UpdateStream as u left outer join stocks as s on u.id == s.id
select u.id as id, s.name as name, s.volume as volume, s.stockDetails as stockDetails
insert into LogInsertUpdateStream;

The above query result is alway null.
My question is how to to retrieve the whole document using the document id in join query ?
Thank you

Docs site not upgraded to the standard

Set support in update operation is not complete

Description:
$subject

Mongodb cannot be queried on date coloumn

Description:
$subject, MongoDB date column cannot be matched to a siddhi column

Ref: https://docs.mongodb.com/manual/reference/method/Date/

Affected Product Version:
1.0.x

Test coverage report is not generated

Test coverage report is not generated which does not allow the developer to see the code coverage leading to low coverage.

Remove mongo-driver.jar from siddhi-store-mongodb.jar

Pass the query execution to mongodb level

Description:
Improve the siddhi MongoDB connector to execute the select queries at the database level such as having, group by, order by

How to parse a MongoDB query using Siddhi

Description:
As far as I understand using the test cases provided here we can do all CRUD operations to the MongoDB using this Siddhi MongoDB extension. My question is how do I parse a complex query(like below) into a MongoDB table and get the output to Siddhi level for further process.

db.employees.aggregate( [
   {
      $graphLookup: {
         from: "employees",
         startWith: "$reportsTo",
         connectFromField: "reportsTo",
         connectToField: "name",
         as: "reportingHierarchy"
      }
   }
] )

Refer
https://docs.mongodb.com/manual/reference/operator/aggregation/graphLookup/#examples