Generic Fybrik Connector. Implements the Fybrik Data-Catalog specification.
To compile the connector code, run:
make
To run the connector locally, run:
make run
make run
runs the connector with the configuration file in conf/conf.yaml
. This configuration assumes that the data catalog is running on localhost and listening on port 8585. In addition, it assumes that Vault is running on localhost too and listening on port 8200. If that is not the case, change the configuration file or employ port-forwarding.
The configuration file also contains a path to a JWT file which is used to identify against Vault.
curl -X POST localhost:8081/createAsset -d @mysql.json
curl -X POST localhost:8081/getAssetInfo -d '{"assetID": "AssetID", "operationType": "read"}'
- pkg/database-types: Currently, could support data sources such as mysql and s3. The direcory contains the database_type.go file, which defines the DatabaseType interface.
- pkg/datacatalog-connector-core: The core files of datacatalog connector, they are implement the connector REST API.
- pkg/utils: Includes utility methods used in the connector code
- pkg/vault: Includes methods to obtain a token and secrets from Vault
- conf: Contains a sample configuration file
- auto-generated: Automatically generated OpenAPI code, both for data catalog (client code) and Fybrik Data Catalog (server code)