OpenSearch Flint is ... It consists of two modules:
flint-core
: a module that contains Flint specification and client.flint-spark-integration
: a module that provides Spark integration for Flint and derived dataset based on it.
Please refer to the Flint Index Reference Manual for more information.
- Spark 3.3.1
- Scala 2.12.14
To use this application, you can run Spark with Flint extension:
spark-sql --conf "spark.sql.extensions=org.opensearch.flint.FlintSparkExtensions"
To build and run this application with Spark, you can run:
sbt clean standaloneCosmetic/publishM2
then add org.opensearch:opensearch-spark_2.12 when run spark application, for example,
bin/spark-shell --packages "org.opensearch:opensearch-spark_2.12:0.1.0-SNAPSHOT"
This project has adopted an Open Source Code of Conduct.
If you discover a potential security issue in this project we ask that you notify AWS/Amazon Security via our vulnerability reporting page. Please do not create a public GitHub issue.
See the LICENSE file for our project's licensing. We will ask you to confirm the licensing of your contribution.
Copyright OpenSearch Contributors. See NOTICE for details.