Comments (7)
SGTM, and it's better to extract an Interface to allow user to implement their custom strategy
from kyuubi.
from kyuubi.
SGTM, and it's better to extract an Interface to allow user to implement their custom strategy
hello, want ask a question, kyuubi-hive-jdbc is only a driver engine, which cannot read configuration from the kyuubiConf, so if we set a strategy configEntry in HA, the kyuubi-hive-jdbc also cannot read the config, the only way i think is to add in connection params, but if add in connection params, we cannot custom our strategy, what do you think?
from kyuubi.
@davidyuan1223 hello, May I ask what strategy will you implement?
from kyuubi.
@davidyuan1223 hello, May I ask what strategy will you implement?
sorry, forget response, curruntly, i implemented poll and random, because hive-jdbc module is a single module, we can not use kyuubi-ha module, so, if we want implemented more strategies, we only can add strategy in connection params, like '&zkStartegy=poll/random', if you have more useful starategy, you can give me some advice
from kyuubi.
@davidyuan1223 hello, May I ask what strategy will you implement?
hello, this is the demo command
bin/beeline -u 'jdbc:hive2://xxx:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=kyuubi;zooKeeperStrategy=poll?spark.app.name=testspark;spark.shuffle.useOldFetchProtocol=true' -n hadoop --verbose=true --showNestedErrs=true
currently it can use poll strategy to choose the right server, but there are some bugs, so i'm not commit a pr.
from kyuubi.
@davidyuan1223 hello, May I ask what strategy will you implement?
hello, this is the demo command
bin/beeline -u 'jdbc:hive2://xxx:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=kyuubi;zooKeeperStrategy=poll?spark.app.name=testspark;spark.shuffle.useOldFetchProtocol=true' -n hadoop --verbose=true --showNestedErrs=true
currently it can use poll strategy to choose the right server, but there are some bugs, so i'm not commit a pr.
i plan the user could implemented a interface named org.apache.kyuubi.jdbc.hive.strategy.ChooseServerStrategy, then use zooKeeperStrategy=xxx.xxx.xxx, so user can use themselves implement plan, of course, if you have more effective plan, you can offered me, and i will try to implement them
from kyuubi.
Related Issues (20)
- [Bug] [spark-hive-connector] failed to setting hive.metastore.uri if not setting `spark.sql.hive.metastore.jars` HOT 5
- [FEATURE] Support RenewDelegationToken for flink sql engine
- [FEATURE] Support impersonation mode for flink sql engine HOT 1
- [Bug] Error operating ExecuteStatement: java.lang.IndexOutOfBoundsException: 0 with saveToFile
- [Bug] When kyuubi web-ui SQL Editor module select the JDBC engine, an exception occurs and prompting 'Get SQL Log Failed'. HOT 10
- lineage plugin throws java.util.NoSuchElementException: None.get HOT 11
- [Bug] ApplicationOperation uses conf instead of sessionConf HOT 2
- FileNotFoundException on executing ADD FILE HOT 1
- [Bug] : In K8s, Spark Session launch failing with error HOT 9
- [Bug] `kyuubiClientTicketCache` always use same authentication
- [Bug] engine.share.level=GROUP takes only first AD Group if the user is part of multiple AD Groups HOT 1
- [Bug] [spark hive connector] failed to create table is partition column is not at the end HOT 1
- [Bug] An error 'The query did not generate a result set' is reported when Hive Engine executeQuery INSERT OVERWRITE DIRECTORY HOT 1
- [TASK][EASY] NPE may occur when closing session
- [Subtask] Add new module common-grpc to support more grpc server in the future
- [TASK][MEDIUM] Integrate Kyuubi with DataSophon HOT 1
- [Improvement] kyuubi-server/web-ui should not to set a timeout for axios requests HOT 2
- [FEATURE] [spark-hive-connector] support scala 2.13 for spark 3.3 version
- [Bug] FlinkSQL engine cannot automatically exit when there is no connection HOT 5
- [Bug] Can't use a HDFS dir for `kyuubi.operation.result.saveToFile.dir` HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kyuubi.