Code of Conduct
Search before asking
Describe the feature
Enhance HiveDelegationTokenProvider to renew delegation tokens of multiple Hive metastore clusters.
Motivation
Kyuubi supports setting Hive metastore uris in JDBC connection URL.
But current HiveDelegationTokenProvider implemented in #1009 can only renew delegation tokens of Hive metastore defined in hive-site.xml.
For users who frequently access different Hive metastore clusters, the Kyuubi enginesare still limited by Hive token's expiration time when visiting non default Hive metastore servers.
Describe the solution
Introduce a Kyuubi configuration kyuuib.credentials.hive.metastore.uris to specify extra Hive metastore URIs.
URIs should be specified in format "thrift://host01:port01,thrift://host02:port02;thrift://host11:port11,thrift://host12:port12", where "," separates URIs belonging to same metastore cluster, ";" separates URIs of different metastore clusters.
HiveDelegationTokenProvider will create a HiveMetaStoreClient for each Hive metastore URIs and periodically renew the delegation tokens.
Additional context
No response
Are you willing to submit PR?
Code of Conduct
Search before asking
Describe the feature
Enhance
HiveDelegationTokenProviderto renew delegation tokens of multiple Hive metastore clusters.Motivation
Kyuubi supports setting Hive metastore uris in JDBC connection URL.
But current
HiveDelegationTokenProviderimplemented in #1009 can only renew delegation tokens of Hive metastore defined in hive-site.xml.For users who frequently access different Hive metastore clusters, the Kyuubi enginesare still limited by Hive token's expiration time when visiting non default Hive metastore servers.
Describe the solution
Introduce a Kyuubi configuration
kyuuib.credentials.hive.metastore.uristo specify extra Hive metastore URIs.URIs should be specified in format "thrift://host01:port01,thrift://host02:port02;thrift://host11:port11,thrift://host12:port12", where "," separates URIs belonging to same metastore cluster, ";" separates URIs of different metastore clusters.
HiveDelegationTokenProviderwill create aHiveMetaStoreClientfor each Hive metastore URIs and periodically renew the delegation tokens.Additional context
No response
Are you willing to submit PR?