Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-1116] Disable columnar url_decoder #1117

Merged
merged 4 commits into from
Sep 23, 2022

Conversation

PHILO-HE
Copy link
Collaborator

@PHILO-HE PHILO-HE commented Sep 21, 2022

We added a config to turn on/off columnar UDF. Currently, only url decoder is the supported UDF. So it will only have an impact on this UDF.
@jackylee-ch, please have a review.

@github-actions
Copy link

#116

import org.apache.arrow.gandiva.expression.{TreeBuilder, TreeNode}
import org.apache.arrow.vector.types.pojo.ArrowType

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: This empty line should not be deleted.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just reverted the change. Thanks!

@jackylee-ch
Copy link
Contributor

This patch works well in our environment, thanks.

@PHILO-HE PHILO-HE changed the title [NSE-116] Disable columnar url_decoder [NSE-1116] Disable columnar url_decoder Sep 23, 2022
@github-actions
Copy link

#1116

@@ -94,6 +96,7 @@ trait SharedSparkSessionBase
conf.set(
StaticSQLConf.WAREHOUSE_PATH,
conf.get(StaticSQLConf.WAREHOUSE_PATH) + "/" + getClass.getCanonicalName)
conf.set(GazellePluginConfig.getSessionConf.enableUDFKey, "true")
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks the config is cached for some reason. So we set the config here to make sure this config is turned on, as required by columnar udf test.

@zhouyuan zhouyuan merged commit 8bdd8a1 into oap-project:main Sep 23, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants