Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-14410][SQL] Push functions existence check into catalog #12198

Closed
wants to merge 6 commits into from

Conversation

andrewor14
Copy link
Contributor

What changes were proposed in this pull request?

This is a followup to #12117 and addresses some of the TODOs introduced there. In particular, the resolution of database is now pushed into session catalog, which knows about the current database. Further, the logic for checking whether a function exists is pushed into the external catalog.

No change in functionality is expected.

How was this patch tested?

SessionCatalogSuite, DDLSuite

@SparkQA
Copy link

SparkQA commented Apr 6, 2016

Test build #55089 has finished for PR 12198 at commit a3601fb.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14
Copy link
Contributor Author

@yhuai

@SparkQA
Copy link

SparkQA commented Apr 6, 2016

Test build #55093 has finished for PR 12198 at commit 6abe10b.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 6, 2016

Test build #55146 has finished for PR 12198 at commit a10e942.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@@ -152,6 +152,8 @@ abstract class ExternalCatalog {

def getFunction(db: String, funcName: String): CatalogFunction

def functionExists(db: String, funcName: String): Boolean
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great!

@yhuai
Copy link
Contributor

yhuai commented Apr 7, 2016

LGTM. Merging to master. We will take care the exception handling in getFunctionOption with the work of https://issues.apache.org/jira/browse/SPARK-14414.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants