Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refer Antlr file using specific branch #2893

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

ykmr1224
Copy link
Collaborator

@ykmr1224 ykmr1224 commented Aug 2, 2024

Description

  • Refer Antlr file using specific tag/branch (Spark -> v3.5.1, Flint -> 0.5)

Related Issues

#2890 (comment)

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
@@ -18,7 +18,7 @@ lexer grammar SqlBaseLexer;

@members {
/**
* When true, parser should throw ParseException for unclosed bracketed comment.
* When true, parser should throw ParseExcetion for unclosed bracketed comment.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should it be Exception ?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is coming from Apache Spark repository, and we shouldn't fix here.

dai-chen
dai-chen previously approved these changes Aug 6, 2024
Copy link
Collaborator

@dai-chen dai-chen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes!

I'm thinking how we can ensure that we remember to update this version whenever a new release branch is created in opensearch-spark repo. cc: @penghuo

@ykmr1224
Copy link
Collaborator Author

ykmr1224 commented Aug 6, 2024

I'm thinking how we can ensure that we remember to update this version whenever a new release branch is created in opensearch-spark repo. cc: @penghuo

Should we have a check list for creating new release branch in opensearch-spark repo?

# Conflicts:
#	async-query-core/src/main/antlr/SqlBaseLexer.g4
#	async-query-core/src/main/antlr/SqlBaseParser.g4
#	async-query-core/src/main/java/org/opensearch/sql/spark/utils/SQLQueryUtils.java
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
Copy link
Collaborator

@dai-chen dai-chen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm thinking whether tracking one Flint Spark branch will be a problem or not.
I think the ideal case SQL main tracks Spark main and SQL 2.x tracks Spark 0.5? However, we cannot do this because we always backport PR?

@ykmr1224
Copy link
Collaborator Author

ykmr1224 commented Sep 9, 2024

I'm thinking whether tracking one Flint Spark branch will be a problem or not. I think the ideal case SQL main tracks Spark main and SQL 2.x tracks Spark 0.5? However, we cannot do this because we always backport PR?

I think the problem is that we tend to automatically include the grammar change in the PRs even if the change is not related to the grammar. We'd want to separate Grammar PRs and don't backport them.

Options came up to my mind are:

  1. Do not automatically update Grammar files.
  2. Separate the grammar files for repository and ones for build, and only update the ones for build during build. And add build target to update grammar file for repository.
  3. Manually avoid including the Grammar files to PRs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x maintenance Improves code quality, but not the product
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants