Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Rest Api Compatibility] Move won't fix tests from block list #73912

Merged
merged 5 commits into from
Jun 14, 2021

Conversation

pgomulka
Copy link
Contributor

@pgomulka pgomulka commented Jun 8, 2021

block list at the moment contains a lot of tests that we already identified that won't be fixed.
This commit moves them out of the main block list so that it is easier to count progress.

@pgomulka pgomulka changed the title extract tests that won't be fixed [Rest Api Compatibility] Move won't fix tests from block list Jun 8, 2021
@pgomulka pgomulka self-assigned this Jun 8, 2021
@pgomulka pgomulka added the :Delivery/Build Build or test infrastructure label Jun 8, 2021
@pgomulka pgomulka requested a review from mark-vieira June 8, 2021 16:38
@pgomulka pgomulka marked this pull request as ready for review June 8, 2021 16:38
@elasticmachine elasticmachine added the Team:Delivery Meta label for Delivery team label Jun 8, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-delivery (Team:Delivery)

@pgomulka
Copy link
Contributor Author

pgomulka commented Jun 8, 2021

my groovy is not best :D let me know how to improve this

'cat.templates/10_basic/Normal templates',
'cat.templates/10_basic/Select columns',
'cat.thread_pool/10_basic/Test cat thread_pool output',
// type information about the type is removed and not passed down. The logic to check for this is also removed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we cleanup/remove some of these comments then given we don't plan on addressing any of these?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think those are beneficial. It is good to know the reason why the test is disabled without actually reading the test. The reasoning why it is disabled is clear now, but after a month or two (or earlier :D ) we might forget the details

@pgomulka pgomulka added the v8.0.0 label Jun 8, 2021
@pgomulka
Copy link
Contributor Author

pgomulka commented Jun 8, 2021

@elasticmachine run Check labels

Copy link
Contributor

@mark-vieira mark-vieira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@@ -28,100 +28,102 @@ testClusters.all {

tasks.named("test").configure { enabled = false }
tasks.named("jarHell").configure { enabled = false }

def willNotFixTests = {
return ['cat.aliases/10_basic/Alias against closed index',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can use wildcards in black lists. I would suggest to wildcard as much of these cat tests as possible to help with brevity and future cases. Also a brief mention that compatibility is not supported for cat APIs would help

@@ -28,100 +28,102 @@ testClusters.all {

tasks.named("test").configure { enabled = false }
tasks.named("jarHell").configure { enabled = false }

def willNotFixTests = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: s/willNotFixTests/v7compatiblityNotSupportedTests

@pgomulka pgomulka requested a review from jakelandis June 9, 2021 13:34
Copy link
Contributor

@jakelandis jakelandis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pgomulka pgomulka merged commit 30b14f1 into elastic:master Jun 14, 2021
pgomulka added a commit to pgomulka/elasticsearch that referenced this pull request Aug 5, 2021
v7compatibilityNotSupportedTests was introduced to make it easier to
track tests that have been identified as not needing compatible changes
and those that still need to be checked.
We have checked all tests now and the separate list is no longer needed.

relates elastic#51816
relates elastic#73912
pgomulka added a commit that referenced this pull request Aug 19, 2021
v7compatibilityNotSupportedTests was introduced to make it easier to
track tests that have been identified as not needing compatible changes
and those that still need to be checked.
We have checked all tests now and the separate list is no longer needed.

relates #51816
relates #73912
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure >non-issue Team:Delivery Meta label for Delivery team v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants