Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix e2e acks test #3471

Merged
merged 8 commits into from
Oct 11, 2023
Merged

Conversation

kkondaka
Copy link
Collaborator

@kkondaka kkondaka commented Oct 10, 2023

Description

Fix flaky test in e2e acks integration test.

Modified the sleep time in InMemorySource to 50ms

Resolves #3481

Issues Resolved

Resolves #3481

Check List

  • [ X] New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Kondaka <krishkdk@amazon.com>
Copy link
Member

@dlvenable dlvenable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please create a GitHub issue to track adding this back in. Set the milestone for 2.6 so that we can track it.

Signed-off-by: Kondaka <krishkdk@amazon.com>
@kkondaka
Copy link
Collaborator Author

@dlvenable created the issue #3472 and put milestone as v2.6

dlvenable
dlvenable previously approved these changes Oct 10, 2023
Signed-off-by: Kondaka <krishkdk@amazon.com>
Signed-off-by: Kondaka <krishkdk@amazon.com>
Signed-off-by: Kondaka <krishkdk@amazon.com>
Signed-off-by: Kondaka <krishkdk@amazon.com>
Signed-off-by: Kondaka <krishkdk@amazon.com>
@kkondaka kkondaka changed the title Disable flaky e2e acks test Fix e2e acks test Oct 11, 2023
@@ -44,13 +45,15 @@ void setUp(String configFile) {
.withPipelinesDirectoryOrFile(configFile)
.build();

System.out.println("Data Prepper Test with config file "+ configFile + " started at "+Instant.now());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please change this to an SLF4J log line.

LOG.info("PipelinesWithAcksIT with configu file {} started at {}", configFile, Instant.now());

dataPrepperTestRunner.start();
inMemorySourceAccessor = dataPrepperTestRunner.getInMemorySourceAccessor();
inMemorySinkAccessor = dataPrepperTestRunner.getInMemorySinkAccessor();
}

@AfterEach
void tearDown() {
System.out.println("Data Prepper Test stopped at "+Instant.now());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Again, use SLF4J.

@@ -115,7 +115,7 @@ public void run() {
try {
final List<Record<Event>> records = inMemorySourceAccessor.read(testingKey);
if (records.size() == 0) {
Thread.sleep(1000);
Thread.sleep(50);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@graytaylor0
Copy link
Member

graytaylor0 commented Oct 11, 2023

Just a callout I created this issue earlier for flaky tests (#3481). If you fixed one of the ones mentioned in that issue please check it off the list in the issue

Signed-off-by: Kondaka <krishkdk@amazon.com>
@kkondaka kkondaka merged commit 400b2a8 into opensearch-project:main Oct 11, 2023
26 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 11, 2023
* Disable flaky e2e acks test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Disabled another flaky test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Added debug statements to debug the failing tests

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Modified to assign unique names to pipelines

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Trying with enabling the disabled test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Fixed failing checkstyle error

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Reduced sleep time in InMemorySource

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Modified to use log4j

Signed-off-by: Kondaka <krishkdk@amazon.com>

---------

Signed-off-by: Kondaka <krishkdk@amazon.com>
(cherry picked from commit 400b2a8)
dlvenable pushed a commit that referenced this pull request Oct 11, 2023
* Disable flaky e2e acks test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Disabled another flaky test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Added debug statements to debug the failing tests

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Modified to assign unique names to pipelines

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Trying with enabling the disabled test

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Fixed failing checkstyle error

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Reduced sleep time in InMemorySource

Signed-off-by: Kondaka <krishkdk@amazon.com>

* Modified to use log4j

Signed-off-by: Kondaka <krishkdk@amazon.com>

---------

Signed-off-by: Kondaka <krishkdk@amazon.com>
(cherry picked from commit 400b2a8)

Co-authored-by: kkondaka <41027584+kkondaka@users.noreply.github.com>
@kkondaka kkondaka deleted the disable-flaky-test branch May 13, 2024 05:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Flaky tests high-level tracking
3 participants