Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update stack versions in recipes/samples and e2e matrix. #8370

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Update stack versions in recipes/samples and e2e matrix. #8370

wants to merge 4 commits into from

Conversation

naemono
Copy link
Contributor

@naemono naemono commented Dec 19, 2024

No description provided.

@naemono
Update stack versions in recipes/samples and e2e matrix.
20e4769 
Signed-off-by: Michael Montgomery <mmontg1@gmail.com>
@naemono naemono added >test Related to unit/integration/e2e tests exclude-from-release-notes Exclude this PR from appearing in the release notes labels Dec 19, 2024
@naemono
Copy link
Contributor Author

naemono commented Dec 19, 2024

buildkite test this -f p=kind -m s=8.17.0,s=9.0.0-SNAPSHOT

@naemono
Copy link
Contributor Author

naemono commented Dec 26, 2024

Strange error in e2e tests; retrying.

{\"log.level\":\"error\",\"@timestamp\":\"2024-12-19T23:12:55.401Z\",\"log.logger\":\"e2e\",\"message\":\"while deleting elastic resources in e2e-nqysy-mercury\",\"service.version\":\"0.0.0-SNAPSHOT+00000000\",\"service.type\":\"eck\",\"ecs.version\":\"1.4.0\",\"group\":\"stackconfigpolicy.k8s.elastic.co\",\"resource\":\"stackconfigpolicies\",\"version\":\"v1alpha1\",\"error\":\"encoding is not allowed for this codec: *versioning.codec\",\"error.stack_trace\":\"github.com/elastic/cloud-on-k8s/v2/test/e2e/test.deleteTestResources\\n\\t/go/src/github.com/elastic/cloud-on-k8s/test/e2e/test/utils.go:232\\ngit.luolix.top/elastic/cloud-on-k8s/v2/test/e2e/test.StepList.RunSequential\\n\\t/go/src/github.com/elastic/cloud-on-k8s/test/e2e/test/step.go:60\\ngit.luolix.top/elastic/cloud-on-k8s/v2/test/e2e/apm.TestCrossNSAssociation\\n\\t/go/src/github.com/elastic/cloud-on-k8s/test/e2e/apm/association_test.go:49\\ntesting.tRunner\\n\\t/usr/local/go/src/testing/testing.go:1690\"}\n"}
--
  | {"Time":"2024-12-19T23:12:55.401590481Z","Action":"output","Package":"github.com/elastic/cloud-on-k8s/v2/test/e2e/apm","Test":"TestCrossNSAssociation/ApmServer_Pods_should_eventually_be_ready","Output":"{\"log.level\":\"error\",\"@timestamp\":\"2024-12-19T23:12:55.401Z\",\"log.logger\":\"e2e\",\"message\":\"while deleting elastic resources\",\"service.version\":\"0.0.0-SNAPSHOT+00000000\",\"service.type\":\"eck\",\"ecs.version\":\"1.4.0\",\"error\":\"encoding is not allowed for this codec: *versioning.codec\",\"error.stack_trace\":\"github.com/elastic/cloud-on-k8s/v2/test/e2e/test.StepList.RunSequential\\n\\t/go/src/github.com/elastic/cloud-on-k8s/test/e2e/test/step.go:61\\ngit.luolix.top/elastic/cloud-on-k8s/v2/test/e2e/apm.TestCrossNSAssociation\\n\\t/go/src/github.com/elastic/cloud-on-k8s/test/e2e/apm/association_test.go:49\\ntesting.tRunner\\n\\t/usr/local/go/src/testing/testing.go:1690\"}\n"}

@naemono
Copy link
Contributor Author

naemono commented Dec 30, 2024

buildkite test this -f p=kind -m s=8.17.0,s=9.0.0-SNAPSHOT

pebrc
pebrc reviewed Dec 31, 2024
View reviewed changes
Copy link
Collaborator

@pebrc pebrc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Screenshot 2024-12-31 at 10 04 29

Looks like the agent ran out of memory?

.buildkite/e2e/nightly-main-matrix.yaml Show resolved Hide resolved
@naemono
Also test 8.18.0-snapshot
1ca57e2 
Signed-off-by: Michael Montgomery <mmontg1@gmail.com>
@naemono
Copy link
Contributor Author

naemono commented Jan 13, 2025

buildkite test this -f p=kind -m s=8.17.0,s=9.0.0-SNAPSHOT

@naemono
Copy link
Contributor Author

naemono commented Jan 13, 2025

buildkite test this -f p=kind -m s=8.17.0,s=8.18.0-SNAPSHOT,s=9.0.0-SNAPSHOT

@naemono naemono requested a review from pebrc January 13, 2025 15:14
@naemono
Copy link
Contributor Author

naemono commented Jan 13, 2025

buildkite test this -f p=kind -m s=8.17.0,s=8.18.0-SNAPSHOT,s=9.0.0-SNAPSHOT

@naemono
Copy link
Contributor Author

naemono commented Jan 14, 2025

buildkite test this -f p=kind -m s=8.18.0-SNAPSHOT

@naemono
Copy link
Contributor Author

naemono commented Jan 15, 2025

Ok, the CI is failing because 8.18.0-snapshot e2e test runs are failing:

  "unassigned_shards" : 9,

in the TestFleetMode/Fleet_in_different_namespace_than_Agent test.

.ds-.logs-deprecation.elasticsearch-default-2025.01.15-000001 0     p      UNASSIGNED                       
.ds-ilm-history-7-2025.01.15-000001                           0     p      UNASSIGNED                       
.kibana_8.18.0_001                                            0     p      UNASSIGNED                       
.kibana_alerting_cases_8.18.0_001                             0     p      UNASSIGNED                       
.kibana_analytics_8.18.0_001                                  0     p      UNASSIGNED                       
.kibana_ingest_8.18.0_001                                     0     p      UNASSIGNED                       
.kibana_security_solution_8.18.0_001                          0     p      UNASSIGNED                       
.kibana_task_manager_8.18.0_001                               0     p      UNASSIGNED                       
.kibana_usage_counters_8.18.0_001                             0     p      UNASSIGNED

I think that the node is out of disk space:

                "data": [
                    {
                        "path": "/usr/share/elasticsearch/data",
                        "mount": "/usr/share/elasticsearch/data (/dev/root)",
                        "type": "ext4",
                        "total": "96.7gb",
                        "total_in_bytes": 103865303040,
                        "free": "3.8gb",
                        "free_in_bytes": 4119760896,
                        "available": "3.8gb",
                        "available_in_bytes": 4102983680,
                        "low_watermark_free_space": "14.5gb",
                        "low_watermark_free_space_in_bytes": 15579795456,
                        "high_watermark_free_space": "9.6gb",
                        "high_watermark_free_space_in_bytes": 10386530304,
                        "flood_stage_free_space": "4.8gb",
                        "flood_stage_free_space_in_bytes": 5193265152
                    }
                ],

@naemono
Copy link
Contributor Author

naemono commented Jan 15, 2025

yep:

  "log.level": "WARN",
  "message": "flood stage disk watermark [95%] exceeded on [CRG7MgEJTfuM8keOGM3URQ][test-kb-resources-j9bw-es-masterdata-0][/usr/share/elasticsearch/data] free: 3.8gb[3.9%], all indices on this node will be marked read-only",

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@thbkrkr thbkrkr thbkrkr approved these changes

@barkbay barkbay Awaiting requested review from barkbay

@rhr323 rhr323 Awaiting requested review from rhr323

@pebrc pebrc Awaiting requested review from pebrc

Assignees
No one assigned
Labels
exclude-from-release-notes Exclude this PR from appearing in the release notes >test Related to unit/integration/e2e tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@naemono @thbkrkr @pebrc