Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[release] stream the full anyscale log to buildkite #47808

Merged
merged 1 commit into from
Sep 25, 2024
Merged

Conversation

can-anyscale
Copy link
Collaborator

Currently we only print 100 last lines of anyscale job log to buildkite. This PR removes that limit and prints everything instead. CC: @kouroshHakha

Test:

  • CI

Copy link
Collaborator

@aslonnie aslonnie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this will print way too many lines for some of the release tests. there are some release tests that have logs that are very verbose.

if we need this, this needs to be an option in the release test definition. or maybe controllable with an env var where default is still 100.

@can-anyscale
Copy link
Collaborator Author

yes, let's control this through a flag

Comment on lines +117 to +118
"--log-streaming-limit",
"100",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have the default flag value, so we can just skip it here?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

arg is still here?

@@ -390,6 +392,7 @@ def run_release_test(
cluster_env_id: Optional[str] = None,
no_terminate: bool = False,
test_definition_root: Optional[str] = None,
log_streaming_limit: int = LAST_LOGS_LENGTH,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unit test for this new feature?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added tests that the value passed into this function overrides the default value and go all the way to the cluster manager

Signed-off-by: can <can@anyscale.com>
@can-anyscale can-anyscale enabled auto-merge (squash) September 24, 2024 23:31
@github-actions github-actions bot added the go add ONLY when ready to merge, run all tests label Sep 24, 2024
@can-anyscale can-anyscale merged commit 2c63e44 into master Sep 25, 2024
7 checks passed
@can-anyscale can-anyscale deleted the can-rel02 branch September 25, 2024 00:11
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
ujjawal-khare pushed a commit to ujjawal-khare-27/ray that referenced this pull request Oct 15, 2024
Currently we only print 100 last lines of anyscale job log to buildkite.
This PR removes that limit and prints everything instead. CC:
@kouroshHakha

Test:
- CI

Signed-off-by: can <can@anyscale.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
go add ONLY when ready to merge, run all tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants