Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

operator debug: write NDJSON for large collections #14610

Merged
merged 2 commits into from
Sep 22, 2022

Commits on Sep 16, 2022

  1. operator debug: write NJSON for large collections

    The `operator debug` command writes JSON files from API responses as a single
    line containing an array of JSON objects. But some of these files can be
    extremely large (GB's) for large production clusters, which makes it difficult
    to parse them using typical line-oriented Unix command line tools that can
    stream their inputs without consuming a lot of memory.
    
    For collections that are typically large, instead emit newline-delimited JSON.
    
    This changeset includes some first-pass refactoring of this command. It breaks
    up monolithic methods that validate a path, create a file, serialize objects,
    and write them to disk into smaller functions, some of which can now be
    standalone to take advantage of generics.
    tgross committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    cc08926 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. Configuration menu
    Copy the full SHA
    5423f92 View commit details
    Browse the repository at this point in the history