Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

More accurate estimation for the result serialization time in RapidsShuffleThreadedWriterBase #11180

Merged
merged 6 commits into from
Jul 18, 2024
Merged

More accurate estimation for the result serialization time in RapidsShuffleThreadedWriterBase #11180

merged 6 commits into from
Jul 18, 2024

Commits on Jul 12, 2024

  1. Exclude the processing time in records.hasNext from the serialization… 

    … time estimation

Signed-off-by: Jihoon Son <ghoonson@gmail.com>
    @jihoonson
    jihoonson committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    6cf48ab View commit details
    Browse the repository at this point in the history

  2. Exclude the wait time on limiter

    @jihoonson
    jihoonson committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    0552fa8 View commit details
    Browse the repository at this point in the history

  3. Exclude batch size computing time as well

    @jihoonson
    jihoonson committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    f39353b View commit details
    Browse the repository at this point in the history

  4. fix outdated comment; add more comments

    @jihoonson
    jihoonson committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    fc299dc View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Add a function that takes a TimeTrackingIterator

    @jihoonson
    jihoonson committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    3b076cf View commit details
    Browse the repository at this point in the history

  2. make stuff private

    @jihoonson
    jihoonson committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    5c8d107 View commit details
    Browse the repository at this point in the history