Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Chunked loading of training data #2423

Merged
merged 13 commits into from
Nov 17, 2023
Merged

Chunked loading of training data #2423

merged 13 commits into from
Nov 17, 2023

Commits on Nov 17, 2023

  1. Load training data in chunks when training an energy regressor

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    bb7cc84 View commit details
    Browse the repository at this point in the history

  2. Check event validity after merging chunks and make it faster

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    0849576 View commit details
    Browse the repository at this point in the history

  3. Do all event validation in chunk loop; remove loading bar 

    - Since the total number of telescope events in a file is not known when
  loading in chunks (only the total number of subarray events),
  a progress bar for loading does not make sense.
    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    8b60cf5 View commit details
    Browse the repository at this point in the history

  4. Chunked loading for training particle clf and training disp reco

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    88f00b5 View commit details
    Browse the repository at this point in the history

  5. Add changelog

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    525e3ba View commit details
    Browse the repository at this point in the history

  6. Fix line too long

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    4ac7709 View commit details
    Browse the repository at this point in the history

  7. Count invalid events as non-predictable, not valid events

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    3fae0b0 View commit details
    Browse the repository at this point in the history

  8. Refactor reading training data into standalone funtion

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    8378645 View commit details
    Browse the repository at this point in the history

  9. Add docstring

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    a389183 View commit details
    Browse the repository at this point in the history

  10. Add type hints

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b52be84 View commit details
    Browse the repository at this point in the history

  11. Use relative imports, default logger, and correct type hint

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    f93e245 View commit details
    Browse the repository at this point in the history

  12. Use keyword arguments

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b61576e View commit details
    Browse the repository at this point in the history

  13. Use n_background for background events

    @LukasBeiske
    LukasBeiske committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    bb01357 View commit details
    Browse the repository at this point in the history