-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multirun capabilities and other improvements #10
Conversation
…ith the new hydra setup and custom resolvers
… from the right sources
…ow in the pre-MEDS stage
… floats vs. ints occurring during the event conversion currently, though
Updated configs and added a resolver to get informative help messages from either the config or the script docstrings.
Warning Review failedThe pull request is closed. WalkthroughThe changes primarily enhance the MEDS data extraction and preprocessing pipeline, adding new configurations, scripts, and instructions for handling MIMIC-IV and eICU datasets. Key updates include improved installation commands, parallel processing options, and detailed guidance for running ETL processes locally, in parallel, or over Slurm. Additionally, new configuration files and scripts streamline the data processing stages, ensuring efficient and accurate data handling. Changes
Sequence Diagram(s)sequenceDiagram
participant User
participant Script
participant ETL_Process
participant Slurm
User->>Script: Initiate ETL Process
Script->>ETL_Process: Start Local/Parallel Processing
Script->>Slurm: Submit Job (if Slurm)
Slurm->>ETL_Process: Execute ETL Stages
ETL_Process->>Script: Process Data
Script->>User: Completion Notification
Poem
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
Summary by CodeRabbit
Documentation
New Features
Bug Fixes
Refactor
Chores