-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PR3: Add cifar10 experiments #171
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mostly cosmetic changes suggested throughout. The biggest set of possible changes are proposed in this PR
tests/utils/sampler_test.py
Outdated
sampler = DirichletLabelBasedSampler(unique_labels=list(range(10)), sample_percentage=1.0, beta=0.1) | ||
ds = MnistDataset(data_path=Path("examples/datasets/MNIST"), train=True) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We're forming the MnistDataset in a few places and this test will require downloading the dataset if it doesn't exist in the folder specified. So I'm thinking we can just use a synthetic dataset for these tests. I encapsulated the possible simplification in this PR
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Even though this is a comment on outdated code, we're still using the MNIST dataset here. So I think the migration to the synthetic dataset will still be useful unless you disagree 🙂
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a few intermediate comments. I know you're still working on this one a bit 🙂
Resolved all feedback and implemented four checkpointing methods for clients and two for the server. Additionally, expanded the test file to evaluate all checkpoint scenarios. |
for more information, see https://pre-commit.ci
…rInstitute/FL4Health into sa_add_cifar10_experiments
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall, this looks pretty good to me. However, there are a few small bugs to fix and perhaps a comment or two that would be useful.
To other final comments:
|
I have made all the necessary changes and added a README to the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Everything looks good to me once we get this smoke test fixed.
PR Type
[Feature ]
Short Description
Cifar10 experiments with various levels of heterogeneity.
Tests Added
No tests added yet.