Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Support unroll with MMDDP in darts algorithm #210

Merged
merged 15 commits into from
Oct 14, 2022
Merged

[Feature] Support unroll with MMDDP in darts algorithm #210

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
a9ac0b2
support unroll in darts
pprp Jul 27, 2022
25755c7
fix bugs in optimizer; add docstring
pprp Jul 28, 2022
37cedb6
update darts algorithm [untested]
pprp Jul 29, 2022
0df63f0
modify autograd.grad to optim_wrapper.backward
pprp Aug 2, 2022
85bd6b3
add amp in train.py; support constructor
pprp Aug 3, 2022
ece0dda
rename mmcls.data to mmcls.structures
pprp Aug 3, 2022
954ac23
modify darts algo to support apex [not done]
pprp Aug 3, 2022
d1ca4ff
fix code spell in diff_mutable_module
pprp Aug 3, 2022
cd48648
modify optim_context of dartsddp
pprp Aug 3, 2022
0034ec1
add testcase for dartsddp
pprp Aug 3, 2022
90cb785
fix bugs of apex in dartsddp
pprp Aug 3, 2022
9ea075d
standardized the unittest of darts
pprp Aug 5, 2022
0f28970
adapt new data_preprocessor
Oct 14, 2022
1ae600d
fix ut bugs
Oct 14, 2022
3a1a0e7
remove unness code
Oct 14, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion configs/nas/mmcls/darts/darts_supernet_unroll_1xb96_cifar10.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,11 @@
_delete_=True,
constructor='mmrazor.SeparateOptimWrapperConstructor',
architecture=dict(
type='OptimWrapper',
optimizer=dict(type='SGD', lr=0.025, momentum=0.9, weight_decay=3e-4),
clip_grad=dict(max_norm=5, norm_type=2)),
mutator=dict(optimizer=dict(type='Adam', lr=3e-4, weight_decay=1e-3)))
mutator=dict(
type='OptimWrapper',
optimizer=dict(type='Adam', lr=3e-4, weight_decay=1e-3)))

find_unused_parameter = False
Loading