Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Integration tests for NAS #2231

Merged
merged 5 commits into from
Mar 27, 2020
Merged

Integration tests for NAS #2231

merged 5 commits into from
Mar 27, 2020

Conversation

ultmaster
Copy link
Contributor

@ultmaster ultmaster commented Mar 25, 2020

The tests cover:

  • Search space generator for classic NAS
  • DARTS
  • ENAS
  • Naive
  • P-DARTS

I'm not gonna finish the tests for other examples in this release, because

  • I need to adjust the distributed scripts to make CDARTS work on pipeline.
  • I need to prepare ImageNet on pipeline machine to test SPOS and ProxylessNAS.
  • I need to prepare glove and SST dataset on machine for TextNAS.
  • Distributed NAS (NAS with nnictl) needs extra engineering effort on pipeline code.

The tests take ~25min on our pipeline, lengthening our pipeline to ~80min. I tried to reduce this time with minimum configurations (minimum epochs, minimum channels). Perhaps it can be further optimized without intrusive modification to example code, but it's not trivial to me.

conda activate nnidev
Merge remote-tracking branch 'privileged/master' into dev-nas-it
@ultmaster
Copy link
Contributor Author

I’m merging it first. UT on IT still pending fix.

@ultmaster ultmaster merged commit 116fd9a into master Mar 27, 2020
@liuzhe-lz liuzhe-lz deleted the dev-nas-it branch July 17, 2020 11:17
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants