【Released】Iteration plan for June

[SparkSnail]

Release 1.7

• Release manager: @chicm-ms
• Code freeze date: 7.1
• Demo and retrospective date: 7.3
• Release and next iteration plan date: 7.8

---

Planned Items

• use new interface to implement the removed NAS examples @QuanluZhang use new interface to implement the removed NAS examples #2311 6/10 support tf2 NAS with non-weight-sharing mode #2541
  TODO: IT and doc
  + local IT tf2.0 pipeline @chicm-ms 6/22
• NASUI @ultmaster
  --- NASUI bugs, UT 6/12 Fix bugs in NAS UI (deferred from previous releases) #2552 reviewer: @chicm-ms
• Add Support for NAS Open Benchmarks Add Support for NAS Open Benchmarks #2506 @ultmaster design review done, pr 6/19 ,
• Guidelines to handle large files in codeDir Guidelines to handle large files in codeDir #2364 @ultmaster book meeting to review pr Add support for .nniignore #2454
  need more changes
• merge parameter utils Provide a wrapper for get_next_parameter() to update namespace automatically #2437 TBD @ultmaster PR Add shortcut to merge parameter into base setup #2540
• WebUI @lvybriage
  • Enhancement to trial duration display Enhancement to trial duration display #1489 PR [WebUI] fix issue#1489: Enhancement to trial duration display #2523 being review
  • during and intermediate results pictures update, issue to create issue. 6/5 [WebUI] fix issue#2530: duration and intermediate results pictures don't update #2531
  • Support nested experiment more friendly Support nested experiment more friendly #2513 6/11 6/15 pr Support nested experiment more friendly #2554 and demo reviewer: quanlu, yuge
  • Hyper-parameter Hyperparameter graph: val_loss as metric #1483 one week 6/19, pr 6/22 Show final result keys in hyper-parameter graph #2586
    reviewers: @SparkSnail @liuzhe-lz
  • minior webui table style issues by @QuanluZhang 6/17 PR fix metric style #2571 reviewers: quanlu, yuge
• update pai storage, issue Update PAI storage  #2331 @SparkSnail (PAI 1.01 released) PR Support paiStorageConfigName #2536 yuge to review
• AML integration @SparkSnail 6/12 TBD base on @Chi 's training service refactoring.
  6/22 PR
• register user's tuner as build-in tuner (@chicm-ms )( 5.15 ) 6/9 6/11 for review (Install builtin tuners #2439 ) , reviewers: liuzhe, shinai
• finalize the homepage migration to readthedoc @leckie-chn finalize the homepage migration to readthedoc #2312 (4.24)
• Reuse OpenPAI jobs to run multiple trials Reuse OpenPAI jobs to run multiple trials #2521
• Add OpEvo example #PR 2549 review: @liuzhe-lz

Model compression TODOs:

• 1. Model speedup support resnet ( concat, add, conv2d group > 1) 6/10 6/17 @zheng-ningxin reviewers: chicm, quanlu
• 2. Fix bug for model graph with shared nn.Module TorchModuleGraph: graph construct error when the model has shared layers #2485 @zheng-ningxin ready for review
• 3. Refactor model pruning framework for automatic pruning (separate weight masking algorithms and pruning/training scheduling algorithms) PR Refactor model pruning framework #2504 update per review comments 6/11 ready
• 4. Support more pruning algorithms Auto pruners #2490 @suiguoxin update per review comments
• 5. Model sensitivity analysis tool Analysis utils #2435 @zheng-ningxin update per review comments
• lottery ticket pruner, add exporting winning ticket @chicm-ms PR Update lottery ticket example #2559 6/11
  reviewers: quanlu, yuge, chenqian 6/22
• flops calculation for model compression and NAS @colorjam 6/8 PR Add flops and params counter #2535 to schedule a meeting to discuss PR Add flops and params counter #2535 reviewers: yuge, quanlu
• mac downloading timeout @ultmaster reviewers: chicm, liuzhe

Bugs

• nodejs OOM when make build nodejs OOM when make build #2475 (@liuzhe-lz ) PR submitted reviewer: @SparkSnail @QuanluZhang
• pipeline failed to install torch 1.5.0+cpu @ultmaster
• bohb pylint error @chicm-ms 6/22

backlog:

• Advanced NAS support (@liuzhe-lz )
• code coverage @chicm-ms
• release pipeline

defer to v1.8

• TensorFlow v2 NAS performance support improve (@liuzhe-lz ) draft PR Improve TF NAS performance #2565, 6/24 ready for review

  • improve mutable performance 6/19

• Fix hyperband and BOHB:

  • support various mode: mixed multiple rounds or strictly staged rounds
    current mixed multi rounds pending

• NASUI @ultmaster
  --- focus mode,

• Fix pytorch import issue for feature engineering @chicm-ms pending

• AMC (automl for model compression) implementation 6/17 how to scale 6/19

• Fix hyperband and BOHB: @QuanluZhang 6/23

  • 2 bugs raised by Chenqian 6/22 fix at weekend

• Search Space of Tuner, quniform +q or mode q Search Space of Tuner #2397 @QuanluZhang leave it as is for now
  hyperopts: mod q (our implementation)
  +q: more user friendly

[chicm-ms]

Done