NNI v3.0 iteration plan

[Bonytu]

Release manager: @Bonytu
Release start date: 5.15
Feature freeze date (at most 30 days): 6.12
Code freeze date & first package:
Tutorial freeze:
Release date (3 weeks since feature freeze):

[Bonytu]

NAS

• P1 - write documents 06.09
• P0 - Support of PyTorch (and Lightning) 2.0 05.26
  • [NAS] Support of PyTorch (and Lightning) 2.0 #5466

[Bonytu]

Compression

• P0 Merge contrib into compression 3d 05.24 [Compression] merge nni.contrib.compression with nni.compression #5573
• P1 Write documents and examples for Houwen's distill util
• P1 Add some pruning features/algos 1w + 1w
• P2 Example about stable diffusion, LLaMa
• P0 Add support for Deepspeed [Compression] Add support for deepspeed #5517
• P1 Add some tricks for PTQ [Compression] Add bias correction feature for PTQ quantizer #5603
• P0 Add the LSQ+ quantization algorithm. [Compression] Add lsq+ quantizer and fix bug #5591
• P0 Add support for quantization speedup @BillAmihom 06.02
• P0 [compression] pruning dependency v2 #5569 05.24 @super-dainiu

[Bonytu]

HPO and NNI manager

• P0 Debug pushing backend 1d
  • webui push api staging #5563
• P1 Notification backend 3d
• P1 Support NAS search space in HPO 3d
• P1 Migrate AML to V3 5d
• P1 File command channel 5d
• P2 To do and fixme 3d 5d
  • Get rid of IoC and remove unused training services #5567
  • REST related TODOs 05.22
  • Trial keeper related TODOs

[Bonytu]

WebUI

• P0 Webui visualize push debug massage 05.26
  • PR 05.22
  • with Zhe
  • Ouyang
• P0 [discuss and design] Reference (https://github.com/continue-revolution/sd-webui-segment-anything/tree/master) to design a UI