[WIP] Add Swin Transformer (#511)
* add Swin Transformer * add Swin Transformer * fixed import * Add some swin training settings. * Fix some filename error. * Fix attribute name: pretrain -> pretrained * Upload mmcls implementation of swin transformer. * Refactor Swin Transformer to follow mmcls style. * Refactor init_weigths of swin_transformer.py * Fix lint * Match inference precision * Add some comments * Add swin_convert to load official style ckpt * Remove arg: auto_pad * 1. Complete comments for each block; 2. Correct weight convert function; 3. Fix the pad of Patch Merging; * Clean function args. * Fix vit unit test. * 1. Add swin transformer unit tests; 2. Fix some pad bug; 3. Modify config to adapt new swin implementation; * Modify config arg * Update readme.md of swin * Fix config arg error and Add some swin benchmark msg. * Add MeM and ms test content for readme.md of swin transformer. * Fix doc string of swin module * 1. Register swin transformer to model list; 2. Modify pth url which keep meta attribute; * Update swin.py * Merge config settings. * Modify config style. * Update README.md Add ViT link * Modify main readme.md Co-authored-by:Jiarui XU <xvjiarui0826@gmail.com> Co-authored-by:
sennnnn <201730271412@mail.scut.edu.cn> Co-authored-by:
Junjun2016 <hejunjun@sjtu.edu.cn>
Showing
- README.md 7 additions, 6 deletionsREADME.md
- README_zh-CN.md 9 additions, 7 deletionsREADME_zh-CN.md
- configs/_base_/models/upernet_swin.py 55 additions, 0 deletionsconfigs/_base_/models/upernet_swin.py
- configs/swin/README.md 27 additions, 0 deletionsconfigs/swin/README.md
- configs/swin/upernet_swin_base_patch4_window12_512x512_160k_ade20k_pretrain_384x384_1K.py 15 additions, 0 deletions...atch4_window12_512x512_160k_ade20k_pretrain_384x384_1K.py
- configs/swin/upernet_swin_base_patch4_window12_512x512_160k_ade20k_pretrain_384x384_22K.py 8 additions, 0 deletions...tch4_window12_512x512_160k_ade20k_pretrain_384x384_22K.py
- configs/swin/upernet_swin_base_patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py 13 additions, 0 deletions...patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py
- configs/swin/upernet_swin_base_patch4_window7_512x512_160k_ade20k_pretrain_224x224_22K.py 8 additions, 0 deletions...atch4_window7_512x512_160k_ade20k_pretrain_224x224_22K.py
- configs/swin/upernet_swin_small_patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py 17 additions, 0 deletions...patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py
- configs/swin/upernet_swin_tiny_patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py 46 additions, 0 deletions...patch4_window7_512x512_160k_ade20k_pretrain_224x224_1K.py
- mmseg/models/backbones/__init__.py 2 additions, 1 deletionmmseg/models/backbones/__init__.py
- mmseg/models/backbones/swin.py 778 additions, 0 deletionsmmseg/models/backbones/swin.py
- mmseg/models/backbones/vit.py 9 additions, 48 deletionsmmseg/models/backbones/vit.py
- mmseg/models/utils/__init__.py 4 additions, 2 deletionsmmseg/models/utils/__init__.py
- mmseg/models/utils/ckpt_convert.py 90 additions, 0 deletionsmmseg/models/utils/ckpt_convert.py
- mmseg/models/utils/embed.py 89 additions, 0 deletionsmmseg/models/utils/embed.py
- mmseg/models/utils/timm_convert.py 0 additions, 32 deletionsmmseg/models/utils/timm_convert.py
- tests/test_models/test_backbones/test_swin.py 64 additions, 0 deletionstests/test_models/test_backbones/test_swin.py
- tests/test_models/test_backbones/test_vit.py 1 addition, 1 deletiontests/test_models/test_backbones/test_vit.py
Loading
Please register or sign in to comment