Skip to content
This repository was archived by the owner on Nov 1, 2024. It is now read-only.

Commit 24a2805

Browse files
ir413facebook-github-bot
authored andcommitted
Refactor se in anynet to support regnety (#42)
Summary: Pull Request resolved: #42 Test Plan: Imported from GitHub, without a `Test Plan:` line. tested locally: ``` ~/fbsource/fbcode/buck-out/gen/vision/fair/pycls/tools/test_net.par --cfg configs/imagenet/regnet/RegNetX-200MF_dds_1gpu.yaml NUM_GPUS 1 TRAIN.BATCH_SIZE 64 TEST.BATCH_SIZE 32 TEST.WEIGHTS https://dl.fbaipublicfiles.com/pycls/checkpoints/RegNet-X-E100-F0200-V04.pyth ``` Reviewed By: vedanuj Differential Revision: D20983994 Pulled By: rajprateek fbshipit-source-id: 61536f340c1e5afca3b0eb3c73f44d3a99839b90
1 parent 708d429 commit 24a2805

18 files changed

+513
-72
lines changed

configs/imagenet/effnet/EN-B0_nds_1gpu.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@ EN:
55
STEM_W: 32
66
DEPTHS: [1, 2, 2, 3, 3, 4, 1]
77
WIDTHS: [16, 24, 40, 80, 112, 192, 320]
8-
SE_ENABLED: True
98
EXP_RATIOS: [1, 6, 6, 6, 6, 6, 6]
109
SE_RATIO: 0.25
1110
STRIDES: [1, 2, 2, 2, 1, 2, 1]

configs/imagenet/effnet/EN-B0_step_1gpu.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@ EN:
55
STEM_W: 32
66
DEPTHS: [1, 2, 2, 3, 3, 4, 1]
77
WIDTHS: [16, 24, 40, 80, 112, 192, 320]
8-
SE_ENABLED: True
98
EXP_RATIOS: [1, 6, 6, 6, 6, 6, 6]
109
SE_RATIO: 0.25
1110
STRIDES: [1, 2, 2, 2, 1, 2, 1]
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 27
7+
W0: 48
8+
WA: 20.71
9+
WM: 2.65
10+
GROUP_W: 24
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 19
7+
W0: 168
8+
WA: 73.36
9+
WM: 2.37
10+
GROUP_W: 112
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 18
7+
W0: 200
8+
WA: 106.23
9+
WM: 2.48
10+
GROUP_W: 112
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 13
7+
W0: 24
8+
WA: 36.44
9+
WM: 2.49
10+
GROUP_W: 8
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 21
7+
W0: 80
8+
WA: 42.63
9+
WM: 2.66
10+
GROUP_W: 24
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 20
7+
W0: 232
8+
WA: 115.89
9+
WM: 2.53
10+
GROUP_W: 232
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 22
7+
W0: 96
8+
WA: 31.41
9+
WM: 2.24
10+
GROUP_W: 64
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 16
7+
W0: 48
8+
WA: 27.89
9+
WM: 2.09
10+
GROUP_W: 8
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 25
7+
W0: 112
8+
WA: 33.22
9+
WM: 2.27
10+
GROUP_W: 72
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
MODEL:
2+
TYPE: regnet
3+
NUM_CLASSES: 1000
4+
REGNET:
5+
SE_ON: True
6+
DEPTH: 15
7+
W0: 48
8+
WA: 32.54
9+
WM: 2.32
10+
GROUP_W: 16
11+
BOT_MUL: 1.0
12+
OPTIM:
13+
BASE_LR: 0.1
14+
LR_POLICY: cos
15+
MAX_EPOCH: 100
16+
MOMENTUM: 0.9
17+
NESTEROV: True
18+
WEIGHT_DECAY: 5e-5
19+
WARMUP_EPOCHS: 5
20+
WARMUP_FACTOR: 0.1
21+
TRAIN:
22+
DATASET: imagenet
23+
SPLIT: train
24+
BATCH_SIZE: 128
25+
IM_SIZE: 224
26+
EVAL_PERIOD: 1
27+
TEST:
28+
DATASET: imagenet
29+
SPLIT: val
30+
BATCH_SIZE: 100
31+
IM_SIZE: 256
32+
NUM_GPUS: 1
33+
DATA_LOADER:
34+
NUM_WORKERS: 4
35+
CUDNN:
36+
BENCHMARK: True
37+
OUT_DIR: .

0 commit comments

Comments
 (0)