Skip to content

Commit fc7df6f

Browse files
authored
Revert "[megatron] fix: BF16 mode should use PAO as well" (#4234)
Reverts #4221
1 parent cfa2e51 commit fc7df6f

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

verl/utils/megatron/optimizer.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -47,8 +47,6 @@ def init_megatron_optim_config(optim_config: dict, fp16: bool = False) -> Optimi
4747
{
4848
"bf16": True,
4949
"params_dtype": torch.bfloat16,
50-
"use_precision_aware_optimizer": True,
51-
"store_param_remainders": True,
5250
}
5351
)
5452
override_config = optim_config.get("override_optimizer_config", {})

0 commit comments

Comments
 (0)