Convert bf16-pretrained model to fp16 #230

Closed

HURIMOZ started this conversation in General

HURIMOZ
Apr 15, 2025

Hi, is it possible to convert a bf16 model into an FP16 model for finetuning LLama 3.2-Instruct?

Replies: 1 comment 1 reply

vince62s
Apr 16, 2025
Maintainer

At conversion time you can:
https://github.com/eole-nlp/eole/blob/main/eole/bin/convert/convert_HF.py#L1125-L1130

1 reply

HURIMOZ Apr 16, 2025
Author

Thanks Vince.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment