Search results

Does FLAP support kv cache reduction?

Status: Open.

#15 In CASIA-IVA-Lab/FLAP;

· SongtaoLiu0823 opened on Dec 2, 2024

Regarding the Choice of Calibration Set

Status: Open.

#13 In CASIA-IVA-Lab/FLAP;

· ShiningSord opened on Jun 13, 2024

can you support baffo32/decapoda-research-llama-7B-hf

Status: Open.

#12 In CASIA-IVA-Lab/FLAP;

· azuryl opened on May 12, 2024

Compute sparsity problem

Status: Open.

#10 In CASIA-IVA-Lab/FLAP;

· ironartisan opened on Apr 10, 2024

AttributeError: Can't pickle local object 'add_hook_to_module.<locals>.new_forward'

Status: Open.

#9 In CASIA-IVA-Lab/FLAP;

· shwu-nyunai opened on Apr 9, 2024

request for the inference speed test script

Status: Open.

#8 In CASIA-IVA-Lab/FLAP;

· JCDemon opened on Apr 6, 2024

pruning 之后使用 无法读取模型

Status: Open.

#7 In CASIA-IVA-Lab/FLAP;

· JCDemon opened on Apr 6, 2024

ModuleNotFoundError: No module named 'models'

Status: Open.

#1 In CASIA-IVA-Lab/FLAP;

· nss-programmer opened on Dec 31, 2023