Skip to content

Loading LoRAs should disable mmap (LoRA + mmap causes segmentation fault) #107

Closed
@horenbergerb

Description

@horenbergerb

In the issue that implemented LoRAs in llama.cpp they say "Using --lora disables mmap since the models have to be modified anyway."

It seems like trying to load a LoRA in llama-cpp-python with mmap enabled causes a segmentation fault. Probably this package should copy the default behavior of llama.cpp and disable mmap when loading LoRAs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions