Skip to content

Not Compatible with Models quantized with updated llama.cpp q4 and q5 quantization. #227

Closed
@awinml

Description

@awinml

Not Compatible with Models quantized with updated llama.cpp q4 and q5 quantization released in llama.cpp PR 1405.

Metadata

Metadata

Assignees

No one assigned

    Labels

    llama.cppProblem with llama.cpp shared libmodelModel specific issue

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions