Running against pre-installed hugging face models #962
Unanswered
AhmedHawater2003
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
First of all, thanks for the great tool!
Is it possible to run the tool against a pre-installed model that I have installed from hugging face (e.g. gemma-3-4B-it-qat-GGUF)? Because from my understanding, the plugins are installed against specific models and these models need to be installed separately.
Just one more note for additional context: I am using Windows along with WSL2 and I have installed the gemma-3-4B-it-qat-GGUF model from LM studio.
Thanks in advance!
Beta Was this translation helpful? Give feedback.
All reactions