How to use this with hugging face API?

[michael-newsrx]

How do I use this with a hugging face API endpoint?

Can it be deployed as a guidance server?

Do I need to run a stock API endpoint then use some magic class that I can't find a reference to?

Think Llama-3 and Mixtral...

-Mike/NewsRx

[michael-newsrx]

What about the Hugging Face Serverless API?

[michael-newsrx]

See also: #945