Custom endpoint for NER

[mouerfelli]

Hi all - I'm trying to run an NER task using a mistral model, hosted within my organization, that I have access to through an endpoint like "http://XXXXXXX/v1/chat/completions"

I saw a feature was added in January that would allow for adding custom endpoints like this, and I attempted to add one - my config.cfg is given below

on running this, I get :

Config validation error
llm.model -> name unexpected value; permitted: 'Mistral-7B-v0.1', 'Mistral-7B-Instruct-v0.1'
llm.model -> config extra fields not permitted
{'@llm_models': 'spacy.Mistral.v1', 'name': 'neuralmagic/Mixtral-8x22B-Instruct-v0.1-FP8', 'config': {'base_url': 'http://XXXXXXX/v1/chat/completions', 'temperature': 0}}

I tried also the config but with :
@llm_models = "langchain.Ollama.v1"

not working for me ! please help

[nlp]
lang = "fr"
pipeline = ["llm"]

[components]

[components.llm]
factory = "llm"

[components.llm.task]
@llm_tasks = "spacy.NER.v3"
labels = ["PERSON", "ORGANIZATION", "LOCATION","PRODUCT","BRAND","MISC","DATE"]
description = Entities are the names of individuals, organizations or locations.
    Adjectives, verbs, adverbs are not entities.
    Pronouns are not entities.


[components.llm.model]
@llm_models = "spacy.Mistral.v1"
name =  "neuralmagic/Mixtral-8x22B-Instruct-v0.1-FP8"
config = {
    "base_url": "http://XXXXXXX/v1/chat/completions",
    "temperature": 0
    }