You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The tool calling that is supported is the [JSON based tool calling](https://llama.meta.com/docs/model-cards-and-prompt-formats/llama3_1/#json-based-tool-calling). For [pythonic tool calling](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/text_prompt_format.md#zero-shot-function-calling) introduced by the Llama-3.2 models, see the `pythonic` tool parser below.
159
161
160
-
The tool calling that is supported is the [JSON based tool calling](https://llama.meta.com/docs/model-cards-and-prompt-formats/llama3_1/#json-based-tool-calling). For [pythonic tool calling](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/text_prompt_format.md#zero-shot-function-calling) in Llama-3.2 models, see the `pythonic` tool parser below.
161
162
Other tool calling formats like the built in python tool calling or custom tool calling are not supported.
162
163
163
164
Known issues:
@@ -166,10 +167,14 @@ Known issues:
166
167
2. The model can generate parameters with a wrong format, such as generating
167
168
an array serialized as string instead of an array.
168
169
169
-
The `tool_chat_template_llama3_json.jinja` file contains the "official" Llama chat template, but tweaked so that
170
-
it works better with vLLM.
170
+
VLLM provides two JSON based chat templates for Llama 3.1 and 3.2:
171
+
172
+
*`examples/tool_chat_template_llama3.1_json.jinja` - this is the "official" chat template for the Llama 3.1
173
+
models, but tweaked so that it works better with vLLM.
174
+
*`examples/tool_chat_template_llama3.2_json.jinja` - this extends upon the Llama 3.1 chat template by adding support for
0 commit comments