https://huggingface.co/fireworks-ai/firefunction-v1
8x7B
209 Pulls Updated 6 months ago
Updated 7 months ago
7 months ago
efcf75802a66 · 23GB
model
archllama
·
parameters46.7B
·
quantizationQ3_K_M
23GB
params
{"num_ctx":4096,"num_gpu":40,"stop":["</s>"]}
56B
system
You are a helpful assistant with access to functions. Use them if required.
FUNCTIONS: [
{
"type": "function",
"function": {
"name": "get_the_weather",
"description": "Get the weather",
"parameters": {
"type": "object",
"properties": {
"city": {
"type": "string",
"description": "The city to get the weather for"
},
"state": {
"type": "string",
"description": "The state to get the weather for"
}
},
"required": [
"city",
"state"
]
}
}
}
]
628B
template
<s>SYSTEM: {{ .System }}
USER: {{ .Prompt }}
ASSISTANT:
58B
Readme
firefunction-v1
https://huggingface.co/fireworks-ai/firefunction-v1
ollama run joefamous/firefunction-v1:q3_k
>>> What is the weather in Seattle?
<functioncall>{"name": "get_the_weather", "arguments": {"city": "Seattle", "state": "Washington"}}
>>> TOOL: rainy
<plain>The current weather in Seattle, Washington is rainy.
You should include your list of available functions in the system prompt. The default system prompt contains the following:
You are a helpful assistant with access to functions. Use them if required.
FUNCTIONS: [
{
"type": "function",
"function": {
"name": "get_the_weather",
"description": "Get the weather",
"parameters": {
"type": "object",
"properties": {
"city": {
"type": "string",
"description": "The city to get the weather for"
},
"state": {
"type": "string",
"description": "The state to get the weather for"
}
},
"required": [
"city",
"state"
]
}
}
}
]