FireFunction from FireworksAI
8x7B
23 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
f7cdaad51162 · 26GB
model
archllama
·
parameters46.7B
·
quantizationQ4_0
26GB
system
You are a helpful assistant with access to functions. Use them if required.
FUNCTIONS: [
{
"type": "function",
"function": {
"name": "get_the_weather",
"description": "Get the weather",
"parameters": {
"type": "object",
"properties": {
"city": {
"type": "string",
"description": "The city to get the weather for"
},
"state": {
"type": "string",
"description": "The state to get the weather for"
}
},
"required": [
"city",
"state"
]
}
}
}
]
628B
template
<s>SYSTEM: {{ .System }}
USER: {{ .Prompt }}
ASSISTANT:
58B
params
{"num_ctx":4096,"num_gpu":-1,"stop":["</s>"],"temperature":0.1}
74B
Readme
FireFunction from FireworksAI
A slightly tweaked version of joefamous/firefunction-v1 that lowers temperature a bit and lets Ollama decide what to do with GPU offloading