Codestral model with an optimised system prompt and parameters specifically for coding.

281 5 months ago

ed305cccb679 · 205B
{
"frequency_penalty": 0.2,
"num_batch": 1024,
"num_ctx": 16384,
"num_keep": 8,
"presence_penalty": 0.2,
"repeat_last_n": 40,
"stop": [
"[INST]",
"[/INST]",
"[PREFIX]",
"[MIDDLE]",
"[SUFFIX]"
],
"temperature": 0.4,
"top_p": 0.9
}