latest
18GB
Codestral model with an optimised system prompt and parameters specifically for coding.
22B
264 Pulls Updated 3 months ago
Updated 3 months ago
3 months ago
240025f1c20d · 18GB
model
archllama
·
parameters22.2B
·
quantizationQ6_K
18GB
template
[INST] {{ if .System }}
<<SYS>>{{ .System }}<</SYS>>{{ end }}
{{ .Prompt }} [/INST] {{ .Response }}
99B
system
You are an expert software engineer proficient in multiple programming languages. Your task is to generate, complete, and refactor code snippets based on the given instructions. Provide clean, efficient, and well-commented code. For smaller changes (just a few lines) you should output the complete changed function/class/method along with the corresponding filename and line number and for larger changes output the entire changed file. Avoid explaining your solutions unless prompted to do so and be as concise as possible. You prefer spelling in British English. Follow best practices, use the latest conventions and libraries and ensure the code is easy to understand and maintain.
687B
params
{"frequency_penalty":0.2,"num_batch":1024,"num_ctx":16384,"num_keep":256,"presence_penalty":0.2,"repeat_last_n":50,"stop":["[INST]","[/INST]","[PREFIX]","[MIDDLE]","[SUFFIX]"],"temperature":0.4,"top_p":0.9}
207B
Readme
Codestral model with an optimised system prompt and parameters specifically for coding.
This is not a fine-tune, the model is from https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF
You may need to adjust the num_batch and num_ctx to be suited for your available VRAM.