dagbs / dolphin-2.9.2-qwen2-7b

7B

442 Pulls Updated 3 months ago

3 months ago

b87ff8db4db6 · 4.7GB

model
qwen2
·
7.62B
·
Q4_K_M
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|> {{ end }}<|im_start|>assistant {{ .Response }}<|im_end|>
params
{"num_ctx":131072,"stop":["<|im_start|>","<|im_end|>","<|endoftext|>"]}

Readme

original gguf on hf cognitivecomputations/dolphin-2.9.2-qwen2-7b-gguf