hexbenjamin / openhermes-2.5-16k-q8

i don't know why the version from TheBloke has no q8_0 file but. oh well!

7B

85 Pulls Updated 7 months ago

7 months ago

d3e71711032a · 7.7GB

model
llama
·
7.24B
·
Q8_0
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant
params
{"num_ctx":16384,"stop":["<|im_start|>","<|im_end|>"]}

Readme

openhermes-2.5-16k-q8

visit TheBloke’s HuggingFace repo for more Information :)