quantization of (https://huggingface.co/starsnatched/MemGPT-DPO-uncensored-GGUF) to q8_0, brought to ollama :)
7B
872 Pulls Updated 7 months ago
5b7336e70bff · 68B
{
"num_ctx": 8192,
"stop": [
"<|im_end|>"
],
"temperature": 0.05
}