bengt0 / em_german_leo_mistral

Quantized variants of a German large language model (LLM).

7B

924 Pulls Updated 4 months ago

6 months ago

3834dd2467ae · 5.1GB

model
llama
·
7.24B
·
Q5_K_M
params
{"temperature":0.5}

Readme

em_german_leo_mistral

Quantized variants of a German large language model (LLM).

Example Modelfile:

FROM ./em_german_leo_mistral.Q4_K_M.gguf

PARAMETER temperature 0.5

Derived from the GGUF models at: https://huggingface.co/TheBloke/em_german_leo_mistral-GGUF

Original model from: https://github.com/jphme/EM_German