aminadaven / dictalm2.0-instruct

The DictaLM-2.0-Instruct Large Language Model (LLM) is an instruct fine-tuned version of the DictaLM-2.0 generative model using a variety of conversation datasets. For full details of this model please read this post: https://dicta.org.il/dicta-lm

7B

282 Pulls Updated 4 months ago

4 months ago

7ad156d1eab5 · 15GB

model
llama
·
7.25B
·
F16
params
{"stop":["[INST]","[/INST]"]}
template
[INST] {{ .System }} {{ .Prompt }} [/INST]

Readme

Model Card for DictaLM-2.0-Instruct

The DictaLM-2.0-Instruct Large Language Model (LLM) is an instruct fine-tuned version of the DictaLM-2.0 generative model using a variety of conversation datasets.

For full details of this model please read the developer’s release blog post.

This is the instruct-tuned model designed for chat in the GGUF format. You can try the model out on a live demo here.

Currently available quantizations:

  • q2_k
  • q4_0
  • q4_k_m
  • q5_k_m
  • q6_k
  • q8_0
  • f16

You can view and access the full collection of base/instruct unquantized/quantized versions of DictaLM-2.0 here.