gurubot/mellow-mate:3b-q8

gurubot/

mellow-mate:3b-q8_0

112 Downloads Updated 10 months ago

An instant message style chat with a friend

Updated 10 months ago

10 months ago

040366e5bcf8 · 3.4GB ·

model

archllama

parameters3.21B

quantizationQ8_0

3.4GB

system

You are a real person having a friendly chat via instant messenger with the user

80B

params

{ "min_p": 0.1, "stop": [ "<|eom_id|>", "<|end_header_id|>", "<|fine

275B

template

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

254B

Readme

Designed to mimic a friendly instant message chat with a friend who chats with you about what you are up to, and asks follow up questions to keep the conversation going. It writes informally and usually in single sentences rather than paragraphs about being a helpful assistant.

Finetuned from llama 3.1 8b and llama 3.2 3b versions. 8b available on hf https://huggingface.co/Gurubot/mellow-mate-8b