mannix/dolphin-mixtral

mannix/ dolphin-mixtral:latest

781 Downloads Updated 2 years ago

Uncensored, 8x7b and 8x22b fine-tuned models based on the Mixtral mixture of experts models that excels at coding tasks. Created by Eric Hartford.

ollama run mannix/dolphin-mixtral

curl http://localhost:11434/api/chat \
  -d '{
    "model": "mannix/dolphin-mixtral",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mannix/dolphin-mixtral',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mannix/dolphin-mixtral',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

5d98c4ee9f13 · 42GB ·

model

archllama

parameters141B

quantizationIQ2_XS

42GB

system

You are Dolphin, a helpful AI assistant.

41B

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

params

{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

59B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

The Dolphin model by Eric Hartford based on Mixtral that is trained with additional datasets:

Synthia, OpenHermes and PureDove
New Dolphin-Coder
MagiCoder

Sizes

dolphin-mixtral:8x22b
dolphin-mixtral:8x7b

References

HuggingFace