70b_i1_q4_k_m
43GB
This model was created with the goal for a good llama 3 uncencored model with long context. At it worked like a charm.
70B
1,645 Pulls Updated 3 months ago
Updated 3 months ago
3 months ago
31544fcfad66 · 58GB
model
archllama
·
parameters70.6B
·
quantizationQ6_K
58GB
template
{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>
254B
params
{"num_keep":24,"stop":["<|start_header_id|>","<|end_header_id|>","<|eot_id|>"]}
110B
Readme
8B and 70B uncensored available NOW!!!
Llama 3 uncensored 8B
Llama 3 uncensored 70B is READY!
import from https://hf-mirror.com/mradermacher/Llama-3-70b-Uncensored-Lumi-Tess-gradient-GGUF
import i1_q4_k_m from:
https://hf-mirror.com/mradermacher/Llama-3-70b-Uncensored-Lumi-Tess-gradient-i1-GGUF
This model was created with the goal for a good llama 3 uncencored model with long context. At it worked like a charm.