everythinglm:13b-16k-q3_K

everythinglm:13b-16k-q3_K_L

588.9K Downloads Updated 2 years ago

Uncensored Llama2 based model with support for a 16K context window.

13b

ollama run everythinglm:13b-16k-q3_K_L

curl http://localhost:11434/api/chat \
  -d '{
    "model": "everythinglm:13b-16k-q3_K_L",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='everythinglm:13b-16k-q3_K_L',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'everythinglm:13b-16k-q3_K_L',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

7fb74f20a0e4 · 6.9GB

model

archllama

parameters13B

quantizationQ3_K_L

6.9GB

template

{{ .System }} User: {{ .Prompt }} Assistant:

45B

license

LLAMA 2 COMMUNITY LICENSE AGREEMENT Llama 2 Version Release Date: July 18, 2023 "Agreement" means th

7.0kB

system

You are a helpful AI assistant.

31B

params

{ "stop": [ "User:", "Assistant:" ] }

32B

Readme

The Everything Language Model is a Llama 2-based model with a 16k context released by Totally Not An LLM (Kai Howard). It was trained with the EverythingLM Dataset and is uncensored.

CLI


Once loaded, change the context size to `16K`

/set parameter num_ctx 16384


### API

Example:

  ```bash
curl -X POST http://localhost:11434/api/generate -d '{
  "model": "everythinglm",
  "prompt": "Why is the sky blue?"
  "options": {
    "num_ctx": 16384
  }
 }'

Reference

13b parameters original source: Totally Not An LLM