mannix/gemma4-31b-he1

mannix/ gemma4-31b-he1

6 Downloads Updated 2 days ago

Pruned/masked heads version of gemma4-31b

tools thinking

ollama run mannix/gemma4-31b-he1:IQ3_M

curl http://localhost:11434/api/chat \
  -d '{
    "model": "mannix/gemma4-31b-he1:IQ3_M",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mannix/gemma4-31b-he1:IQ3_M',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mannix/gemma4-31b-he1:IQ3_M',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code ollama launch claude --model mannix/gemma4-31b-he1:IQ3_M

OpenClaw ollama launch openclaw --model mannix/gemma4-31b-he1:IQ3_M

Hermes Agent ollama launch hermes --model mannix/gemma4-31b-he1:IQ3_M

Codex ollama launch codex --model mannix/gemma4-31b-he1:IQ3_M

OpenCode ollama launch opencode --model mannix/gemma4-31b-he1:IQ3_M

Models

View all →

Name

23 models

Size / Usage

Context

Input

gemma4-31b-he1:IQ3_M

14GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ3_M

14GB

256K

Text

gemma4-31b-he1:Q2_K_L

12GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q2_K_L

12GB

256K

Text

gemma4-31b-he1:Q3_K_XL

16GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q3_K_XL

16GB

256K

Text

gemma4-31b-he1:Q4_K_L

19GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q4_K_L

19GB

256K

Text

gemma4-31b-he1:Q5_K_L

22GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q5_K_L

22GB

256K

Text

gemma4-31b-he1:Q6_K_L

26GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q6_K_L

26GB

256K

Text

gemma4-31b-he1:Q3_K_S

14GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q3_K_S

14GB

256K

Text

gemma4-31b-he1:Q4_0

18GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q4_0

18GB

256K

Text

gemma4-31b-he1:Q4_1

19GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q4_1

19GB

256K

Text

gemma4-31b-he1:Q4_K_S

18GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q4_K_S

18GB

256K

Text

gemma4-31b-he1:Q4_K_M

19GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q4_K_M

19GB

256K

Text

gemma4-31b-he1:Q5_K_S

21GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q5_K_S

21GB

256K

Text

gemma4-31b-he1:Q5_K_M

22GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q5_K_M

22GB

256K

Text

gemma4-31b-he1:Q6_K

25GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q6_K

25GB

256K

Text

gemma4-31b-he1:Q8_0

33GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:Q8_0

33GB

256K

Text

gemma4-31b-he1:IQ2_XXS

8.7GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ2_XXS

8.7GB

256K

Text

gemma4-31b-he1:IQ2_XS

9.5GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ2_XS

9.5GB

256K

Text

gemma4-31b-he1:IQ2_S

10GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ2_S

10GB

256K

Text

gemma4-31b-he1:IQ2_M

11GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ2_M

11GB

256K

Text

gemma4-31b-he1:IQ3_XXS

12GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ3_XXS

12GB

256K

Text

gemma4-31b-he1:IQ3_XS

13GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ3_XS

13GB

256K

Text

gemma4-31b-he1:IQ4_XS

17GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ4_XS

17GB

256K

Text

gemma4-31b-he1:IQ4_NL

18GB · 256K context window · Text · 2 days ago

gemma4-31b-he1:IQ4_NL

18GB

256K

Text

Readme

Model on HF:

https://huggingface.co/ManniX-ITA/gemma-4-31b-he1-it

Full GGUF:

https://huggingface.co/ManniX-ITA/gemma-4-31b-he1-it-GGUF