nemotron-mini

A commercial-friendly small language model by NVIDIA optimized for roleplay, RAG QA, and function calling.

Tools

1,030 Pulls Updated 5 hours ago

17 Tags
latest
ed76ab18784f • 2.7GB • Updated yesterday
4b
latest
ed76ab18784f • 2.7GB • Updated yesterday
4b-instruct-fp16
d0d806e9853c • 8.4GB • Updated yesterday
4b-instruct-q2_K
71c1aed58cc4 • 1.9GB • Updated yesterday
4b-instruct-q3_K_S
28cabdeeb76e • 2.1GB • Updated yesterday
4b-instruct-q3_K_M
91b07164ba46 • 2.3GB • Updated yesterday
4b-instruct-q3_K_L
899020cd5b1e • 2.5GB • Updated yesterday
4b-instruct-q4_0
041bd339f71f • 2.6GB • Updated yesterday
4b-instruct-q4_1
715f0114b145 • 2.8GB • Updated yesterday
4b-instruct-q4_K_S
59f3d2ea76f8 • 2.6GB • Updated yesterday
4b-instruct-q4_K_M
ed76ab18784f • 2.7GB • Updated yesterday
4b-instruct-q5_0
e5f64c7116d1 • 3.0GB • Updated yesterday
4b-instruct-q5_1
8c244be13dfe • 3.2GB • Updated yesterday
4b-instruct-q5_K_S
072f4b7daa17 • 3.0GB • Updated yesterday
4b-instruct-q5_K_M
9e36e563dbdd • 3.1GB • Updated yesterday
4b-instruct-q6_K
4cf36901911e • 3.4GB • Updated yesterday
4b-instruct-q8_0
fe86a4d04f9f • 4.5GB • Updated yesterday