MichelRosselli/ ternary-bonsai

2,283 3 months ago

Ternary Bonsai: 1.58-bit Language Models at 8B, 4B, and 1.7B Scale.

tools thinking

4 models

ternary-bonsai:latest
812e80f7cf27 • 16GB • 64K context window •
Text input • 3 months ago
ternary-bonsai:1.7b-f16
51c303aed2fc • 3.4GB • 32K context window •
Text input • 3 months ago
ternary-bonsai:4b-f16
00af4e4f4926 • 8.0GB • 32K context window •
Text input • 3 months ago
ternary-bonsai:8b-f16
812e80f7cf27 • 16GB • 64K context window •
Text input • 3 months ago