Uynaity
/

gemma-3-12b-it-qat-GGUF

Model card Files Files and versions

gemma-3-12b-it-qat-GGUF

130 GB

1 contributor

History: 3 commits

Uynaity's picture

Create README.md

2d5ed70 verified 10 months ago

.gitattributes
2.97 kB

Upload folder using huggingface_hub 10 months ago
README.md
79 Bytes

Create README.md 10 months ago
gemma-3-12B-it-qat-IQ2_M.gguf
4.31 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ2_S.gguf
4.02 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ2_XS.gguf
3.84 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ2_XXS.gguf
3.53 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ3_M.gguf
5.66 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ3_S.gguf
5.46 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ3_XS.gguf
5.21 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ3_XXS.gguf
4.78 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ4_NL.gguf
6.89 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-IQ4_XS.gguf
6.55 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q2_K.gguf
4.77 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q2_K_S.gguf
4.45 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q3_K_L.gguf
6.48 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q3_K_M.gguf
6.01 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q3_K_S.gguf
5.46 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q4_K_M.gguf
7.3 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q4_K_S.gguf
6.94 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q5_K_M.gguf
8.45 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q5_K_S.gguf
8.23 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q6_K.gguf
9.66 GB
xet

Upload folder using huggingface_hub 10 months ago
gemma-3-12B-it-qat-Q8_0.gguf
12.5 GB
xet

Upload folder using huggingface_hub 10 months ago
imatrix.dat
7.43 MB
xet

Upload folder using huggingface_hub 10 months ago