7 builds of 270m~muxodious-abominable-heresy measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it.
proved by at least one build: Structured output · Writes code
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:IQ4_XS | mradermacher | IQ4_XS | ollama | — | — | 38.6 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:Q3_K_S | mradermacher | Q3_K_S | ollama | — | — | 37.4 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:Q2_K | mradermacher | Q2_K | ollama | — | — | 35.1 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:Q4_K_M | mradermacher | Q4_K_M | ollama | — | — | 33.9 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:Q4_K_S | mradermacher | Q4_K_S | ollama | — | — | 33.7 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:Q8_0 | mradermacher | Q8_0 | ollama | — | — | 32.2 | 1 |
| hf.co/mradermacher/functiongemma-270m-it-abominable-heresy-GGUF:F16 | mradermacher | F16 | ollama | — | — | 22.7 | 1 |