4 builds of functiongemma-270m-it-unsloth-bnb-4bit-ft-QAT-GGUF measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it.
proved by at least one build: Structured output · Writes code · Reasons about code
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/mingxilei/functiongemma-270m-it-unsloth-bnb-4bit-ft-QAT-GGUF:Q4_K_M | mingxilei | Q4_K_M | ollama | derivative | — | 39.3 | 1 |
| hf.co/mingxilei/functiongemma-270m-it-unsloth-bnb-4bit-ft-QAT-GGUF:Q5_K_M | mingxilei | Q5_K_M | ollama | derivative | — | 33.0 | 1 |
| hf.co/mingxilei/functiongemma-270m-it-unsloth-bnb-4bit-ft-QAT-GGUF:Q8_0 | mingxilei | Q8_0 | ollama | derivative | — | 31.5 | 1 |
| hf.co/mingxilei/functiongemma-270m-it-unsloth-bnb-4bit-ft-QAT-GGUF:F16 | mingxilei | F16 | ollama | derivative | — | 23.3 | 1 |