Granite 4.2 3B Heretic GGUF

Richard Young maintains GGUF quantizations of a community Heretic modification of IBM’s Granite 4.2 3B model. The repository was created on September 28, 2026. Its October 15 expansion adds IQ3_M and IQ4_XS downloads, an importance matrix, and refreshed Q4_K_M and Q5_K_M files.

The English card provides Ollama, llama.cpp and llama-cpp-python usage recipes and declares Apache-2.0 licensing. The author’s refusal test describes a tradeoff between fewer refusals and changes to normal behavior; it does not establish that every original capability survives the modification.