> Q4_K_M has ~0 quality degradation Llama 3.3 already shows a degradation from Q...

		acchow on April 6, 2025 \| parent \| context \| favorite \| on: The Llama 4 herd > Q4_K_M has ~0 quality degradation Llama 3.3 already shows a degradation from Q5 to Q4. As compression improves over the years, the effects of even Q5 quantization will begin to appear