What's the verdict for real world use on Q3 120B (fits in 64GB) vs Q4 of a small... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Archit3ch 34 days ago \| parent \| context \| favorite \| on: Unsloth Dynamic 2.0 GGUFs What's the verdict for real world use on Q3 120B (fits in 64GB) vs Q4 of a smaller model?

FuckButtons 33 days ago [–]

Bigger model wins as long as the quantization was done properly.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact