A new ternary weight quantization framework, RoleQ, places scales by Transformer unit roles rather than weight matrix layout, matching per-layer axis search at lower solver cost and cutting perplexity by up to…

#RoleQ #Quantization #ModelCompression #AIResearch
https://arxiv.org/abs/2610.21808