A new quantization method called Fractional Power-of-Two uses a base-√2 weight grid to enable 4-bit LLM weights while keeping a fully integer shift-add datapath, avoiding the accuracy loss common in…
#LLM #Quantization #EfficientAI #PostTrainingQuantization
https://arxiv.org/abs/2610.21257
