Statistically lossless quantisation Collection MLX quants done using a port of IST-DASLab SLQ. The mechanism used is Heuristics based greedy allocation. Not the one paper suggests • 10 items • Updated 7 days ago
Distillation-Aware Weight Quantization Collection Distillation-Aware Weight Quant of models. The RTN is further trained using data generated from BF16 model or 8bit RTN quant if BF16 is not feasible. • 6 items • Updated 7 days ago
Statistically lossless quantisation Collection MLX quants done using a port of IST-DASLab SLQ. The mechanism used is Heuristics based greedy allocation. Not the one paper suggests • 10 items • Updated 7 days ago