TokenPost·

MACaQ Quantizes a 122-Billion-Parameter Model in 64 Minutes

Your call?

The post-training method uses four-bit weights and activations and matched the best Llama-3-8B perplexity result with one-eleventh the quantization time.

Share

More news