TokenPost·

Ant Group and vLLM Community Open-Source Humming Kernel Library

Your call?

The library supports quantization formats for dense and mixture-of-experts models, with performance gains across many representative workloads.

Share

More news