2025-07-04

Accurate KV Cache Quantization with Outlier Tokens Tracing

2025-07-04

QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache

2025-07-04

KV cache 量化工作总结

2025-07-04

NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

2025-07-01

CPU 的 INT8 × INT8 → INT32 计算

2025-07-01

INT-FlashAttention: Enabling Flash Attention for INT8 Quantization

2025-07-01

DUAL GRAINED QUANTIZATION: EFFICIENT FINEGRAINED QUANTIZATION FOR LLM

2025-07-01

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

2025-07-01

KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization

2025-06-30

Cocktail: Chunk-Adaptive Mixed-Precision Quantization for Long-Context LLM Inference