[DEV] 支持kv cache量化 #253

Open

opened

目标版本
main

功能描述
分段式kv cache量化，
quant->update
get->dequant->compute

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests