Skip to content

优化 MetaX 平台 HD64 GQA Paged Attention Decode 的 K/V 数据复用 - #1557

Open
Qzong2020 wants to merge 2 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
Qzong2020:metax-paged-attention-hd64-gqa
Open

优化 MetaX 平台 HD64 GQA Paged Attention Decode 的 K/V 数据复用#1557
Qzong2020 wants to merge 2 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
Qzong2020:metax-paged-attention-hd64-gqa

chore: trigger CI

a60fa3f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs