Skip to content

[OPSD] Request last-position logits only in HybridEngine rollout prefill - #8839

Open
jinyouzhi wants to merge 2 commits into
deepspeedai:masterfrom
jinyouzhi:rollout-prefill-last-logits
Open

jinyouzhi wants to merge 2 commits into
deepspeedai:masterfrom
jinyouzhi:rollout-prefill-last-logits