Skip to content

Avoid rereading CUDA weights blob for SHA-256 computation - #21800

Open
Gasoonjia wants to merge 1 commit into
rm-unnecessary-op-replacementfrom
rm-sha-mul-load
Open

Avoid rereading CUDA weights blob for SHA-256 computation#21800
Gasoonjia wants to merge 1 commit into
rm-unnecessary-op-replacementfrom
rm-sha-mul-load

Conversation

@Gasoonjia

Copy link
Copy Markdown
Contributor

Summary

  • Compute SHA-256 while streaming the CUDA AOTI external weights blob to disk, avoiding a second full read of the approximately 19 GB weights file during serialization.
  • Preserve lazy SHA-256 computation for callers that do not provide a digest.

Performance

In an independent MG 30B cold export with an empty Inductor cache, export time improved from 21:16.45 to 18:56.75, a 10.9% reduction.

@pytorch-bot

pytorch-bot Bot commented Aug 13, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21800

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 6b88a80 with merge base e60faa2 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant