Skip to content

Remove unnecessary graph rewrites for both cuda and whole ET pipeline - #21799

Open
Gasoonjia wants to merge 2 commits into
low-host-mem-cuda-export-fixfrom
rm-unnecessary-op-replacement
Open

Remove unnecessary graph rewrites for both cuda and whole ET pipeline#21799
Gasoonjia wants to merge 2 commits into
low-host-mem-cuda-export-fixfrom
rm-unnecessary-op-replacement

Conversation

@Gasoonjia

Copy link
Copy Markdown
Contributor

CUDA / AOTI backend path

  • Skip run_decompositions() during AOTI preprocessing when none of the backend decomposition table’s operators occur in the graph.
  • Remove the obsolete CUDA int64 floor-div rewrite pass, since AOTInductor now handles the original operation directly.

Overall ExecuTorch export pipeline

  • Only do operator decomposition when the operator exists in original edge graph.

Performance

MG 30B cold export time improved from 26:06 to 21:16.45, an 18.5% reduction.

@pytorch-bot

pytorch-bot Bot commented Aug 13, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21799

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit a81d8cc with merge base e60faa2 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant