Skip to content

audit: screenshots are viewport-cropped — vision pass can't audit below the fold on tall pages (fullPage capture) #14

Description

@rz1989s

What

The audit engine's screenshots are viewport-cropped, not full-page. On any page taller than one viewport (which is most real pages — the audited architecture diagram is ~8–10 viewports tall), the vision pass only ever sees the hero + first few hundred px. Every "below the fold" element — nav bars placed under a hero, the actual flow cards, gates, tables — is unauditable by Tier 4, and the vision model wastes its reply on "I can only see the cropped region, resend full screenshots."

Observed on a 5-tab architecture diagram: screenshot-1280.png shows only the hero + one card; the FLOW pipelines, gates, tab bar at mobile, and the skills table never appear in any capture.

Suggestion

  • capture with Playwright fullPage: true (or add --fullpage flag; maybe both: a viewport shot AND a fullPage shot per width)
  • for very tall pages, consider tiled captures (fullPage capped at N viewports) or scrolled offsets
  • the vision-pass instructions in references/verbs/audit.md should state which capture mode is used — currently the model is asked to audit elements the screenshot cannot contain

Environment

keystone @getpipher/keystone, engine/audit.mjs path mode, 2026-08-30 run, page ~8 viewports tall.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions