Skip to content

BulkImageScrape: add configurable delay between image scrapes - #817

Open
officialasishkumar wants to merge 1 commit into
stashapp:mainfrom
officialasishkumar:BulkImageScrape-scrape-delay
Open

officialasishkumar wants to merge 1 commit into
stashapp:mainfrom
officialasishkumar:BulkImageScrape-scrape-delay

Conversation

@officialasishkumar

Copy link
Copy Markdown

Adds a ScrapeDelaySeconds setting to Bulk Image Scrape so users can slow down scraping for rate-limited sites (see #736).

  • Previously the plugin always slept a hardcoded 0.5s before each image.
  • New NUMBER setting; unset keeps the 0.5s default, 0 disables the delay, negative values are clamped to 0, and non-numeric/NaN/inf values fall back to the default with a warning.
  • README documents the option; plugin version bumped to 0.3.7.

Validation: node validator/index.js --ci passes, the script compiles, and the parsing helper was exercised against None/empty/int/float/string/negative/NaN/inf/bool/list inputs.

Closes #736

The plugin always slept a hardcoded 0.5 seconds before scraping each
image, which is not enough for scrapers hitting rate-limited websites
and cannot be changed without editing the plugin on disk.

Add a ScrapeDelaySeconds NUMBER setting. When unset the previous 0.5
second delay is kept, 0 disables the delay, negative values are clamped
to 0 and non-numeric/non-finite values fall back to the default with a
warning. Document the setting in the README and bump the plugin version.

Closes stashapp#736

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bulk Image Scraper] Option to add a delay between scrapes.

1 participant