Skip to content

build(deps): update scrapy requirement from >=2.13.5 to >=2.19.0 - #3589

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/scrapy-gte-2.19.0
Closed

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/scrapy-gte-2.19.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 19, 2026 •

Copy link
Copy Markdown
Contributor

Updates the requirements on scrapy to permit the latest version.

Release notes

Sourced from scrapy's releases.

2.19.0

  • New RemoteControl extension which allows inspecting and controlling a running crawl over HTTP, used by the Scrapy MCP server
  • Experimental aiohttp-based download handler (now the default when running without a reactor)

Full Changelog

Changelog

Sourced from scrapy's changelog.

Scrapy 2.19.0 (2026-09-10)

Highlights:

  • New RemoteControl extension which allows inspecting and controlling a running crawl over HTTP, used by the :ref:Scrapy MCP server <using-mcp-server>

  • Experimental aiohttp-based download handler (now the default when running without a reactor)

Modified requirements


-   Added support for Python 3.15.
    (:gh:`7511`)
  • New dependencies:

    • aiohttp_ >= 3.13.3

    • charset-normalizer_ >= 3.4.0

    • platformdirs_ >= 2.0.0

    (:gh:7866, :gh:8054)

Backward-incompatible changes

  • When running :ref:without a Twisted reactor <asyncio-without-reactor>, i.e. with :setting:TWISTED_REACTOR_ENABLED set to False, the default download handler for http and https is now :class:~scrapy.core.downloader.handlers._aiohttp.AiohttpDownloadHandler instead of :class:~scrapy.core.downloader.handlers._httpx.HttpxDownloadHandler. You can configure :class:~scrapy.core.downloader.handlers._httpx.HttpxDownloadHandler in the :setting:DOWNLOAD_HANDLERS setting if you want. (:gh:8118)

  • scrapy.http.cookies.WrappedRequest.is_unverifiable() now always returns False, and the undocumented is_unverifiable request meta key that it used to read is ignored. (:gh:7933)

Deprecations


</tr></table> 

... (truncated)

Commits
  • 8026dee Bump version: 2.18.0 → 2.19.0
  • b1f1cba Release notes for 2.19.0 (#8124)
  • a410975 Fix LocalCache evicting a different key when updating an existing key (#8113)
  • 41c3f3e Add AiohttpDownloadHandler and switch reactorless to it (#8118)
  • 20dcf82 Implement some idioms from newer Python versions. (#8123)
  • 3fd2a40 Agents docs page. (#8120)
  • 6995549 Exclude news and contributing from llms-full.txt only (#8119)
  • 6057f02 Expose HTTP cache storage timestamp via the cache_timestamp meta key (#8034)
  • 1d5fa5a Include bind address in HTTP/1.1 and HTTP/2 pool keys (#8081)
  • 544f4d2 Fix missing certificate and IP address on HTTP/1.1 responses without a body (...
  • Additional commits viewable in compare view

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Sep 19, 2026
@github-actions github-actions Bot added the repo label Sep 19, 2026
Updates the requirements on [scrapy](https://github.com/scrapy/scrapy) to permit the latest version.
- [Release notes](https://github.com/scrapy/scrapy/releases)
- [Changelog](https://github.com/scrapy/scrapy/blob/master/docs/news.rst)
- [Commits](scrapy/scrapy@2.14.0...2.19.0)

---
updated-dependencies:
- dependency-name: scrapy
  dependency-version: 2.19.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/pip/scrapy-gte-2.19.0 branch from ad821d6 to 061a9f8 Compare September 19, 2026 07:10
@dependabot @github

dependabot Bot commented on behalf of github Sep 19, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by #3592.

@dependabot dependabot Bot closed this Sep 19, 2026
@dependabot
dependabot Bot deleted the dependabot/pip/scrapy-gte-2.19.0 branch September 19, 2026 07:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update Python code repo size/XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants