C# web scraping library that crawls websites with CSS selectors, request throttling, multi-threaded workers, identity rotation, and response caching. Runnable .NET examples for extracting structured data from blogs, shopping sites, and movie databases, following pagination, and honouring robots.txt. .NET Standard 2.0+.
crawler scraper csharp dotnet web-crawler web-scraping dotnet-core data-extraction html-parsing css-selectors screen-scraping iron-software ironwebscraper
-
Updated
Aug 29, 2026 - C#