search

dotnetcore / DotnetSpider

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
MIT License
3.98k stars 1.04k forks source link

添加SpiderOptions属性OneRequestDoneFirst，支持优先处理 request -> sub request ->… #242

Closed capadong closed 1 year ago

capadong commented 1 year ago

解决批量请求时，并且每个请求中有多个子请求，所有IDataFlow会被放置到最后处理的情况。 优先处理单个请求的流程 request -> sub request -> sub request -> .... -> IDataFlow