search

sjdirect / abotx

Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
https://abotx.org
131 stars 23 forks source link

If paid feature is enabled, Abotx doesn't do anything and no warning or exception is present #23

Closed ghost closed 4 years ago

ghost commented 4 years ago

I copied some code from here and Abotx didn't work. I tried a few things and found out that if I turned off autotuning, it works. There's no warning or exception to tell me that autotuning is a paid feature and I had to find out the hard way.

I suggest making paid features need a license through an exception message so it's very clear from the start.

sjdirect commented 4 years ago

Hi,

This should already be the case with the ParallelCrawlerEngine. It should throw an UnauthorizedException if you use a feature that is beyond the scope of your license.

The individual CrawlerX instance makes this available also...

var crawlResult = await crawler.CrawlAsync(new Uri("http://!YOURSITEHERE!.com")); if(crawlResult.ErrorOccurred)... if(crawlResult.ErrorException != null)...

The exception messages should be crystal clear on those exceptions.