[x] Refactored config structs into multiple files (0 code logic changes, only renamed a few fields)
[x] Fixed bug in engines unit testing, where the buggy colly timeout was being set but the hard timeout was left at default
[x] Created a new algo with better comment explanation and naming of config fields
[x] BREAKING CHANGE: removed colly timeout for both normal and pages collectors (since it's proven to be buggy)
[x] BREAKING CHANGE: removed category info (also worked with !wiki) in favor of quick (also !fast), and added more engines to it
[x] BREAKING CHANGE: renamed category surf to broad (also works with !surf)
Algo explanation:
1) Wait for PreferredTimeoutMin before checking the number of engines
2) Check if the number of results is more than or equal to the PreferredResultsNumber
3) If not, wait additional StepTime until either PreferredResultsNumber or PreferredTimeoutMax is reached
4) Check if the number of results is more than or equal to the MinimumResultsNumber
5) If not, wait additional StepTime until either MinimumResultsNumber or HardTimeout is reached
If at any time all engines respond, the results will be returned immediately. This now will hopefully return results as quickly as possible but also prefer to return slow but some results instead of not returning anything.
info(also worked with!wiki) in favor ofquick(also!fast), and added more engines to itsurftobroad(also works with!surf)Algo explanation:
1) Wait for PreferredTimeoutMin before checking the number of engines 2) Check if the number of results is more than or equal to the PreferredResultsNumber 3) If not, wait additional StepTime until either PreferredResultsNumber or PreferredTimeoutMax is reached 4) Check if the number of results is more than or equal to the MinimumResultsNumber 5) If not, wait additional StepTime until either MinimumResultsNumber or HardTimeout is reached
If at any time all engines respond, the results will be returned immediately. This now will hopefully return results as quickly as possible but also prefer to return slow but some results instead of not returning anything.
Default options for GENERAL:
Default options for IMAGES:
Default options for QUICK: