Currently pages, including redirects are marked as scanned before they are actually scanned. If the page redirects from a link without trailing / to a link with / (e.g. www.pronobis.pro/publications/zheng2018aaai redirects to www.pronobis.pro/publications/zheng2018aaai/), then the page will never be scanned (the scanner considers both links to refer to the same page, and the one without / is already added as scanned).
This simple change fixes it for me, although, I'm not sure if there won't be any unintended consequences.
Currently pages, including redirects are marked as scanned before they are actually scanned. If the page redirects from a link without trailing / to a link with / (e.g. www.pronobis.pro/publications/zheng2018aaai redirects to www.pronobis.pro/publications/zheng2018aaai/), then the page will never be scanned (the scanner considers both links to refer to the same page, and the one without / is already added as scanned).
This simple change fixes it for me, although, I'm not sure if there won't be any unintended consequences.