internetstandards / Internet.nl

Internet standards compliance test suite
https://internet.nl
171 stars 35 forks source link

Prechecks not in batch #1303

Open baknu opened 5 months ago

baknu commented 5 months ago

Prechecks are not enabled in batch modus. This can lead to result differences between single test and batch test. We should make this clear in the documentation (see also #1201) and maybe also try to add these prechecks again for batch.

GT in a mail on 21th June 2019:

For the current batch release I tried to enable the DNS prechecks we also have in the internet.nl UI. They were not implemented in the batch environment because they introduced latency in the initial design. I tried to enable them with this release but the overhead is still not acceptable for long lists of domains as Dennis found out when he was trying to test > 10K domains.

This means that the behavior stays the same as with previous batch behavior for now.

bwbroersma commented 5 months ago

Related, bypassing precheck in single test: