Open klanomath opened 3 years ago
Yes I agree with you completely. The matching algorithm is worthless.
The approach is interesting but it turns out that it doesn't make any sense to draw conclusions from it other than that it's easy to find a ton of arbitrary matches. But most of their twitter followers will take this paper and spread the message that PCR tests are worthless. It's very frustrating to see that happening.
The sql-script you are referring to (Bayes Lines Tool (BLT) - A SQL-script for analyzing diagnostic test results with an application to SARS-CoV-2-testing) has major flaws in the matching algorithm:
Here is the reason why:
In a test campaign Tᵢ with nᵢ tests and mᵢ positive tests, the real prevalenceᵢ/sensitivityᵢ/specificityᵢ of Tᵢ is some product of k and 1/nᵢ (with 0 ≤ k ≤ n and k,n: non-negative integers) and is specific for this campaign (daily/mass testing result etc.) because every person (of all tested persons) is either true positiv or not (or false positive/false negativ or not).
If you choose a much larger (or "odd") step size in the algorithm like the 0,001-steps for the prevalence in the sql-script (sensitivity 0,005/specificity 0,005 respectively) compared to the step size 1/nᵢ of the test scenario (e.g. 1/28,757), you will miss a lot of valid matches because of rounding limitations or odd matching conditions ("the 99.99%" mentioned in the PDF).
Test 1:
Test 2 with the dutch numbers (28,757 tests with 3,829 positive results)
With a very small subset (201x11x11=24,231) – the number of permutations mentioned in the pdf is 17,945,000! – I get 27 valid matches alone compared to "23 possible solutions" in the original work.
Modified SQL code:
If I understand your Python code correctly, you made a similar error. IIRC your numbers aren't as odd as the original numbers because you used a wider error margin.
Dieser Matching-Algorithmus und die jämmerliche Interpretation der Daten, die er produziert, ist eine Schande für jeden Mathematiker oder Halb-Mathematiker, der an dem Papier beteiligt ist/war!