Closed mtrojan-ub closed 6 years ago
@dstillman is it at all possible that the old translator-server maintains a global session with related cookies?
@adomasven: Yes, I imagine the old server persisted cookies for sites at least as long as it was running. (The Docker version would've lost those cookies on next startup, while a non-Docker install would preserve them forever.)
I think not preserving cookies beyond a single save will generally lead to better results, since it will avoid paywalls that trigger after repeated visits. Google sites will probably be more inclined to block, but I suspect they're the exception.
How do you think that's contributing to this issue?
Downloading the same URL 10 times in a row results in about 2 correct and 8 empty results
2 times
8 times
Even if you use different urls, we noticed that occasionaly some results are empty and some are not, but i think the same url is a good test case. Sequence is not always the same, sometimes e.g. only attempt 3 and 7 are correct, sometimes only attempt 5, ...
/edit: This might be URL specific, using e.g. https://www.nytimes.com/2018/06/11/technology/net-neutrality-repeal.html instead leads to 10 of 10 successful results