Closed sudocanttype closed 3 years ago
main?
Yep, and lemme get you the testoutput. It seems to be a very rare error, but still a bug. I kinda just ignored it, but it failed 2 times in a row for my while running the quality test
Did the class scrapping changed after fixing the ºC and ºF bug?
I am not sure, I thought they just improved the regex/filtering
Can you comment the lines of the new scrapping lines for weather, 205-211 and uncomment 204, and try it again? Even though it will show ºC and ºF swapped.
Yep, still failed.
Then it's a problem with Google UI returning you those results, get the query that normally fails and instead of passing the results to tuxi to scrap, debug it to a file. Can you do it?
Actually, don't comment line 156, just add in the next one curl -Gs --compressed "$google_url" --user-agent "$user_agent" --data-urlencode "q=$query" > output.html
When it gives you an error, share the output.html
file.
Strange. It looks like it just doesnt load some times for me. output.txt (HTML is not supported by github apparently)
soooo this can be either curl
failing rarely to get Google's html data, or Google giving you just this result because they're trolling you, I don't think there's a solution for that since the html file that you gave doesn't give any information at all
can be just javascript trying to load the information in (question of milliseconds) and curl already exporting the data, well
Yep, it's not a problem until someone else reports it. I'm going to assume its just a me thing and close this.
Steps to Reproduce the Problem
The test script fails on random while testing weather, and when I was testing it.
Expected Behavior
It to return the weather
Actual Behavior
Look at the picture
Log
No Log