openaustralia / jacaranda-righttoknow

a watchful tree and slack messenger to keep you informed of the use of Right To Know
0 stars 0 forks source link

Incorrect number of new requests #5

Open henare opened 7 years ago

henare commented 7 years ago

Jacaranda just said...

1088 new requests were made through Right To Know last fortnight

...which I don't think is quite correct :smile:

equivalentideas commented 7 years ago

This still happens when our hack fails because the number of pages of requests during the period is more than 10.

https://github.com/openaustralia/jacaranda-righttoknow/blob/master/scraper.rb#L28-L34

Quick fix is increasing the number of pages it looks through to 20 or something.