Imageomics / distributed-downloader

MPI-based distributed downloading tool for retrieving data from diverse domains.
MIT License
2 stars 0 forks source link

Repeat requests [BUG] #2

Open egrace479 opened 1 month ago

egrace479 commented 1 month ago

Emailed issue received:

It looks like your bot or other automated process is making repeated requests of the Library's digital image collections for full-sized images, particularly the Herbarium Catalog Collection:

https://quod.lib.umich.edu/h/herb00ic

and the Insect Division Collection:

https://quod.lib.umich.edu/i/insect2ic

and repeating the same requests within seconds of each other:

192.148.249.250 - "" [10/May/2024:08:03:14 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 23290634

192.148.249.250 - "" [10/May/2024:08:03:19 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 23828790

192.148.249.250 - "" [10/May/2024:08:03:42 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 1136898

192.148.249.250 - "" [10/May/2024:08:03:24 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 33785300

192.148.249.250 - "" [10/May/2024:08:03:30 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 31068931

192.148.249.250 - "" [10/May/2024:08:03:36 -0400] "GET /cgi/i/image/api/image/insect2ic:UMMZI-149171:UMMZ-INS-149171/full/res:0/0/native.jpg HTTP/1.1" 200 2200760 "-" "Imageomics Institute ([https://imageomics.org](https://urldefense.com/v3/__https:/imageomics.org__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8sitkhA$); [imageomics-contact@osu.edu](mailto:imageomics-contact@osu.edu))" [quod.lib.umich.edu](https://urldefense.com/v3/__http:/quod.lib.umich.edu__;!!KGKeukY!ygZFAzX7h8PmMzVcsGWXc2s9E3OIyGTOhIREmaxlXauQ3_t_OXDoZZdGXitiPJVgS1xfhqMBlB3vpAGcHOgq8OUJ8j4$) 28916282