AwarioBot Addition

[robwent]

This is a duplicate of #560 which I added as removal instead of addition by mistake.

Paste the full User-Agent String here

Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)

Is this for Addition / Removal?

• [x] Addition
• [ ] Removal
• [ ] Keep a watch on this one

Did the User-Agent request robots.txt first?

• [ ] Yes
• [x] No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

46.4.108.51 - - [28/Mar/2024:06:11:19 +0000] "GET /yachts-for-sale-by-model/lagoon-450-s/ HTTP/2.0" 200 31238 "-" "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)"
46.4.108.51 - - [28/Mar/2024:06:11:23 +0000] "GET /yachts-for-sale/pilot-lounge-name-reserved-2/ HTTP/2.0" 200 38904 "-" "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)"
46.4.108.51 - - [28/Mar/2024:06:11:31 +0000] "GET /yachts-for-sale/riva-ariston/ HTTP/2.0" 200 30524 "-" "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)"
46.4.108.51 - - [28/Mar/2024:06:11:35 +0000] "GET /yachts-for-sale-by-model/lagoon-450/ HTTP/2.0" 200 31121 "-" "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)"
46.4.108.51 - - [28/Mar/2024:06:11:38 +0000] "GET /yachts-for-sale/gatsby/ HTTP/2.0" 200 32968 "-" "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)"

Additional information

A brand monitoring company scanning billions of pages a day: https://awario.com/

[mitchellkrogza]

Thanks @robwent has been added