[Error] Cloudflare wall for konachan

[KAGEYAM4]

Bug description

[21:31:20.619][Info] Loading results...
[21:31:20.621][Info] [konachan.com][Html] Loading page http://konachan.com/post/index?limit=20&page=1&tags=
[21:31:20.622][Info] [konachan.com][Xml] Loading page http://konachan.com/post/index.xml?limit=20&page=1&tags=
[21:31:21.667][Info] [konachan.com][Html] Receiving page http://konachan.com/post/index?limit=20&page=1&tags=
[21:31:21.668][Error] [konachan.com][Html] Cloudflare wall for 'http://konachan.com/post/index?limit=20&page=1&tags='
[21:31:22.059][Info] [konachan.com][Xml] Receiving page http://konachan.com/post/index.xml?limit=20&page=1&tags=
[21:31:22.061][Error] [konachan.com][Xml] Cloudflare wall for 'http://konachan.com/post/index.xml?limit=20&page=1&tags='
[21:31:22.062][Warning] [konachan.com] Loading using Xml failed. Retry using Json.
[21:31:22.062][Info] [konachan.com][Json] Loading page http://konachan.com/post/index.json?limit=20&page=1&tags=
[21:31:22.511][Info] [konachan.com][Json] Receiving page http://konachan.com/post/index.json?limit=20&page=1&tags=
[21:31:22.512][Error] [konachan.com][Json] Cloudflare wall for 'http://konachan.com/post/index.json?limit=20&page=1&tags='
[21:31:22.513][Warning] [konachan.com] Loading using Json failed. Retry using Html.
[21:31:22.514][Info] [konachan.com][Html] Loading page http://konachan.com/post/index?limit=20&page=1&tags=
[21:31:23.026][Info] [konachan.com][Html] Receiving page http://konachan.com/post/index?limit=20&page=1&tags=
[21:31:23.027][Error] [konachan.com][Html] Cloudflare wall for 'http://konachan.com/post/index?limit=20&page=1&tags='
[21:31:23.029][Warning] [konachan.com] No valid source of the site returned result.

Steps to reproduce

1. Enable konachan source
2. search empty string
3. See error konachan.com - No result Possible reasons: server offline

Context

main_2024.05.14-21.50.00.380.log

• using stock settings.ini file.

System information

• OS: Arch Linux x86_64
• Grabber version: 7.12.1

Additional context

• i tried cloudflare dns.
• i copied my mozilla firefox useragen into Header section of konachan source
• i tried cloudflare-warp

Add any other context about the bug report here.

• Just a question, konachan provides api, so why is cloudflare causing problem?

[KAGEYAM4]

gallery-dl was also showing this error ->

[konachan][warning] Cloudflare challenge
[konachan][error] HttpError: '403 Forbidden' for 'https://konachan.com/post.json'

But after passing it cookies.txt and --user-agent it worked.

But imgbrd-grabber is still not working. One thing could be that i am passing values in different case ->

[AndreiAdii]

Setting the cookies and the user agent worked only if I set in the "Images per page" to 999 or lower. If I leave it at 1000 as defeault I get the cloudflare block

[kdsps]

same issue here, setting user agent didnt work, nor cloudflare warp. it happens even when "Images per page" is lower than 999 (I set it to 25, still happens)

[KAGEYAM4]

@kdsps i was able to make it work. I am waiting for developer to reply so that maybe we can document it.

Here's what worked for me ->

1. use upper-case in the string Use-Agent

2. for cookies, grab the cf_clearance. Also just to be sure make a new profile in firefox and then grab the cf_clearance cookie.