search

QuiteRSS / quiterss

Free news feeds reader
https://quiterss.org
Other
1.01k stars 123 forks source link

Olx.ua rss just stop working #1171

Closed Rockbard closed 4 years ago

Rockbard commented 5 years ago

Here is the test link https://www.olx.ua/nedvizhimost/doma/prodazha-domov/odessa/rss/?search%5Bfilter_float_price%3Ato%5D=75000&search%5Bfilter_enum_property_type_houses%5D%5B0%5D=house&search%5Bfilter_enum_property_type_houses%5D%5B1%5D=club_house&search%5Bfilter_enum_property_type_houses%5D%5B2%5D=cottage&search%5Bfilter_enum_property_type_houses%5D%5B3%5D=townhouse&search%5Bfilter_enum_property_type_houses%5D%5B4%5D=country_house&search%5Bfilter_enum_property_type_houses%5D%5B5%5D=duplex&search%5Bdistrict_id%5D=85&currency=USD

aidaho commented 5 years ago

They are now serving html bot-protection warning instead of RSS XML.

I've contacted them about it, but I don't think I've gotten my message through tech support to the dev team.

Rockbard commented 5 years ago

Would be great if this problem could be fixed

пн, 10 июн. 2019 г., 12:01 Sergey Frolov notifications@github.com:

They are now serving html bot-protection warning instead of RSS XML.

I've contacted them about it, but I don't think I've gotten my message through tech support to the dev team.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/QuiteRSS/quiterss/issues/1171?email_source=notifications&email_token=AJMUHFFZLGFNNXJP2BZNNNTPZYJ7PA5CNFSM4HRWTGFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXJKRPQ#issuecomment-500345022, or mute the thread https://github.com/notifications/unsubscribe-auth/AJMUHFBMTWJ2FRHU5KFYDPDPZYJ7PANCNFSM4HRWTGFA .

aidaho commented 5 years ago

Would be great if this problem could be fixed

One can't fix that by complaining in QuiteRSS bugtracker. You should annoy OLX tech support, just as I did.

Rockbard commented 5 years ago

Oh, got it. Thank you though

пн, 10 июн. 2019 г., 23:29 Sergey Frolov notifications@github.com:

Would be great if this problem could be fixed

One can't fix that by complaining in QuiteRSS bugtracker. You should annoy OLX tech support, just as I did.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/QuiteRSS/quiterss/issues/1171?email_source=notifications&email_token=AJMUHFFAUXME4HY3SD6NPQLPZ22RFA5CNFSM4HRWTGFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXLELSY#issuecomment-500581835, or mute the thread https://github.com/notifications/unsubscribe-auth/AJMUHFDRSOHSUWOQ7OS3MVLPZ22RFANCNFSM4HRWTGFA .

kjacewicz commented 5 years ago

I had the same problem with olx.pl. They introduced User Agent checking. QuiteRss with 'User-Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/538.1 (KHTML, like Gecko) QuiteRSS/0.18.12 Safari/538.1' just fails. Now I'm using Fiddler to change UA.

It would be nice to have UA change option in QuiteRSS...

aidaho commented 5 years ago

I had the same problem with olx.pl. They introduced User Agent checking. QuiteRss with 'User-Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/538.1 (KHTML, like Gecko) QuiteRSS/0.18.12 Safari/538.1' just fails. Now I'm using Fiddler to change UA.

It would be nice to have UA change option in QuiteRSS...

Thanks for the tip.

I've tried spoofing UA through Squid and although web browser with empty profile does receive RSS XML, QuiteRSS with same UA does not. Seems like they might do more profiling than that.

Have you spoofed and/or removed any other headers to get it to work or was it just UA that did the trick for you?

Katarn commented 5 years ago

Validate feed here: http://www.feedvalidator.org/

aidaho commented 5 years ago

I've got it working!

Looks like OLX marked me with a cookie. I've deleted them before doing my previous test from the UI, but that apparently didn't work. All I had to do is to disable saving cookies and restart QuiteRSS to get rid of the session.

Everything works again now.

Thank you for the workaround, kjacewicz!

Funcy-dcm commented 4 years ago

Corrected. Expect New Version