vinc3PO / ebayKleinanzeigenAlert

Telegram Alert for ebay kleinanzeigen posts
MIT License
57 stars 15 forks source link

Namensaenderung von ebay-Kleinanzeigen auf Kleinanzeigen #32

Open daaanieelq opened 1 year ago

daaanieelq commented 1 year ago

Hey, vielen Dank erstmal fuer das script. Leider ist es jetzt aber dazu gekommen, dass ein paar fehlermeldungen entstehen, sobald man die Links einfuegen moechte. sobald ich den Befehl "ebAlert start" eingebe, erhalte ich eine Fehlermeldung. ( Webpage fetching error for url: https://www.kleinanzeigen.de/s-45257/clubmate/k0l2039r200 )

Ich weiss leider wirklich nicht, wie ich das umgehen kann. Waere wirklich nett, wenn mir jemand dabei helfen koennte.|

EDIT: Habe gerade nochmal im Code nachgeschaut und das hier gefunden:

response = requests.get(self.link, headers=custom_header) if response and response.status_code == 200: return response.text else: print(f"<< webpage fetching error for url: {self.link}")

wenn ich's richtig verstehe, kann sich der Bot einfach keinen Zugriff zur Seite verschaffen?

dandud100 commented 1 year ago

@workinghard

vinc3PO commented 1 year ago

Hi, I don't know exactly but I have tried with the link provided and everything seems to be working for me. It's possible that ebay is starting to implement some sort of filtering. Depending on the number of request that are send.

30

workinghard commented 1 year ago

It's possible that ebay is starting to implement some sort of filtering

This is something they are doing already for quite some time. @daaanieelq: Wait until you get a new IP and try it again. Don't request more often then 1-2 links per 3 minutes. Otherwise your IP will get on a block list. No idea for how long.

daaanieelq commented 1 year ago

i actually wasnt even able to run it once. I've set it up on a VPS Server using Linux, maybe thats the issue?

workinghard commented 1 year ago

i actually wasnt even able to run it once. I've set it up on a VPS Server using Linux, maybe thats the issue?

Means you have a static IP?

cyberpete2244 commented 1 year ago

I just want to share my experiences.

  1. I have the script running on a VPS and had no issues in 2 months. Even through namechnages. I did not have to change anything.

  2. I run 50 searches per minute plus 150 every 5 minutes. No problems.

  3. While developing and testing changes to script I run it locally on my machine. About 2 month ago the IP blocking started. But I found what they check.. it's the headers. I have implemented an API which fetches randomized http headers for the webscraper every couple of searches. No more IP blocked messages.

Hope that helps.

dandud100 commented 1 year ago

3. I have implemented an API which fetches randomized http headers for the webscraper every couple of searches. No more IP blocked messages.

Maybe you could do a pr so Vinc3PO can merge them.

cyberpete2244 commented 1 year ago

Maybe you could do a pr so Vinc3PO can merge them.

I will try to figure out how compatible it is with my overall changes. I have customized my fork of the script quite a bit by now. Maybe I can rather make a contribution to the master branch, maybe that is what you meant... I am new to GitHub.

johnomon commented 1 year ago

Maybe you could do a pr so Vinc3PO can merge them.

I will try to figure out how compatible it is with my overall changes. I have customized my fork of the script quite a bit by now. Maybe I can rather make a contribution to the master branch, maybe that is what you meant... I am new to GitHub.

that would be amazing!