Open daaanieelq opened 1 year ago
@workinghard
Hi, I don't know exactly but I have tried with the link provided and everything seems to be working for me. It's possible that ebay is starting to implement some sort of filtering. Depending on the number of request that are send.
It's possible that ebay is starting to implement some sort of filtering
This is something they are doing already for quite some time. @daaanieelq: Wait until you get a new IP and try it again. Don't request more often then 1-2 links per 3 minutes. Otherwise your IP will get on a block list. No idea for how long.
i actually wasnt even able to run it once. I've set it up on a VPS Server using Linux, maybe thats the issue?
i actually wasnt even able to run it once. I've set it up on a VPS Server using Linux, maybe thats the issue?
Means you have a static IP?
I just want to share my experiences.
I have the script running on a VPS and had no issues in 2 months. Even through namechnages. I did not have to change anything.
I run 50 searches per minute plus 150 every 5 minutes. No problems.
While developing and testing changes to script I run it locally on my machine. About 2 month ago the IP blocking started. But I found what they check.. it's the headers. I have implemented an API which fetches randomized http headers for the webscraper every couple of searches. No more IP blocked messages.
Hope that helps.
3. I have implemented an API which fetches randomized http headers for the webscraper every couple of searches. No more IP blocked messages.
Maybe you could do a pr so Vinc3PO can merge them.
Maybe you could do a pr so Vinc3PO can merge them.
I will try to figure out how compatible it is with my overall changes. I have customized my fork of the script quite a bit by now. Maybe I can rather make a contribution to the master branch, maybe that is what you meant... I am new to GitHub.
Maybe you could do a pr so Vinc3PO can merge them.
I will try to figure out how compatible it is with my overall changes. I have customized my fork of the script quite a bit by now. Maybe I can rather make a contribution to the master branch, maybe that is what you meant... I am new to GitHub.
that would be amazing!
Hey, vielen Dank erstmal fuer das script. Leider ist es jetzt aber dazu gekommen, dass ein paar fehlermeldungen entstehen, sobald man die Links einfuegen moechte. sobald ich den Befehl "ebAlert start" eingebe, erhalte ich eine Fehlermeldung. ( Webpage fetching error for url: https://www.kleinanzeigen.de/s-45257/clubmate/k0l2039r200 )
Ich weiss leider wirklich nicht, wie ich das umgehen kann. Waere wirklich nett, wenn mir jemand dabei helfen koennte.|
EDIT: Habe gerade nochmal im Code nachgeschaut und das hier gefunden:
response = requests.get(self.link, headers=custom_header) if response and response.status_code == 200: return response.text else: print(f"<< webpage fetching error for url: {self.link}")
wenn ich's richtig verstehe, kann sich der Bot einfach keinen Zugriff zur Seite verschaffen?