search

tdurieux / leboncoin-api

DEPRECATED
https://www.npmjs.com/package/leboncoin-api
169 stars 54 forks source link

Requests blocked due to security increase #64

Open xavierartot opened 4 years ago

xavierartot commented 4 years ago

This is still possible to use your library to read the data’s?

tdurieux commented 4 years ago

It depends of your "Production" and how many requests you plan to do.

tagazok commented 4 years ago

Hi,

What do you mean by "Production" ? I tried to use the api with the example in the readme and run it locally on my computer, I get a 403 error :/ Any way I can make this work ?

tdurieux commented 4 years ago

I updated the user-agent used by the lib (v0.0.43), you should not get a 403 error now.

nFonsat commented 4 years ago

Hello, I updated this package to 0.0.45 but I get a 403 error. Please help me.

[EDIT] I just tried it with a vpn and it works. I think "datadome" or "leboncoin" blocked my IP.

tdurieux commented 4 years ago

They drastically increase security yesterday. I think it is the end of the lib :( The first request is generally not blocked but the second one is.

nFonsat commented 4 years ago

I think so too :(. On their website, since yesterday, it is mandatory to validate a "captcha". Can we retrieve in another way their content as other very well known sites do?

tdurieux commented 4 years ago

i am not aware of other ways

ronycohen commented 3 years ago

They drastically increase security yesterday. I think it is the end of the lib :( The first request is generally not blocked but the second one is.

That was a great Journey :)

victorbartel commented 3 years ago

What do you think about to leverage the community strength and crawl their site with micro, silenum based scrapers from many spots(every community member could launch one for 30 min a day) in order to grab, package and expose the data through a clean API?