Still unable to use proxy IP

[cyberfab007]

Anyway we can get a proxy variable dropped in to this script please , I know how to do it php , it is so easy when using CURL, I mean it must be simper in ruby to do this!

[cyberfab007]

http://ruby-doc.org/stdlib-2.0/libdoc/open-uri/rdoc/OpenURI/OpenRead.html

somthing like this ?

[mlieber]

Use the set_proxy() method on agent, i.e.: agent.set_proxy('proxy address', port, 'username', 'password')

[cyberfab007]

Im sorry but I don't know how to code in ruby as of yet (though I have taken some tutorials, can you just update in the github release ? so its like this "linkedin-scraper LINKEDINURL proxy port " when you run the command

[yatish27]

I guess you can buy proxies for the virtual server in which you running this bot. You can buy them at one place https://instantproxies.com

[cyberfab007]

yatish27 I have over 500 proxies from not only instantproxies.com but others as well I use them for my lead generation for my business , but I can not use them with this scraper , I am learning ruby , but cant figure it out how to drop the proxy variable ,

you should be able to do this from the command line

linkedin-scaper PROFILEURL 10.40.43.35:8080

that would ideal

[yatish27]

Let me look into it

On Mon, May 11, 2015 at 8:23 PM, Jeremy Fabiano notifications@github.com wrote:

yatish27 I have over 500 proxies from only instantproxies.com but others as well I use them for my lead generation for my business , but I can not use them with this scraper , I am learning ruby , but cant figure it out how to drop the proxy variable , you should be able to do this from the command line linkedin-scaper PROFILEURL 10.40.43.35:8080

that would ideal

Reply to this email directly or view it on GitHub: https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101080358

[mlieber]

No worries I know how; I will try your proxy.

Le lundi 11 mai 2015, Yatish Mehta notifications@github.com a écrit :

Let me look into it

On Mon, May 11, 2015 at 8:23 PM, Jeremy Fabiano <notifications@github.com javascript:_e(%7B%7D,'cvml','notifications@github.com');> wrote:

yatish27 I have over 500 proxies from only instantproxies.com but others as well I use them for my lead generation for my business , but I can not use them with this scraper , I am learning ruby , but cant figure it out how to drop the proxy variable , you should be able to do this from the command line linkedin-scaper PROFILEURL 10.40.43.35:8080

that would ideal

Reply to this email directly or view it on GitHub:

https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101080358

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101082186 .

[cyberfab007]

well thats not a real proxy I use here I just make that one up

[cyberfab007]

besides my paid proxies , I also use proxies from here http://www.publicproxyservers.com/proxy/list1.html

[cyberfab007]

here as well http://tools.rosinstrument.com/raw_free_db.htm?0&t=1

[mlieber]

Ok thanks. But we want to use dedicated proxies, not public ones, that's very unsafe, they record your queries. I am already using a private proxy, thanks.

On Mon, May 11, 2015 at 6:14 PM, Jeremy Fabiano notifications@github.com wrote:

here as well http://tools.rosinstrument.com/raw_free_db.htm?0&t=1

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101086518 .

[cyberfab007]

so you updated the script ?

[mlieber]

The proxy that I was using got blocked after a couple of 100 requests.. We need to find another solution.

Le mardi 12 mai 2015, Jeremy Fabiano notifications@github.com a écrit :

so you updated the script ?

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101460953 .

[cyberfab007]

humm, just use the public ones for just testing , I have lots of private ones , but they are being used to pull down the profiles right now and they behavior is set in such a way google is not bothering me right now

[mlieber]

Thanks, but it won't work. Linked in is very sensitive with proxies. I tried a lot of them already.

Le mardi 12 mai 2015, Jeremy Fabiano notifications@github.com a écrit :

humm, just use the public ones for just testing , I have lots of private ones , but they are being used to pull down the profiles right now and they behavior is set in such a way google is not bothering me right now

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101484850 .

[cyberfab007]

ok I will have some fresh proxies for you

[cyberfab007]

just waiting for some paypal transfer from my bank , I will buy 50 more

[mlieber]

Wow - 50 may work indeed! I just need their IPs and the username and password. Cheers -

Le mardi 12 mai 2015, Jeremy Fabiano notifications@github.com a écrit :

just waiting for some paypal transfer from my bank , I will buy 50 more

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101505996 .

[cyberfab007]

do you have the script working ? with 50 IP's I should be able to pull about 500 profiles a hour

[mlieber]

Yes the script is working. I just need your list of IPs and port, username and pass. Thanks

Le mardi 12 mai 2015, Jeremy Fabiano notifications@github.com a écrit :

do you have the script working ? with 50 IP's I should be able to pull about 500 profiles a hour

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101525243 .

[cyberfab007]

add me on skype

[cyberfab007]

cyberfab007

[mlieber]

what's your handle ? There are several -

On Wed, May 13, 2015 at 6:06 PM, Jeremy Fabiano notifications@github.com wrote:

add me on skype

— Reply to this email directly or view it on GitHub https://github.com/yatish27/linkedin-scraper/issues/45#issuecomment-101870192 .

[cyberfab007]

cyberfab007 is my handle

[bricemaurin]

Hi there, any news on the possibility to use proxies ? this version allows that: https://github.com/alex-go/linkedin-scraper/blob/master/lib/linkedin-scraper/profile.rb. Should I fork or may i expect these modifs to be included at some point ? It seems like the proxy topic is coming regularly but it's never been merged into master

[yatish27]

@deuxio Check out version 1.0.2

[bricemaurin]

Thanks a lot Yatish

[yatish27]

Check latest version