search

m8sec / CrossLinked

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
GNU General Public License v3.0
1.3k stars 183 forks source link

Does Google ban Crosslinked? #16

Closed RohanBos closed 2 years ago

RohanBos commented 2 years ago

I successfully cloned the CrossLinked directory and ran the algorithm. I tried to get a list of people working for a company. Google returned 280 hits and Bing returned about 80. Both numbers are pretty low, given the fact that this particular company has more than 5000 employees. For now, that's a minor issue. :-) However, running the algorithm for a second time returned zero hits for Google. Since this second run Google does not return any hits at all. Bing works -sort of- alright. Does Google have a policy of banning the use of Crosslinked after recognizing the IP -address? Or are we talking an old issue?

m8sec commented 2 years ago

Try increasing the timeout to keep the search running longer for better results .

However, to address your second point, most search engines impose protections against unauthorized bots and scrapers. That said, crosslinked typically works great on the first run, after that you may need to change/rotate your source address.