samwize / python-email-crawler

Search on Google, and crawls for emails related to the result
292 stars 127 forks source link

urllib #13

Closed AndreV84 closed 6 years ago

AndreV84 commented 7 years ago

could you advise please on a) how to resolve: python email_crawler.py "iphone developers" File "email_crawler.py", line 96 except urllib2.URLError, e: ^ SyntaxError: invalid syntax b) how to crawl emails from a specific country, e.g all emails from .it or .com

Thanks

DigiFist-EU commented 7 years ago

I'm having the same problem with line 96. Whats the solution?

Thanks

tiagoamx commented 7 years ago

@AndreV84 @Axlo I noticed this error when using python 3, but with python 2.7.9 it's ok

AndreV84 commented 7 years ago

Is there a way to use the crawler to gather email addresses from a top-level domain like .com or .it or whatever? Are you aware of implementations of that approach? How do one scan a top level domain ? Please advise.

On Mon, Feb 27, 2017 at 9:59 PM, Tiago Vilardi notifications@github.com wrote:

@AndreV84 https://github.com/AndreV84 @Axlo https://github.com/Axlo I noticed this error when using python 3, but with python 2.7.9 it's ok

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/samwize/python-email-crawler/issues/13#issuecomment-282743812, or mute the thread https://github.com/notifications/unsubscribe-auth/APncWalbhQEHXwWGfOfqI2lPXQ7CmZ2fks5rguTEgaJpZM4L_7fW .

ArthurCockfield commented 7 years ago

@AndreV84 @Axlo here's what you need to do: Before: except urllib2.URLError, e: After: except urllib2.URLError as e:

AndreV84 commented 7 years ago

Thank you for the update! I am just wondering if I could search for specific domain email addresses, like .com or it. Thanks

ArthurCockfield commented 7 years ago

@AndreV84 Haven't been able to get it to run. Have you? It seems like the reason it's not working is because the syntax is different for python 3x. Also missing libraries

AndreV84 commented 7 years ago

I did just run it and it seems running: [11:47:12] INFO::email_crawler - Crawling https://www.wired.com/tag/hacks/ Is there a way to search for all emails which belong to a specific domain?

ArthurCockfield commented 7 years ago

@andreV84 what version of python are you running? And how did you fix the issue with URLparse if you're using python 3 and greater.

ArthurCockfield commented 7 years ago

@AndreV84 for all emails hunter.io is software which keeps a database of specific domains

AndreV84 commented 7 years ago

thank you for letting me know!

AndreV84 commented 7 years ago

I think I am using python 2.7

On Fri, Aug 4, 2017 at 7:02 PM, ArthurCockfield notifications@github.com wrote:

@AndreV84 https://github.com/andrev84 for all emails hunter.io is software which keeps a database of specific domains

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/samwize/python-email-crawler/issues/13#issuecomment-320328851, or mute the thread https://github.com/notifications/unsubscribe-auth/APncWZuerz2akJK9GCdckyuN2kpavcuLks5sU2q6gaJpZM4L_7fW .

ArthurCockfield commented 7 years ago

@AndreV84 Okay thanks for letting me know. Is the output supposed to be "logging.config.dictconfig after the program is running? Does that mean it is doing the searches?