mlsecproject / combine

Tool to gather Threat Intelligence indicators from publicly available sources
https://www.mlsecproject.org/
GNU General Public License v3.0
650 stars 179 forks source link

Combine is getting "Killed" #164

Open TejaRamachandran opened 7 years ago

TejaRamachandran commented 7 years ago

Hi Guys,

I am facing this below situation again and again. The combine is getting killed all the time. I am not sure what will be the reason.

2016-07-28 11:19:12,148 - combine.thresher - INFO - Parsing feed from http://dragonresearchgroup.org/insight/vncprobe.txt 2016-07-28 11:19:12,149 - combine.thresher - INFO - Evaluating http://danger.rulez.sk/projects/bruteforceblocker/blist.php 2016-07-28 11:19:12,149 - combine.thresher - INFO - Parsing feed from http://danger.rulez.sk/projects/bruteforceblocker/blist.php 2016-07-28 11:19:12,156 - combine.thresher - INFO - Evaluating https://isc.sans.edu/ipsascii.html 2016-07-28 11:19:12,157 - combine.thresher - INFO - Parsing feed from https://isc.sans.edu/ipsascii.html 2016-07-28 11:19:12,159 - combine.thresher - INFO - Evaluating http://www.nothink.org/blacklist/blacklist_ssh_day.txt 2016-07-28 11:19:12,159 - combine.thresher - INFO - Parsing feed from http://www.nothink.org/blacklist/blacklist_ssh_day.txt 2016-07-28 11:19:12,159 - combine.thresher - INFO - Evaluating https://www.packetmail.net/iprep.txt 2016-07-28 11:19:12,160 - combine.thresher - INFO - Parsing feed from https://www.packetmail.net/iprep.txt 2016-07-28 11:19:12,170 - combine.thresher - INFO - Evaluating https://autoshun.org/files/shunlist.csv 2016-07-28 11:19:12,170 - combine.thresher - INFO - Parsing feed from https://autoshun.org/files/shunlist.csv 2016-07-28 11:19:12,170 - combine.thresher - INFO - Skipping site https://autoshun.org/files/shunlist.csv 2016-07-28 11:19:12,171 - combine.thresher - INFO - Evaluating http://charles.the-haleys.org/ssh_dico_attack_hdeny_format.php/hostsdeny.txt 2016-07-28 11:19:12,171 - combine.thresher - INFO - Parsing feed from http://charles.the-haleys.org/ssh_dico_attack_hdeny_format.php/hostsdeny.txt 2016-07-28 11:19:12,302 - combine.thresher - INFO - Evaluating http://virbl.org/download/virbl.dnsbl.bit.nl.txt 2016-07-28 11:19:12,302 - combine.thresher - INFO - Parsing feed from http://virbl.org/download/virbl.dnsbl.bit.nl.txt 2016-07-28 11:19:12,304 - combine.thresher - INFO - Evaluating http://botscout.com/last_caught_cache.htm 2016-07-28 11:19:12,304 - combine.thresher - INFO - Parsing feed from https://zeustracker.abuse.ch/blocklist.php?download=ipblocklist 2016-07-28 11:19:12,305 - combine.thresher - INFO - Parsing feed from https://palevotracker.abuse.ch/blocklists.php?download=ipblocklist 2016-07-28 11:19:12,305 - combine.thresher - INFO - Parsing feed from http://reputation.alienvault.com/reputation.data 2016-07-28 11:19:12,451 - combine.thresher - INFO - Parsing feed from http://www.nothink.org/blacklist/blacklist_malware_dns.txt 2016-07-28 11:19:12,473 - combine.thresher - INFO - Parsing feed from http://www.nothink.org/blacklist/blacklist_malware_http.txt 2016-07-28 11:19:12,475 - combine.thresher - INFO - Parsing feed from http://www.nothink.org/blacklist/blacklist_malware_irc.txt 2016-07-28 11:19:12,475 - combine.thresher - INFO - Parsing feed from https://feodotracker.abuse.ch/blocklist/?download=ipblocklist 2016-07-28 11:19:12,480 - combine.thresher - INFO - Storing parsed data in crop.json 2016-07-28 11:19:14,160 - combine.baler - INFO - Reading processed data from crop.json Killed

alexcpsec commented 7 years ago

Sorry, Teja, but this is not enough information to tell me anything. Have you tried running the code on a Python debbuger or IDE to see where it is being killed?