ail-project / ail-framework

AIL framework - Analysis Information Leak framework
GNU Affero General Public License v3.0
561 stars 80 forks source link

Stuck Queue #83

Open Gr3gbug opened 3 years ago

Gr3gbug commented 3 years ago

Hi guys, I have a problem related to AIL queues. After some time, the framework starts to show stuck queue (e.g. Tags, Mail, Web etc...). I can't understand what's happening under the hoods ? Could someone help me to solve this issue? Now, the unique option i have to solve this problem is stopping ail and restart the framework, but i think it is not the best. Please help me to understand where is the real problem

Terrtia commented 3 years ago

Hi @lucadigregorio !

Can you check the output of all windows inside the Script_AIL screen:

screen -r Script_AIL

Here is a list of shortcut to manage/navigate in the screen:

mokaddem commented 3 years ago

@lucadigregorio you can list all screen available for the user using this command

screen -ls

If you don't see any screen available but still see some running using htop/top. That probably means they was created using another user than the one you are currently using.

Gr3gbug commented 3 years ago

Hi @mokaddem, i try also to to do this, and i can't see anything. The message is: No sockets found in /run/screen/S-user. I also try to open some screen and attach something on them and it works. Any idea?

Gr3gbug commented 3 years ago

Sorry, @mokaddem, the screen is under root user. Now, i can share with you the problem. I just run the feeder, as soon as the queue got stuck i will share with you the output of the Script_AIL screen

Gr3gbug commented 3 years ago

@mokaddem For example, i actually have the Tags queue which is stuck. All i can see from the screen -r Script_AIL is: Please provide a list of valid IP address.

Terrtia commented 3 years ago

Hi @lucadigregorio !

Can you navigate through windows? you have multiple terminals/windows inside a screen. (Ctrl-a + n: next window, Ctrl-a + p: previous window)

Gr3gbug commented 3 years ago

Hi @Terrtia, i just did it, i'm actually trying to understand where is the problem. I'm going to share with you the screen of Script_AIL: ---> screen of Script_AIL (something seems to be wrong with the sentiment analysis module) sentiment_stuck --> Error syntax Script_AIL_error --> No IP range provided Script_AIL_error2

I have a doubt about the following point: while i'm navigating through windows of Script_AIL, among the others i've seen the manager. As soon as i push 'enter' to see all the modules information, all ail's queue restarted. Is it normal this behaviour ? I mean, from what i understood about the ModulesInformationV2.py, the user should be able to see all running queue, their status and if the case restart manually (and singularly) a queue. So, why all queues has been restarted just entering in the modules information manager ?

@Terrtia i've update the comment removing additional information about crawler problem, i'll open another issue for this