Bug: Submit larger file: Did not analyse => 404

ail-project / ail-framework

AIL framework - Analysis Information Leak framework

GNU Affero General Public License v3.0

591 stars 79 forks source link

Bug: Submit larger file: Did not analyse => 404 #61

Open certrik opened 3 years ago

certrik commented 3 years ago

Hi,

I submitted a 100 MB ascii text file via https://ail.domain.tld:7000/PasteSubmit/ via file upload. It stated everything workes fine but apparently it didn't. Didn't get any tracker alerts even if I manually looked into it and it should have alerted on some. If searching for tag infoleak:submission="manual" it shows up but if I try to access the reference I get an 404 error.

certrik commented 3 years ago

Is there any upper limit for filesize? I searched for an info, but didn't find any answers.

mokaddem commented 3 years ago

Not sure if it help, but it may be worth playing with this https://flask.palletsprojects.com/en/1.1.x/patterns/fileuploads/#improving-uploads

certrik commented 3 years ago

@mokaddem Sorry for asking ... but is this a comment for me to try to find a workaround or is it something which could resolve the issue upstream?

mokaddem commented 3 years ago

I also think that your intuition about maximum submission size is correct, so I just pointed the relevant part of the documentation. If your initial guess is correct, it should solve the issue and we would gladly add an entry in the documentation. However, please note that AIL is not designed (yet?) to process files of this size. If you can split your big file into multiple fragments (<5Mb would be best), it would be much faster for the system to ingest and process.