search

ail-project / ail-framework

AIL framework - Analysis Information Leak framework
GNU Affero General Public License v3.0
561 stars 80 forks source link

The built-in test fails when Tor is not usable despite web crawling being available #232

Open ajoga opened 1 month ago

ajoga commented 1 month ago

Summary

I understand Lacus can fetch content from both Tor websites and the normal internet.

An installation without configuring Tor will make the built-in test fail, when in reality web content can be fetched.

Step to reproduce

Follow the procedure from https://github.com/ail-project/ail-framework/blob/26f9e84d9796446cefa175eed78a0e89ebfda966/HOWTO.md#crawler

When running the test while you don't have a Tor socks listening, the test output will be the following: image

One can confirm the web crawling works:

  1. go to Manual crawler, set a public URL and crawler type = web.
  2. go to Web crawler and observe that the URL was crawled (allow 10-30 seconds if that doesn't show right away)

Expected outcome

I would expect not to have the "Error" in red after the test for sure.

Ideally two tests, one for Web and one for Tor: there it would make sense for me to see one pass and one fail. Currently it feels like the whole test was unsuccessful.

Rafiot commented 1 month ago

I transferred this issue to AIL because I don't think it is related to lacus (?)

Rafiot commented 2 weeks ago

Hey, I just looked at the error message again, and just making sure of one thing: is tor up and running on the machine where lacus is installed? Because the error messages makes me think lacus cannot connect to the proxy, possibly because it's not there.

ajoga commented 2 weeks ago

is tor up and running on the machine where lacus is installed

No it is not, by design in our case.

Rafiot commented 2 weeks ago

Ok, I'll let @Terrtia take care of it then.