search

Arachni / arachni

Web Application Security Scanner Framework
http://www.arachni-scanner.com
Other
3.71k stars 756 forks source link

Nightly (10/03/22) : scheduled scan failed when started, normal scan running fine #1062

Closed Chridolc closed 2 years ago

Chridolc commented 2 years ago

Hello. Just tried the Schedule : it seems not working properly and stop immediatly when started. On the web interface, the task have a "Finished" status with error

Type : N/A Issue Count : 0 Started at : N/A Finished at : N/A

next scan is still in queue.

Logs of this scheduled scan attached.

thanks for your help arachni_web_schedule.txt

Zapotek commented 2 years ago

Seems like a connectivity issue with the target, as the log says HTTP requests to reach it completely failed.

Chridolc commented 2 years ago

Hello. That's my second test with two externally hosted websites from my company. same behavior.. but maybe... so i'll test with an internal one.

Thanks.

Le lun. 14 mars 2022 à 14:12, Tasos Laskos @.***> a écrit :

Seems like a connectivity issue with the target, as the log says HTTP requests to reach it completely failed.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066767871, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEHHN627JKFRI7UKAVDU743KDANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Zapotek commented 2 years ago

There's nothing special with scheduled scans. There's a chance you got blocked.

Chridolc commented 2 years ago

yep. You're right. Tested with a "monitored" website : scheduled scan running fine. I've found that there was a wordpress "firewall (pfew..)" plugin on the previous one... have a little problem : When i try to modify a schedule (start time) i've had a "something get wrong" issue when updating... But i need to make more tests to confirm.

Thanks again for your reply.

Cheers.

Le lun. 14 mars 2022 à 14:21, Tasos Laskos @.***> a écrit :

There's nothing special with scheduled scans. There's a chance you got blocked.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066778529, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEHUEDNDZFE5NPXOFQTU744N5ANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Zapotek commented 2 years ago

You can find the actual error in the logfile under logs/webui/.

Chridolc commented 2 years ago

i think it's here :

Schedule Update (0.2ms) UPDATE "schedules" SET "start_at" = ?, "updated_at" = ? WHERE "schedules"."id" = ? [["start_at", "2022-03-15 13:55:05"], ["updated_at", "2022-03-14 14:09:33.831500"], ["id", 14]] (7.8ms) commit transaction Profile Load (0.5ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] Dispatcher Load (0.2ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Redirected to CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Completed 500 Internal Server Error in 83ms (ActiveRecord: 10.0ms | Allocations: 75540) CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]]

NoMethodError (undefined method `back_url' for

):

app/controllers/scans_controller.rb:238:in block (2 levels) in update' app/controllers/scans_controller.rb:234:inupdate' Started GET "/navigation" for XXX.XXX.XXX.XXX at 2022-03-14 15:09:33 +0100 Processing by HomeController#navigation as HTML

Just changed the start time of a scheduled scan.

Le lun. 14 mars 2022 à 14:57, Tasos Laskos @.***> a écrit :

You can find the actual error in the logfile under logs/webui/.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066825875, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEDNR5PYBUA2MOG6DR3U75AU3ANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Zapotek commented 2 years ago

Should be fixed now in the nightlies.

Thanks for the feedback.

Chridolc commented 2 years ago

tested again with an internal / sensible website - sure it's 100% available.

=> created a new schedule => going back to this schedule => changing the start time => error

(0.1ms) begin transaction Schedule Update (0.2ms) UPDATE "schedules" SET "start_at" = ?, "updated_at" = ? WHERE "schedules"."id" = ? [["start_at", "2022-03-14 16:30:00"], ["updated_at", "2022-03-14 15:00:50.020718"], ["id", 18]] (8.6ms) commit transaction Profile Load (0.5ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] Dispatcher Load (0.2ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Redirected to CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Completed 500 Internal Server Error in 86ms (ActiveRecord: 19.1ms | Allocations: 76501) CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]]

NoMethodError (undefined method `back_url' for

):

app/controllers/scans_controller.rb:238:in block (2 levels) in update' app/controllers/scans_controller.rb:234:inupdate' ScanManager#keep_schedule Schedule Load (0.3ms) SELECT "schedules".* FROM "schedules" INNER JOIN "scans" ON "scans"."schedule_id" = "schedules"."id" WHERE "scans"."status" = ? AND (start_at <= '2022-03-14 15:00:52.309662') [["status", "scheduled"]] ScanManager#refresh

Le lun. 14 mars 2022 à 14:12, Tasos Laskos @.***> a écrit :

Seems like a connectivity issue with the target, as the log says HTTP requests to reach it completely failed.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066767871, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEHHN627JKFRI7UKAVDU743KDANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Chridolc commented 2 years ago

i'll create another instance to check if i can reproduce it.

Le lun. 14 mars 2022 à 16:03, Christophe Dolci @.***> a écrit :

tested again with an internal / sensible website - sure it's 100% available.

=> created a new schedule => going back to this schedule => changing the start time => error

(0.1ms) begin transaction Schedule Update (0.2ms) UPDATE "schedules" SET "start_at" = ?, "updated_at" = ? WHERE "schedules"."id" = ? [["start_at", "2022-03-14 16:30:00"], ["updated_at", "2022-03-14 15:00:50.020718"], ["id", 18]] (8.6ms) commit transaction Profile Load (0.5ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] Dispatcher Load (0.2ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Redirected to CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Completed 500 Internal Server Error in 86ms (ActiveRecord: 19.1ms | Allocations: 76501) CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]]

NoMethodError (undefined method `back_url' for

):

app/controllers/scans_controller.rb:238:in block (2 levels) in update' app/controllers/scans_controller.rb:234:inupdate' ScanManager#keep_schedule Schedule Load (0.3ms) SELECT "schedules".* FROM "schedules" INNER JOIN "scans" ON "scans"."schedule_id" = "schedules"."id" WHERE "scans"."status" = ? AND (start_at <= '2022-03-14 15:00:52.309662') [["status", "scheduled"]] ScanManager#refresh

Le lun. 14 mars 2022 à 14:12, Tasos Laskos @.***> a écrit :

Seems like a connectivity issue with the target, as the log says HTTP requests to reach it completely failed.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066767871, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEHHN627JKFRI7UKAVDU743KDANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Chridolc commented 2 years ago

Hello.

I've installed a fresh nightly (14/03), empty database.

Le lun. 14 mars 2022 à 16:11, Christophe Dolci @.***> a écrit :

i'll create another instance to check if i can reproduce it.

Le lun. 14 mars 2022 à 16:03, Christophe Dolci @.***> a écrit :

tested again with an internal / sensible website - sure it's 100% available.

=> created a new schedule => going back to this schedule => changing the start time => error

(0.1ms) begin transaction Schedule Update (0.2ms) UPDATE "schedules" SET "start_at" = ?, "updated_at" = ? WHERE "schedules"."id" = ? [["start_at", "2022-03-14 16:30:00"], ["updated_at", "2022-03-14 15:00:50.020718"], ["id", 18]] (8.6ms) commit transaction Profile Load (0.5ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] Dispatcher Load (0.2ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Redirected to CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]] Completed 500 Internal Server Error in 86ms (ActiveRecord: 19.1ms | Allocations: 76501) CACHE Profile Load (0.0ms) SELECT "profiles". FROM "profiles" WHERE "profiles"."id" IN (?, ?, ?, ?, ?, ?, ?, ?, ?) LIMIT ? [["id", 1], ["id", 2], ["id", 3], ["id", 4], ["id", 5], ["id", 1], ["id", 2], ["id", 3], ["id", 4], ["LIMIT", 11]] CACHE Dispatcher Load (0.0ms) SELECT "dispatchers". FROM "dispatchers" WHERE 1=0 AND "dispatchers"."alive" = ? LIMIT ? [["alive", 1], ["LIMIT", 11]]

NoMethodError (undefined method `back_url' for

):

app/controllers/scans_controller.rb:238:in block (2 levels) in update' app/controllers/scans_controller.rb:234:inupdate' ScanManager#keep_schedule Schedule Load (0.3ms) SELECT "schedules".* FROM "schedules" INNER JOIN "scans" ON "scans"."schedule_id" = "schedules"."id" WHERE "scans"."status" = ? AND (start_at <= '2022-03-14 15:00:52.309662') [["status", "scheduled"]] ScanManager#refresh

Le lun. 14 mars 2022 à 14:12, Tasos Laskos @.***> a écrit :

Seems like a connectivity issue with the target, as the log says HTTP requests to reach it completely failed.

— Reply to this email directly, view it on GitHub https://github.com/Arachni/arachni/issues/1062#issuecomment-1066767871, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVLRHEHHN627JKFRI7UKAVDU743KDANCNFSM5QVPHVEQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

Zapotek commented 2 years ago

Can I see the error this time please?

Chridolc commented 2 years ago

of course ! arachni_web_schedule.txt

Zapotek commented 2 years ago

My bad, from what I realised I had made the changes to the master branch (stable/release) by accident, not experimental (nightlies), that's why.

Chridolc commented 2 years ago

no problem :-).

maybe the same issue when i click on "mark as read" on the main page affter auth ?

Zapotek commented 2 years ago

Yep, it was a redirection issue, should be gone now in the nightlies.

Chridolc commented 2 years ago

I confirm. schedule modification & "mark as read" button running fine.

Thanks.