olacabs / jackhammer

Jackhammer - One Security vulnerability assessment/management tool to solve all the security team problems.
https://jch.olacabs.com/userguide
Other
718 stars 162 forks source link

Jackhammer CLI #100

Open dkogue opened 6 years ago

dkogue commented 6 years ago

Please is there a way to interact with jackhammer via CLI.I would like to schedule some scanning job using tools I have in jackhammer. So i want to do this via CLI. Any suggestion please? Thanks in advance.

kmadhusudhan commented 6 years ago

sorry , we do not have CLI version

dkogue commented 6 years ago

Thanks for your feedback. I have added owaps zap but when I scan no alerts is generated. Is there something I am missing in my zap.rb code? Is it possible to see application level logs in jackhammer (for example to see if the zap.rb is generating some error)

Here is my code...... require 'pipeline/tasks/base_task' require 'pipeline/util' require 'tempfile' require 'json'

 #Change class name as scanner name, class name should be in CamelCase  

class Pipeline::Zap < Pipeline::BaseTask Pipeline::Task.add self include Pipeline::Util

    def initialize(trigger, tracker)
        super(trigger, tracker)
    @name = 'Zap' #ex: ArachniScanner
    @description = "Zap is a web app security scanner " #example: Arachni Scanner is web app security scanner 
        @stage = :code
        @labels << "code" 
     end
     def run
         # Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name  
         @results_file = Tempfile.new(['zap','xml'])

         #cd /home/usr/local/bin
         #Dir.chdir '/opt/zaproxy'
         #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')

         Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

          runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start")

          runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")

          runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7", "report", "-o","xml", "#{@results_file.path}")

          #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
          #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")

      #parsing results to json
      @results = JSON.parse(File.read("#{@results_file}"))
     end
 def analyze

        #if already parser worker is written , please replace Parser section code without comment ,And you can discard rest of lines untill end of method definition 
    #please check your parser worker in $APPLICATION_PATH/web/app/worker. 
     #worker name will be scaner_name_upload_worker.rb ex: arachni_upload_worker.rb 
    ##########################Parser section code##################
      ZapUploadWorker.perform_async(@trigger.scan_id,@result_xml_path)
      #ZapUploadWorker.new.perform(@trigger.scan_id,@results_file.path)
     # Above line upload the results to jackhammer

     rescue Exception => e
        Pipeline.warn e.message
        Pipeline.warn e.backtrace
     end
ensure
 # FileUtils.rm @results_file #file gets deleted after parsing is done
end
 # Check , if the scanner is installed
def supported?
    unless File.exist?('/opt/zaproxy/zap')
        Pipeline.notify "Install zap-cli: 'pip install --upgrade zapcli'"
        return false
    else
        return true
    end

end

Thanks in advance

dkogue commented 6 years ago

@KMadhuSudhan @shadsidd @sampathmende please Team I need your help. I have been trying to add zap to jackhammer the whole week and I have not succeeded. when I ran a scan it shows complete (which is done in a fraction of second) but no alerts show. Any help will be much appreciated. Question: Is it possible to check from jackhammer level why zap scanner is not generating any alerts or if the scan ran at all? Thank you all !

kmadhusudhan commented 6 years ago

@dkogue 1) Tool name need to configure from UI and need to enable , please refer Userguide. 2) After configuring a tool add target and run the scan. 3) check logs in log/sidekiq.log file , please check wether tool running against scan .
4) if any error throws by your tool ,it will be logged in log/sidekiq.log or log/scans/[scanid].log, check this file from application root directory

dkogue commented 6 years ago

@KMadhuSudhan

Thanks for your swift feedback. That perfectly what I did. and my log file in my jackhammer dir is empty. did you try to add zap yourself? I will keep digging but if you have any idea that can help me please share. Thanks!

dkogue commented 6 years ago

@KMadhuSudhan @shadsidd Her is my sidekiq logs. apparently my "dynamic_scan_worker" is failing. I will highly appreciate your help. Thanks in advance.

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-06-24T07:39:45.949Z 68 TID-gr1rmquxs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Loading Schedule 2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-06-24T07:39:45.955Z 68 TID-gr1rmquxs INFO: Schedules Loaded root@dom-VirtualBox:/var/lib/docker/overlay2/9a9e44afe9aa85a91ef4bc14969855211a34f134f210ff5f4227a0190d0b80f9/diff/home/app/log# cat sidekiq.log

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-06-24T07:39:45.949Z 68 TID-gr1rmquxs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Loading Schedule 2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-06-24T07:39:45.955Z 68 TID-gr1rmquxs INFO: Schedules Loaded 2018-06-24T07:54:08.164Z 68 TID-gr1swt0hk DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start Loading scanner... 2018-06-24T07:54:08.533Z 68 TID-gr1swt0hk DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.369 sec 2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826848.1637225,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,10],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ca05b11ba4ddb09cf2a862f9\",\"created_at\":1529826848.161588,\"enqueued_at\":1529826848.1637225}"} 2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: TypeError: no implicit conversion of nil into String 2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform' /home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' 2018-06-24T07:54:36.277Z 68 TID-gr1swt19w DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start Loading scanner... 2018-06-24T07:54:36.355Z 68 TID-gr1swt19w DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.078 sec 2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826876.2770114,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"],"retried_at":1529826876.3559597},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,10],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ca05b11ba4ddb09cf2a862f9\",\"created_at\":1529826848.161588,\"enqueued_at\":1529826876.2770114,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1529826848.5338473,\"retry_count\":0,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform'\",\"/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'\"]}"} 2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: TypeError: no implicit conversion of nil into String 2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform' /home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' 2018-06-24T07:55:39.023Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start Loading scanner... 2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.058 sec 2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: Adding dead DynamicScanWorker job ca05b11ba4ddb09cf2a862f9 2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826939.022467,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"],"retried_at":1529826939.081275},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,10],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ca05b11ba4ddb09cf2a862f9\",\"created_at\":1529826848.161588,\"enqueued_at\":1529826939.022467,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1529826848.5338473,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform'\",\"/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'\"],\"retried_at\":1529826876.3559597}"} 2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 WARN: TypeError: no implicit conversion of nil into String 2018-06-24T07:55:39.082Z 68 TID-gr1sc0704 WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inensure in perform' /home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'

kmadhusudhan commented 6 years ago

@dkogue given logs says your tool is not counted for scanning , got to settings=>Scan tools => List tools=>[Scan Type], enable your tool from here and do the rescan

dkogue commented 6 years ago

@KMadhuSudhan I have done the same and zap is enable. I don't know why it is not counting the added tool. Any idea what can be the cause? Thanks for all your feedback, much appreciated.

dkogue commented 6 years ago

@sampathmende @alex-rad I seen some of your posts. trying to add zap to jackhammer but with no avail. Your input or advice will be much appreciated. Thanks in advance.

kmadhusudhan commented 6 years ago

please run the below commands , lets check if your tool listed . if it is listed please restart sidekiq by running 'bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml'

root@cd881aaaf1f1:/home/app# rails c Running via Spring preloader in process 12377 Loading production environment (Rails 4.2.7.1) [1] pry(main)> Setting.pipeline => {"npm_registry"=>"https://registry.npmjs.org/", "tasks_for"=> {"Ruby"=>"BundleAudit,Brakeman,Dawnscanner", "JavaScript"=>"NPM,RetireJS,NodeSecurityProject,Snyk", "CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject,Snyk", "Java"=>"Xanitizer,FindSecurityBugs,PMD", "WebScanners"=>"Arachni"}, "pmd_path"=>"/home/app/tools/pmd-bin-5.5.1", "findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6", "xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.4", "truffle_hog_path"=>"/home/app/tools/truffleHog", "commit_start_date"=>nil, "commit_end_date"=>nil, "commits_depth"=>nil, "enabled_tools"=>"NPM,NodeSecurityProject,RetireJS,Snyk,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner,Xanitizer", "checkmarx_server"=>nil, "checkmarx_user"=>nil, "checkmarx_password"=>nil, "checkmarx_log"=>nil} [2] pry(main)>

dkogue commented 6 years ago

@KMadhuSudhan Here is the output. My tool is not listed. Can I add it manually? if yes how please. Thanks.
root@1becc9fa2d77:/home/app# rails c Running via Spring preloader in process 322 Loading production environment (Rails 4.2.7.1) [1] pry(main)> Setting.pipeline => {"npm_registry"=>"https://registry.npmjs.org/", "tasks_for"=> {"Ruby"=>"BundleAudit,Brakeman,Dawnscanner", "JavaScript"=>"NPM,RetireJS,NodeSecurityProject", "CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject", "Java"=>"Xanitizer,FindSecurityBugs,PMD", "WebScanners"=>"Arachni"}, "pmd_path"=>"/home/app/tools/pmd-bin-5.5.1", "findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6", "xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0", "truffle_hog_path"=>"/home/app/tools/truffleHog", "commit_start_date"=>nil, "commit_end_date"=>nil, "commits_depth"=>nil, "enabled_tools"=> "FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner", "checkmarx_server"=>nil, "checkmarx_user"=>nil, "checkmarx_password"=>nil, "checkmarx_log"=>nil} [2] pry(main)>

dkogue commented 6 years ago

@KMadhuSudhan I managed to make my too listed as shown bellow, I added zap gem to the Gemifile. But now none of the tools are able to scan. This is very frustrating, please help.

root@d1f6e20245be:/home/app# rails c Running via Spring preloader in process 594 Loading production environment (Rails 4.2.7.1) [1] pry(main)> Setting.pipeline => {"npm_registry"=>"https://registry.npmjs.org/", "tasks_for"=> {"Ruby"=>"BundleAudit,Brakeman,Dawnscanner", "JavaScript"=>"NPM,RetireJS,NodeSecurityProject", "CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject", "Java"=>"Xanitizer,FindSecurityBugs,PMD", "WebScanners"=>"Arachni"}, "pmd_path"=>"/home/app/tools/pmd-bin-5.5.1", "findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6", "xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0", "truffle_hog_path"=>"/home/app/tools/truffleHog", "commit_start_date"=>nil, "commit_end_date"=>nil, "commits_depth"=>nil, "enabled_tools"=> "FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner,Zap", "checkmarx_server"=>nil, "checkmarx_user"=>nil, "checkmarx_password"=>nil, "checkmarx_log"=>nil} [2] pry(main)>


have this error when I run this command: bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml root@d1f6e20245be:/home/app# bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml bundler: command not found: RAILS_ENV=production Install missing gem executables with bundle install

  1. I bundle install and run again but same error
  2. From which directory should I execute the ' bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml' command.

thanks, lets make this work so we can share it with the community. if it is not yet possible to add all tools or zap as I am doing now please let me know. It is consuming a lot of my time.

Thanks.

kmadhusudhan commented 6 years ago

@dkogue once its listed in the pipeline , Not required to restart sidekiq . Sidekiq worker will pick the the tool automatically . rebuild the jackhammer required when you do any code changes. if the any tool is not working for you i given list of steps to verify in https://github.com/olacabs/jackhammer/issues/77

dkogue commented 6 years ago

@KMadhuSudhan what do you think can be the cause of the scanner not loading?

dkogue commented 6 years ago

I think it is scanning now but there is issue with reporting. below is my log. kindly help to make this work.

2018-07-01T01:12:22.571Z 69 TID-gp65p7y2k DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T01:12:22.617Z 69 TID-gp65p7y2k DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.047 sec 2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407542.570743,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[5,6],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ad137b807555b4552ce42976\",\"created_at\":1530407542.5703247,\"enqueued_at\":1530407542.570743}"} 2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: TypeError: no implicit conversion of nil into String 2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' _2018-07-01T01:13:02.366Z 69 TID-gp65p7xwg DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T01:13:02.408Z 69 TID-gp65p7xwg DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.042 s_ec 2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407582.36445,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530407582.4087877},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[5,6],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ad137b807555b4552ce42976\",\"created_at\":1530407542.5703247,\"enqueued_at\":1530407582.36445,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530407542.6180234,\"retry_count\":0,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'\"]}"} 2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: TypeError: no implicit conversion of nil into String 2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inperform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T01:13:59.994Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with #<Pipeline::URLMounter:0x0055b1672bfe08> Mounted http://testasp.vulnweb.com/Default.asp? with #<Pipeline::URLMounter:0x0055b1672bfe08> Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T01:14:00.045Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.051 sec 2018-07-01T01:14:00.045Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: Adding dead DynamicScanWorker job ad137b807555b4552ce42976 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407639.9941664,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"],"retried_at":1530407640.0457242},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[5,6],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ad137b807555b4552ce42976\",\"created_at\":1530407542.5703247,\"enqueued_at\":1530407639.9941664,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530407542.6180234,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530407582.4087877}"} 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: TypeError: no implicit conversion of nil into String 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread

dkogue commented 6 years ago

I have notice that zap.rb is not mounted in the container tasks directory as shown in below log.

root@lab-VirtualBox:/home/lab/jackhammer/web/app/lib/pipeline/tasks# ls andro_scanner.rb brakeman.rb findsecbugs.rb nsp.rb snyk.rb zap.rb arachni.rb bundle-audit.rb nmap.rb pmd.rb truffle_scanner.rb base_task.rb dawnscanner.rb npm.rb retirejs.rb xanitizer.rb


root@3a436074e18b:/home/app/lib/pipeline/tasks# ls andro_scanner.rb brakeman.rb findsecbugs.rb nsp.rb snyk.rb arachni.rb bundle-audit.rb nmap.rb pmd.rb truffle_scanner.rb base_task.rb dawnscanner.rb npm.rb retirejs.rb xanitizer.rb

kmadhusudhan commented 6 years ago

@dkogue , can you please pull https://github.com/olacabs/jackhammer/pull/101/commits/9290131ba3a57e2ff1b302645789074bb861b5b2 and rerun the scan , we will get the clear logs .

dkogue commented 6 years ago

same log I think. but why my zap.rb is not mounting as indicated in my last comment. thanks for your assistance

6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' 2018-07-01T11:25:52.116Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: start 2018-07-01T11:25:52.123Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: fail: 0.071 sec 2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: Adding dead DynamicScanWorker job 21caf89fe3d5c11ec17303e6 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,9],"retry":2,"queue":"dynamic","backtrace":true,"jid":"21caf89fe3d5c11ec17303e6","created_at":1530444287.057154,"enqueued_at":1530444352.1159604,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444287.1016653,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.187723},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,9],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"21caf89fe3d5c11ec17303e6\",\"created_at\":1530444287.057154,\"enqueued_at\":1530444352.1159604,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444287.1016653,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'\"],\"retried_at\":1530444313.4484363}"} 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inperform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: fail: 0.066 sec 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: Adding dead DynamicScanWorker job 76521a8eee48dd4782db9eaa 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"],"retried_at":1530444352.1894608},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,8],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"76521a8eee48dd4782db9eaa\",\"created_at\":1530444245.7496054,\"enqueued_at\":1530444352.1221764,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444245.803329,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530444293.4157581}"} 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T11:29:03.530Z 70 TID-gq8kzl25c INFO: Loading Schedule 2018-07-01T11:29:03.531Z 70 TID-gq8kzl25c INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T11:29:03.543Z 70 TID-gq8kzl25c INFO: Schedules Loaded 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Loading Schedule 2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Schedules Loaded 2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Starting processing, hit Ctrl-C to stop /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Loading Schedule 2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T13:42:26.784Z 70 TID-gnn8jzjmk INFO: Schedules Loaded root@3a436074e18b:/home/app/log# root@3a436074e18b:/home/app/log# root@3a436074e18b:/home/app/log# > sidekiq.log root@3a436074e18b:/home/app/log# cat sidekiq.log root@3a436074e18b:/home/app/log# clear

root@3a436074e18b:/home/app/log# cat sidekiq.log 2018-07-01T13:48:03.414Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T13:48:03.715Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: fail: 0.302 sec 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[1,1],"retry":2,"queue":"dynamic","backtrace":true,"jid":"fe056252f93ca0fe10dc7962","created_at":1530452883.4118361,"enqueued_at":1530452883.4134464,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530452883.7158911,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[1,1],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"fe056252f93ca0fe10dc7962\",\"created_at\":1530452883.4118361,\"enqueued_at\":1530452883.4134464}"} 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: TypeError: no implicit conversion of nil into String 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' root@3a436074e18b:/home/app/log#

dkogue commented 6 years ago

same log I think. but why my zap.rb is not mounting as indicated in my last comment. thanks for your assistance

6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' 2018-07-01T11:25:52.116Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: start 2018-07-01T11:25:52.123Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: fail: 0.071 sec 2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: Adding dead DynamicScanWorker job 21caf89fe3d5c11ec17303e6 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,9],"retry":2,"queue":"dynamic","backtrace":true,"jid":"21caf89fe3d5c11ec17303e6","created_at":1530444287.057154,"enqueued_at":1530444352.1159604,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444287.1016653,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.187723},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,9],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"21caf89fe3d5c11ec17303e6\",\"created_at\":1530444287.057154,\"enqueued_at\":1530444352.1159604,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444287.1016653,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'\"],\"retried_at\":1530444313.4484363}"} 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:inperform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: fail: 0.066 sec 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: Adding dead DynamicScanWorker job 76521a8eee48dd4782db9eaa 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:inexist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread'"],"retried_at":1530444352.1894608},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,8],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"76521a8eee48dd4782db9eaa\",\"created_at\":1530444245.7496054,\"enqueued_at\":1530444352.1221764,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444245.803329,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530444293.4157581}"} 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T11:29:03.530Z 70 TID-gq8kzl25c INFO: Loading Schedule 2018-07-01T11:29:03.531Z 70 TID-gq8kzl25c INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T11:29:03.543Z 70 TID-gq8kzl25c INFO: Schedules Loaded 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Loading Schedule 2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Schedules Loaded 2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Starting processing, hit Ctrl-C to stop /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before* Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux] 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"} 2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Loading Schedule 2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"} 2018-07-01T13:42:26.784Z 70 TID-gnn8jzjmk INFO: Schedules Loaded root@3a436074e18b:/home/app/log# root@3a436074e18b:/home/app/log# root@3a436074e18b:/home/app/log# > sidekiq.log root@3a436074e18b:/home/app/log# cat sidekiq.log root@3a436074e18b:/home/app/log# clear

root@3a436074e18b:/home/app/log# cat sidekiq.log 2018-07-01T13:48:03.414Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with # Mounted http://testasp.vulnweb.com/Default.asp? with # Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T13:48:03.715Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: fail: 0.302 sec 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[1,1],"retry":2,"queue":"dynamic","backtrace":true,"jid":"fe056252f93ca0fe10dc7962","created_at":1530452883.4118361,"enqueued_at":1530452883.4134464,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530452883.7158911,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:inperform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:inblock (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:inblock (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:incall'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:ininvoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:inwith_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:instats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:inblock in '","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:inprocess_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:inwatchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[1,1],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"fe056252f93ca0fe10dc7962\",\"created_at\":1530452883.4118361,\"enqueued_at\":1530452883.4134464}"} 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: TypeError: no implicit conversion of nil into String 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:inexist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:inexecute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:inblock in ' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:inblock in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:inblock (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:inblock (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:inblock in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:inprocess' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:inrun' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:inblock in safe_thread' root@3a436074e18b:/home/app/log#

dkogue commented 6 years ago

@KMadhuSudhan Normally Zap should have been in the WebServer listed tools right? is that mean is still not counted ? Please help I want to make it work but need your help since you are the developer. Thanks in advance.

{"npm_registry"=>"https://registry.npmjs.org/", "tasks_for"=> {"Ruby"=>"BundleAudit,Brakeman,Dawnscanner", "JavaScript"=>"NPM,RetireJS,NodeSecurityProject", "CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject", "Java"=>"Xanitizer,FindSecurityBugs,PMD", "WebScanners"=>"Arachni"}, "pmd_path"=>"/home/app/tools/pmd-bin-5.5.1", "findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6", "xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0", "truffle_hog_path"=>"/home/app/tools/truffleHog", "commit_start_date"=>nil, "commit_end_date"=>nil, "commits_depth"=>nil, "enabled_tools"=> "FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Wpscan,AndroScanner,Nmap,TruffleScanner,Zap", "checkmarx_server"=>nil, "checkmarx_user"=>nil, "checkmarx_password"=>nil, "checkmarx_log"=>nil}

dkogue commented 6 years ago

@KMadhuSudhan @zee7han Further log from the scans directory. Please assist. Thanks in advance.

root@ccbdb44aff92:/home/app/log/scans# cat 5.log Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in <class:Zap>'", "/home/app/lib/pipeline/tasks/zap.rb:9:in<top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:in block in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:ineach'", "/home/app/lib/pipeline/tasks.rb:121:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in<top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:inrun'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in block (2 levels) in perform'"] sending notification mail..for scan id.5 Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in'", "/home/app/lib/pipeline/tasks/zap.rb:9:in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:inblock in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:in each'", "/home/app/lib/pipeline/tasks.rb:121:in<top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:inscan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:inblock (2 levels) in perform'"] sending notification mail..for scan id.5 Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in <class:Zap>'", "/home/app/lib/pipeline/tasks/zap.rb:9:in<top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:in block in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:ineach'", "/home/app/lib/pipeline/tasks.rb:121:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in<top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:inrun'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in `block (2 levels) in perform'"] sending notification mail..for scan id.5

kmadhusudhan commented 6 years ago

i could see there is a syntax error in zap.rb at line 10 . And also in run method "Below line runs the scanner " need be comment , this is not a ruby syntax

def run

Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name

     @results_file = Tempfile.new(['zap','xml'])

     #cd /home/usr/local/bin
     #Dir.chdir '/opt/zaproxy'
     #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')

     Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

      runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start")

      runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")

      runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7", "report", "-o","xml", "#{@results_file.path}")

      #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
      #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")

  #parsing results to json
  @results = JSON.parse(File.read("#{@results_file}"))
 end `
dkogue commented 6 years ago

@KMadhuSudhan

thanks for your feedback. kindly find below my current scans log. dynamic_scan_worker sames not to work. We are almost there I think :)

root@ccbdb44aff92:/home/app/log/scans# cat 7.log Error occurred while running dynamicscan ...["/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:246:in rescue in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:237:inscan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:inblock (2 levels) in perform'"] sending notification mail..for scan id.7

kmadhusudhan commented 6 years ago

i could see some error thrown by pipeline.rb, runsystem method is defined inside pipeline . can you please run the each line from run method in rails console and figure out where is the issue . i think zap-cli is not installed inside docker runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start") , it will convert to shell command

dkogue commented 6 years ago

@KMadhuSudhan Ok I will check that right way. also I think the update on dynamic_scan_worker.rb is not working well because arachni which used to run is not running anymore

dkogue commented 6 years ago

@KMadhuSudhan So I have cleaned everything and cloned jackhammer. A web scan with arachni came out successful with 6 informational alerts. But when I look at the sidekiq log I have noticed that DynamicScanWorker failed as well but still scan completed. I am saying this because I was having the same error when I added Zap, only that it didnt present any alert. May be there is a problem with DynamicScanWorker that we need to fix.

I also noticed that when I restart the sidekiq, even arachni doesnt not provide any result. 2018-07-02T22:59:58.050Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: start Loading scanner... Mounting https://prdpc02lu.paycash.eu/login?lang=en with # Mounted https://prdpc02lu.paycash.eu/login?lang=en with # Processing target...https://prdpc02lu.paycash.eu/login?lang=en Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code code - Arachni - # Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-02T23:00:38.188Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: fail: 40.139 sec 2018-07-02T23:00:38.189Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: Adding dead DynamicScanWorker job 4e3c3da9c3a3942bedb199b5

dkogue commented 6 years ago

@KMadhuSudhan @shadsidd Here is my latest progress. log after scanning. I will fill paste my code and then the log. Thanks for your support .

Issue: Scan complete without any alerts Observation: after the Running tasks in stage: code the zap instance need to run but I am not sure if it is running.

***Zap.rb code**** require 'pipeline/tasks/base_task' require 'pipeline/util' require 'tempfile' require 'json'

Change class name as scanner name, class name should be in CamelCase

class Pipeline::Zap < Pipeline::BaseTask Pipeline::Tasks.add self include Pipeline::Util

def initialize(trigger, tracker)
    super(trigger, tracker)
@name = 'Zap' #ex: ArachniScanner
@description = "Zap is a web app security scanner " #example: Arachni Scanner is web app security scanner 
    @stage = :code
    @labels << "code" 
 end
 def run
     # Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name  
     @results_file = Tempfile.new(['zap','xml'])

     #cd /home/usr/local/bin
     #Dir.chdir '/opt/zaproxy'
     #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')

     #Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

      runsystem(true,"zap-cli","--zap-path","/home/app/ZAP_2.7.0", "start", "--start-options" ,'-config api.disablekey=true')

      runsystem(true,"zap-cli","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")

      runsystem(true,"zap-cli", "report", "-o","xml", "#{@results_file.path}")

      #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
      #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")

  #parsing results to json
  @results = JSON.parse(File.read("#{@results_file}"))
 end

def analyze

if already parser worker is written , please replace Parser section code without comment ,And you can discard rest of lines untill end of method definition

#please check your parser worker in $APPLICATION_PATH/web/app/worker. 
 #worker name will be scaner_name_upload_worker.rb ex: arachni_upload_worker.rb 
##########################Parser section code##################
  #ZapUploadWorker.perform_async(@trigger.scan_id,@result_xml_path)
  ZapUploadWorker.new.perform(@trigger.scan_id,@results_file.path)
 # Above line upload the results to jackhammer

 rescue Exception => e
    Pipeline.warn e.message
    Pipeline.warn e.backtrace
 end

ensure

FileUtils.rm @results_file #file gets deleted after parsing is done

end

Check , if the scanner is installed

def supported? unless File.exist?('/home/app/ZAP_2.7.0') Pipeline.notify "Install zap-cli: 'pip install --upgrade zapcli'" return false else return true end

end

*****Scans log**

root@417f9b0dccf0:/home/app/log/scans# cat 6.log [2018-07-03 08:18:04 +0000] Loading scanner... [2018-07-03 08:18:04 +0000] Mounting ... https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:04 +0000] Mounting target: https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] In Docker mounter, target: https://prdpc02lu.paycash.eu/login?lang=en became: lang=en ... wondering if it matched .docker [2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Mounted https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:04 +0000] Processing target...https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:04 +0000] Running tasks in stage: wait [2018-07-03 08:18:04 +0000] Running tasks in stage: mount [2018-07-03 08:18:04 +0000] Running tasks in stage: file [2018-07-03 08:18:04 +0000] Running tasks in stage: code [2018-07-03 08:18:04 +0000] Running tasks in stage: live [2018-07-03 08:18:04 +0000] Running tasks in stage: done [2018-07-03 08:18:04 +0000] Have 0 items pre ZAP filter. [2018-07-03 08:18:04 +0000] Have 0 items post ZAP filter. [2018-07-03 08:18:04 +0000] Generating report...[:to_s] [2018-07-03 08:18:04 +0000] Running base reoprt... sending notification mail..for scan id.6 [2018-07-03 08:18:46 +0000] Loading scanner... [2018-07-03 08:18:46 +0000] Mounting ... https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:46 +0000] Mounting target: https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] In Docker mounter, target: https://prdpc02lu.paycash.eu/login?lang=en became: lang=en ... wondering if it matched .docker [2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Mounting https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Mounted https://prdpc02lu.paycash.eu/login?lang=en with # [2018-07-03 08:18:46 +0000] Processing target...https://prdpc02lu.paycash.eu/login?lang=en [2018-07-03 08:18:46 +0000] Running tasks in stage: wait [2018-07-03 08:18:46 +0000] Running tasks in stage: mount [2018-07-03 08:18:46 +0000] Running tasks in stage: file [2018-07-03 08:18:46 +0000] Running tasks in stage: code [2018-07-03 08:18:46 +0000] Running tasks in stage: live [2018-07-03 08:18:46 +0000] Running tasks in stage: done [2018-07-03 08:18:46 +0000] Have 0 items pre ZAP filter. [2018-07-03 08:18:46 +0000] Have 0 items post ZAP filter. [2018-07-03 08:18:46 +0000] Generating report...[:to_s] [2018-07-03 08:18:46 +0000] Running base reoprt...

dkogue commented 6 years ago

@KMadhuSudhan I will appreciate your feedback on the above log please. Also do think we can integrate SSlzye to jackhammer. wondering how we present the alert though. Any ideas from you will be appreciated. Thank you for your assistance through out.

dkogue commented 6 years ago

I had indicated this earlier, why default scans (Arachni, nmap) work for sometime and then after do not work when scan. the data base is very slow. same dynamicscan error message for all scan.

This is really, really frustrating. Even the demo site has some scans pending for days. giving up....

wheelq commented 5 years ago

Is the CLI still not supported? Is there any wrapper available?

rgplvr commented 5 years ago

you could start checking V2 which supports more options

On Thu, Apr 11, 2019 at 6:40 PM Michal Wiczynski notifications@github.com wrote:

Is the CLI still not supported? Is there any wrapper available?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/olacabs/jackhammer/issues/100#issuecomment-482107657, or mute the thread https://github.com/notifications/unsubscribe-auth/AHb61T5HFQAUgmU9rHUSQLSMtEe-ONo4ks5vfzRigaJpZM4Urro2 .

wheelq commented 5 years ago

thank you

rgplvr commented 5 years ago

there is a branch called v2

On Thu, Apr 11, 2019 at 8:35 PM Michal Wiczynski notifications@github.com wrote:

where can I find v2?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/olacabs/jackhammer/issues/100#issuecomment-482153083, or mute the thread https://github.com/notifications/unsubscribe-auth/AHb61QgSA7ojtFK4OESdNQDs5GORFc5eks5vf09EgaJpZM4Urro2 .