threatgrid / ctia

Cisco Threat Intelligence API
Eclipse Public License 1.0
69 stars 26 forks source link

Enable auth in migration params schema #1432

Closed ereteog closed 4 months ago

ereteog commented 4 months ago

Related XDR-5272

Fix CTIA migration configuraiton schema to accept authentication

2024-06-25T14:53:45.274Z INFO (main) [ctia.task.migration.migrate-es-stores] - migration started {:buffer-size 3, :store {:es {:default {:protocol :https, :host "int-es7-storage.es.vpce.us-east-1.aws.elastic-cloud.com", :auth {:params {:pwd "zGHz6L5gf1PsMxf86LAxIkWG", :user "elastic"}, :type :basic-auth}, :port 443, :version 7}, :migration {:indexname "ctia_migration"}}}, :migration-id "elastic-migration", :restart? nil, :prefix "2.0.0", :store-keys (:actor :attack-pattern :campaign :coa :feed :feedback :indicator :judgement :malware :relationship :sighting :tool :vulnerability :weakness), :migrations (:identity), :confirm? true, :batch-size 6000}
2024-06-25T14:53:45.280Z ERROR (main) [ctia.task.migration.migrate-es-stores] - Unexpected error during migration
clojure.lang.ExceptionInfo: Input to check-migration-params does not match schema:

           [(named {:store {:es {:default {:auth disallowed-key}}}} arg0) nil]

        at ctia.task.migration.migrate_es_stores$eval100649$check_migration_params__100654.invoke(migrate_es_stores.clj:283)
        at ctia.task.migration.migrate_es_stores$eval100709$run_migration__100714$fn__100715.invoke(migrate_es_stores.clj:325)
        at ctia.task.migration.migrate_es_stores$eval100709$run_migration__100714.invoke(migrate_es_stores.clj:310)
        at ctia.task.migration.migrate_es_stores$_main.invokeStatic(migrate_es_stores.clj:357)
        at ctia.task.migration.migrate_es_stores$_main.doInvoke(migrate_es_stores.clj:345)
        at clojure.lang.RestFn.applyTo(RestFn.java:137)
        at clojure.lang.Var.applyTo(Var.java:705)
        at clojure.core$apply.invokeStatic(core.clj:667)
        at clojure.main$main_opt.invokeStatic(main.clj:514)
        at clojure.main$main_opt.invoke(main.clj:510)
        at clojure.main$main.invokeStatic(main.clj:664)
        at clojure.main$main.doInvoke(main.clj:616)
        at clojure.lang.RestFn.applyTo(RestFn.java:137)
        at clojure.lang.Var.applyTo(Var.java:705)
        at clojure.main.main(main.java:40) 

§ QA

No QA is needed.