search

cloudera-labs / cloudera.cluster

An Ansible collection for lifecycle and management of Cloudera CDP Private Cloud resources on bare metal, IaaS, and PaaS.
Apache License 2.0
32 stars 46 forks source link

Update AWS_S3 service validation #162

Closed wmudge closed 7 months ago

wmudge commented 8 months ago

Discussed in https://github.com/cloudera-labs/cloudera.cluster/discussions/156

Originally posted by **hadoopch** November 3, 2023 Hi all, AWS_S3 is different than the other services. You don't assign it to any host. Furthermore you don't have instance related scope of configuration (SERVICEWIDE, SERVER, ...). Therefore it is not clear how to define it in the definition.yml. Verify will not accept a defintion without a host template. I tried it via --skip-tags verify. Service was added but the configuration was not applied. ``` configs: AWS_S3: cloud_account: obsbackup s3_endpoint: "obs.mydomain.com" AWS_S3_service_env_safety_valve: "path_style_access=true\nsigning_algorithm=S3SignerType\nconnection_ssl_enabled=false\nmultiobjectdelete_enable=true\nfast_upload=true\nendpoint_region=eu-ch2" INFRA_SOLR: SOLR_SERVER: solr_hdfs_blockcache_slab_count: 93 process_auto_restart: true solr_java_heapsize: "{{12*1024**3}}" solr_java_direct_memory_size: "{{16*1024**3}}" ``` Who can support ? Best regards Uli
wmudge commented 7 months ago

Fixed in #161

hadoopch commented 6 months ago

It's working

   configs:
      AWS_S3:
        SERVICEWIDE:
          cloud_account: obsbackup
          s3_endpoint:  "obs.{{ep_suffix}}"

you don't have to use it in the host_templates