TrivadisPF / platys-modern-data-platform

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
Apache License 2.0
68 stars 15 forks source link

STREAMSETS_volume_map_data: true with issues #600

Open johnfelipe opened 1 year ago

johnfelipe commented 1 year ago
CONTAINER ID   IMAGE                             COMMAND                  CREATED              STATUS                         PORTS                                       NAMES
eb02d566c0b7   streamsets/datacollector:3.22.2   "/pre-docker-entrypo…"   About a minute ago   Restarting (1) 5 seconds ago                                               streamsets-1
33c29d847804   trivadis/markdown-web:latest      "/bin/sh -c 'FLASK_A…"   10 minutes ago       Up 9 minutes                   0.0.0.0:80->80/tcp, :::80->80/tcp           markdown-viewer
b094cce2c5f6   wettyoss/wetty:latest             "yarn start"             10 minutes ago       Up 9 minutes                   0.0.0.0:3001->3000/tcp, :::3001->3000/tcp   wetty

with true generate error, NOT STARTED with false ALL OK I need put that in true for map data

johnfelipe commented 1 year ago

https://gist.github.com/1671ef035f023ecdb9fa018baebc2377

gschmutz commented 1 year ago

works for me in a VM using Linux, do you run docker on Windows?

johnfelipe commented 1 year ago

can u send me example of all configuration of streamset, because im using VM to

El mié, 16 nov 2022 a las 1:40, Guido Schmutz @.***>) escribió:

works for me in a VM using Linux, do you run docker on Windows?

— Reply to this email directly, view it on GitHub https://github.com/TrivadisPF/platys-modern-data-platform/issues/600#issuecomment-1316453814, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADIWFDF56PFOWYPMBCLJULWIR6VRANCNFSM6AAAAAAR3NSOFI . You are receiving this because you authored the thread.Message ID: @.***>

johnfelipe commented 1 year ago
     # =====  Streamsets Data Collector ========
      #
      STREAMSETS_enable: true
      STREAMSETS_volume_map_data: true
      STREAMSETS_volume_map_logs: true
      STREAMSETS_volume_map_security_policy: false
      STREAMSETS_activate_https: false
      STREAMSETS_additional_port_mappings: 0
      STREAMSETS_kafka_support: false
      STREAMSETS_aws_support: false
      STREAMSETS_google_support: true
      STREAMSETS_azure_support: false
      STREAMSETS_nosql_support: true
      # some values for stage libs:  'streamsets-datacollector-apache-kafka_2_6-lib,streamsets-datacollector-aws-lib,streamsets-datacollector-azure-lib,streamsets-datacollector-groovy_2_4-lib,streamsets-datacollector-jdbc-lib'
      # https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Installation/AddtionalStageLibs.html
      STREAMSETS_stage_libs: 'streamsets-datacollector-apache-kafka_2_6-lib,streamsets-datacollector-aws-lib,streamsets-datacollector-azure-lib,streamsets-datacollector-groovy_2_4-lib,streamsets-datacollector-jdbc-lib'
      STREAMSETS_enterprise_stage_libs: ''
      STREAMSETS_jdbc_jars: ''
      STREAMSETS_install_pipelines: false
      # one of 'none', 'basic', 'digest', 'form' or 'aster'
      STREAMSETS_http_authentication: 'form'
      STREAMSETS_sdc_id: ''
      STREAMSETS_use_external_conf_file: false

docker logs -f streamsets-1 this is log: https://gist.github.com/88a3640877dd1e016a6b1c8c09e9ca3a

johnfelipe commented 1 year ago

still with issue, pls share your configurable file for replication in my side pls

johnfelipe commented 1 year ago

can u send me example of all configuration of streamset, because im using VM to El mié, 16 nov 2022 a las 1:40, Guido Schmutz @.>) escribió: works for me in a VM using Linux, do you run docker on Windows? — Reply to this email directly, view it on GitHub <#600 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADIWFDF56PFOWYPMBCLJULWIR6VRANCNFSM6AAAAAAR3NSOFI . You are receiving this because you authored the thread.Message ID: @.>

pls share me your docker version and your docker compose version, for do changes

johnfelipe commented 1 year ago

https://gist.github.com/johnfelipe/88a3640877dd1e016a6b1c8c09e9ca3a?permalink_comment_id=4372882#gistcomment-4372882