search

lensesio / fast-data-dev

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
https://lenses.io
Apache License 2.0
2.01k stars 330 forks source link

Is This Docker Image Usable Within CI Build Environments Such As Travis or GitLab? #167

Open dcs3spp opened 3 years ago

dcs3spp commented 3 years ago

Hi,

Can lensesio/fast-data-dev be used within a CI environment, such as Gitlab or Travis?

I have the following Gitlab CI job for running tests. Setting ADV_HOST to the kafka container on the same docker network via Gitlab CI services. The job hangs when trying to contact the kafak container.

GitLab CI Job

tests:
  stage: test
  variables:
    ADV_HOST: kafka
    DISABLE: azure-documentdb,blockchain,bloomberg,cassandra,coap,druid,elastic,elastic5,ftp,hazelcast,hbase,influxdb,jms,kudu,mongodb,mqtt,redis,rethink,voltdb,yahoo,hdfs,jdbc,elasticsearch,s3,twitter
    CONNECT_HEAP: 512m
    MINIO_BUCKET: images
    SAMPLEDATA: 0
    REST_PORT: 8082
    FORWARDLOGS: 0
    RUNTESTS: 0
    DISABLE_JMX: 1
    WEB_PORT: 0
    DISABLE: hive-1.1

  ##
  # Services
  # - Kafka
  # - Mosquitto (MQTT)
  # - Minio (S3)
  ##
  services:
  - name: lensesio/fast-data-dev:2.5.1-L0
    alias: kafka
  - name: dcs3spp/minio:version-1.0.2
    alias: minio
  - name: eclipse-mosquitto:1.6.9
    alias: mqtt

  script:
    - >
      dotnet test --no-restore
      --logger:trx
      --settings:Tests/coverlet.runsettings
      --collect:"XPlat Code Coverage"
      WebApp.sln

CI job hangs trying to contact kafka container

info: WebApp.Kafka.Admin.KafkaAdminService[0]
      Admin service trying to create Kafka Topic...
info: WebApp.Kafka.Admin.KafkaAdminService[0]
      Topic::eventbus, ReplicationCount::1, PartitionCount::3
info: WebApp.Kafka.Admin.KafkaAdminService[0]
      Bootstrap Servers::kafka:9092