Error: invalid IP address in add-host: "host-gateway"

Issue Description

I get this error when running podman with --add-host host.docker.internal:host-gateway

podman run --name=danswer-stack_api_server_1 -d --requires=danswer-stack_relational_db_1,danswer-stack_index_1 --label io.podman.compose.config-hash=1429214656ab9b9e6f56b3325f6dc5f4a5a6bc085982746309c2102607272a9a --label io.podman.compose.project=danswer-stack --label io.podman.compose.version=1.0.6 --label PODMAN_SYSTEMD_UNIT=podman-compose@danswer-stack.service --label com.docker.compose.project=danswer-stack --label com.docker.compose.project.working_dir=/opt/devts/danswer/deployment/docker_compose --label com.docker.compose.project.config_files=docker-compose.yml --label com.docker.compose.container-number=1 --label com.docker.compose.service=api_server -e AUTH_TYPE=disabled -e SESSION_EXPIRE_TIME_SECONDS=86400 -e VALID_EMAIL_DOMAINS= -e GOOGLE_OAUTH_CLIENT_ID= -e GOOGLE_OAUTH_CLIENT_SECRET= -e REQUIRE_EMAIL_VERIFICATION= -e SMTP_SERVER= -e SMTP_PORT=587 -e SMTP_USER= -e SMTP_PASS= -e EMAIL_FROM= -e GEN_AI_MODEL_PROVIDER= -e GEN_AI_MODEL_VERSION= -e FAST_GEN_AI_MODEL_VERSION= -e GEN_AI_API_KEY= -e GEN_AI_API_ENDPOINT= -e GEN_AI_API_VERSION= -e GEN_AI_LLM_PROVIDER_TYPE= -e GEN_AI_MAX_TOKENS= -e QA_TIMEOUT= -e MAX_CHUNKS_FED_TO_CHAT= -e DISABLE_LLM_FILTER_EXTRACTION= -e DISABLE_LLM_CHUNK_FILTER= -e DISABLE_LLM_CHOOSE_SEARCH= -e DISABLE_LLM_QUERY_REPHRASE= -e DISABLE_GENERATIVE_AI= -e DOC_TIME_DECAY= -e HYBRID_ALPHA= -e EDIT_KEYWORD_QUERY= -e MULTILINGUAL_QUERY_EXPANSION= -e QA_PROMPT_OVERRIDE= -e POSTGRES_HOST=relational_db -e VESPA_HOST=index -e WEB_DOMAIN= -e DOCUMENT_ENCODER_MODEL= -e DOC_EMBEDDING_DIM= -e NORMALIZE_EMBEDDINGS= -e ASYM_QUERY_PREFIX= -e ENABLE_RERANKING_REAL_TIME_FLOW= -e ENABLE_RERANKING_ASYNC_FLOW= -e MODEL_SERVER_HOST= -e MODEL_SERVER_PORT= -e DISABLE_TELEMETRY= -e LOG_LEVEL=info -e LOG_ALL_MODEL_INTERACTIONS= -e LOG_VESPA_TIMING_INFORMATION= -e HTTP_PROXY=http://proxy-priv.coface.dns:8080 -e HTTPS_PROXY=http://proxy-priv.coface.dns:8080 -v danswer-stack_local_dynamic_storage:/home/storage -v danswer-stack_file_connector_tmp_storage:/home/file_connector_storage -v danswer-stack_model_cache_torch:/root/.cache/torch/ -v danswer-stack_model_cache_nltk:/root/nltk_data/ -v danswer-stack_model_cache_huggingface:/root/.cache/huggingface/ --net danswer-stack_default --network-alias api_server --log-driver=json-file --log-opt=max-size=50m --log-opt=max-file=6 --add-host host.docker.internal:host-gateway -p 8080:8080 --restart always danswer/danswer-backend:latest /bin/sh -c alembic upgrade head && echo "Starting Danswer Api Server" && uvicorn danswer.main:app --host 0.0.0.0 --port 8080
Error: invalid IP address in add-host: "host-gateway"
exit code: 125

Steps to reproduce the issue

git clone https://github.com/danswer-ai/danswer.git
cd danswer/deployment/docker_compose
mv docker-compose.dev.yaml docker-compose.yaml
add name:danswer-stack to the docker-compose.yaml
podman-compose up -d --pull-always --force-recreate api_server

Describe the results you received

Error: invalid IP address in add-host: "host-gateway" when starting api_server service

Describe the results you expected

Container api_server started

podman info output

host:
  arch: amd64
  buildahVersion: 1.31.3
  cgroupControllers:
  - memory
  - pids
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: conmon-2.1.8-1.el9.x86_64
    path: /usr/bin/conmon
    version: 'conmon version 2.1.8, commit: aadb7c890ac6283eb4666d92690238e5fbdec5c7'
  cpuUtilization:
    idlePercent: 99.35
    systemPercent: 0.42
    userPercent: 0.23
  cpus: 8
  databaseBackend: boltdb
  distribution:
    distribution: '"rhel"'
    version: "9.3"
  eventLogger: file
  freeLocks: 2041
  hostname: frdevllm01.coface.dns
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 30600513
      size: 1
    - container_id: 1
      host_id: 10000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 30665244
      size: 1
    - container_id: 1
      host_id: 10000
      size: 65536
  kernel: 5.14.0-362.18.1.el9_3.x86_64
  linkmode: dynamic
  logDriver: k8s-file
  memFree: 14376583168
  memTotal: 33373888512
  networkBackend: netavark
  networkBackendInfo:
    backend: netavark
    dns:
      package: aardvark-dns-1.7.0-1.el9.x86_64
      path: /usr/libexec/podman/aardvark-dns
      version: aardvark-dns 1.7.0
    package: netavark-1.7.0-2.el9_3.x86_64
    path: /usr/libexec/podman/netavark
    version: netavark 1.7.0
  ociRuntime:
    name: crun
    package: crun-1.8.7-1.el9.x86_64
    path: /usr/bin/crun
    version: |-
      crun version 1.8.7
      commit: 53a9996ce82d1ee818349bdcc64797a1fa0433c4
      rundir: /run/user/30665244/crun
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL
  os: linux
  pasta:
    executable: ""
    package: ""
    version: ""
  remoteSocket:
    path: /run/user/30665244/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    seccompProfilePath: /usr/share/containers/seccomp.json
    selinuxEnabled: false
  serviceIsRemote: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: slirp4netns-1.2.1-1.el9.x86_64
    version: |-
      slirp4netns version 1.2.1
      commit: 09e31e92fa3d2a1d3ca261adaeb012c8d75a8194
      libslirp: 4.4.0
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.5.2
  swapFree: 4293914624
  swapTotal: 4294963200
  uptime: 97h 9m 56.00s (Approximately 4.04 days)
plugins:
  authorization: null
  log:
  - k8s-file
  - none
  - passthrough
  - journald
  network:
  - bridge
  - macvlan
  - ipvlan
  volume:
  - local
registries:
  search:
  - registry.access.redhat.com
  - registry.redhat.io
  - docker.io
store:
  configFile: /ad_users/olivier_levillain/.config/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions: {}
  graphRoot: /ad_users/olivier_levillain/.local/share/containers/storage
  graphRootAllocated: 268424970240
  graphRootUsed: 131569205248
  graphStatus:
    Backing Filesystem: xfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
    Using metacopy: "false"
  imageCopyTmpDir: /opt/lorax/tmp
  imageStore:
    number: 58
  runRoot: /run/user/30665244/containers
  transientStore: false
  volumePath: /ad_users/olivier_levillain/.local/share/containers/storage/volumes
version:
  APIVersion: 4.6.1
  Built: 1701529524
  BuiltTime: Sat Dec  2 16:05:24 2023
  GitCommit: ""
  GoVersion: go1.20.10
  Os: linux
  OsArch: linux/amd64
  Version: 4.6.1

Podman in a container

Privileged Or Rootless

Rootless

Upstream Latest Release

Additional environment details

No response

Additional information

I saw #8466 issue is closed because it should be supported but it looks like it isn't

containers / podman

Error: invalid IP address in add-host: "host-gateway" #22186