search

lancachenet / monolithic

A monolithic lancache service capable of caching all CDNs in a single instance
https://hub.docker.com/r/lancachenet/monolithic
Other
726 stars 73 forks source link

Unreal Engine Fails to download with MD-DL #108

Closed CanisHelix closed 1 year ago

CanisHelix commented 4 years ago

Describe the issue you are having

Since implementing the monolithic cache I am unable to download Unreal Engine 4.23.4 (and probably other versions)

How are you running the container(s)

version: '2'
services:
#  dns:
#    image: lancachenet/lancache-dns:latest
#    env_file: .env
#    restart: unless-stopped
#    ports:
#      - ${DNS_BIND_IP}:53:53/udp
  sniproxy:
    image: lancachenet/sniproxy:latest
    env_file: .env
#    restart: unless-stopped
    ports:
      - 443:443/tcp
  monolithic:
    image: lancachenet/monolithic:latest
    env_file: .env
#    restart: unless-stopped
    ports:
      - 80:80/tcp
    volumes:
      - ${CACHE_ROOT}/cache:/data/cache
      - ${CACHE_ROOT}/logs:/data/logs

DNS Configuration

I have put the following in my /var/unbound/conf.d/ folder on pfSense and I'm including /var/unbond/conf.d/*.conf

server:
  local-zone: "epicgames-download1.akamaized.net" redirect
  local-data: "epicgames-download1.akamaized.net 30 IN A 10.25.0.201"
  local-zone: "download.epicgames.com" redirect
  local-data: "download.epicgames.com 30 IN A 10.25.0.201"
  local-zone: "download2.epicgames.com" redirect
  local-data: "download2.epicgames.com 30 IN A 10.25.0.201"
  local-zone: "download3.epicgames.com" redirect
  local-data: "download3.epicgames.com 30 IN A 10.25.0.201"
  local-zone: "download4.epicgames.com" redirect
  local-data: "download4.epicgames.com 30 IN A 10.25.0.201"
CanisHelix commented 4 years ago

/logs/access.log from this time shows the following:

[epicgames] 172.18.0.1 / 10.25.0.40 - - [30/Mar/2020:11:15:19 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest HTTP/1.0" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "-" "epicgames-download1.akamaized.net" "bytes=0-1048575"
[epicgames] 10.25.0.40 / - - - [30/Mar/2020:11:15:19 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest HTTP/1.1" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "MISS" "epicgames-download1.akamaized.net" "-"
[epicgames] 172.18.0.1 / 10.25.0.40 - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.0" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "-" "download.epicgames.com" "bytes=0-1048575"
[epicgames] 10.25.0.40 / - - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.1" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "MISS" "download.epicgames.com" "-"
[epicgames] 172.18.0.1 / 10.25.0.40 - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.0" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "-" "download2.epicgames.com" "bytes=0-1048575"
[epicgames] 10.25.0.40 / - - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.1" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "MISS" "download2.epicgames.com" "-"
[epicgames] 172.18.0.1 / 10.25.0.40 - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.0" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "-" "download3.epicgames.com" "bytes=0-1048575"
[epicgames] 10.25.0.40 / - - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.1" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "MISS" "download3.epicgames.com" "-"
[epicgames] 172.18.0.1 / 10.25.0.40 - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.0" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "-" "download4.epicgames.com" "bytes=0-1048575"
[epicgames] 10.25.0.40 / - - - [30/Mar/2020:11:15:20 +0100] "GET /Builds/Rocket/Automated/Engine/CloudDir/cYiUOBzQbIx6kgokk0iweeW0If8BDw.manifest?Policy=eyJTdGF0ZW1lbnQiOiBbeyJSZXNvdXJjZSI6IipCdWlsZHMvUm9ja2V0L0F1dG9tYXRlZC9FbmdpbmUvQ2xvdWREaXIvY1lpVU9CelFiSXg2a2dva2swaXdlZVcwSWY4QkR3Lm1hbmlmZXN0IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNTg1NTY1MTE5fSwiSXBBZGRyZXNzIjp7IkFXUzpTb3VyY2VJcCI6IjAuMC4wLjAvMCJ9fX1dfQ__&Signature=WhjNN35JxctcvjJ8wNpV~w1iOW4Dlig-Hab4ssxzjqfDyTPBcbHv3izZXH~XMIrfpIRvp7esM3sTjWLjBSgnBV-vcKjPEhYm0KtUxehpXsIbxuYEwZXDqsanSvBzxT7M9LHL4fm4DJXdOySPMN2UV8ZmJy1g5hvJLeTGDzaiyVp0gx7VofrblfuDUl7LIpxu-RQLFt4STvCbBKk9U5rb3UKXZ9bTPjg4I7vz3VNxVKARuHrLqxxICg1MoUifUJqbZKCt0x4MrwLDtZrKjj4UDQW4NhAGKhTtguMncMu~I6LUpnreu2zlnIGMo-OwAzEEev3rIdml7dRHHE4Ri7K8Pw__&Key-Pair-Id=APKAI5CNFPJPTPYZISXQ HTTP/1.1" 508 0 "-" "EpicGamesLauncher/10.15.2-12451672+++Portal+Release-Live Windows/10.0.18363.1.256.64bit" "MISS" "download4.epicgames.com" "-"