search

lancachenet / monolithic

A monolithic lancache service capable of caching all CDNs in a single instance
https://hub.docker.com/r/lancachenet/monolithic
Other
726 stars 73 forks source link

Windows Update + Origin failing #138

Closed ScottishTom closed 2 years ago

ScottishTom commented 2 years ago

Describe the issue you are having

Windows Update under Windows 10 and 11 are having issues with being unable to retrieve updates through the Lancache. Origin is also struggling unless I re-enable "safe downloads", which I believe bypasses the Lancache? Steam is functioning properly, as is Battle.NET.

Lancache is running on Ubuntu 20.04.3 LTS w/ Docker 20.10.7, which is itself running inside a Hyper-V VM on an HP Gen8 microserver running Windows Server 2019. It's been working fine until very recently, and I had not made any config changes between it working and it failing to do so.

I've tried some basic troubleshooting:

  1. Updating the cache container images via update_containers.sh
  2. Disabling 443 for the Monolithic container and using sniproxy instead, with no effect.
  3. Tried disabling the delivery optimization service on either Windows 10 or 11, with no effect.
  4. Both Win10 and Win11 devices can "see" there are updates available, they list them, they just cannot pull down the content.
  5. The only solution I've found so far is to bypass the cache entirely.
  6. Interestingly, my Server 2019 box (that hosts the Ubuntu instance that is my docker host) can still update from Windows Update just fine.

Please just say if there are further logs/details I can provide.

How are you running the container(s)

version: '2'
services:
  dns:
    image: lancachenet/lancache-dns:latest
    env_file: .env
    restart: unless-stopped
    ports:
      - ${DNS_BIND_IP}:53:53/udp
      - ${DNS_BIND_IP}:53:53/tcp

## HTTPS requests are now handled in monolithic directly
## you could choose to return to sniproxy if desired

#  sniproxy:
#    image: lancachenet/sniproxy:latest
#    env_file: .env
#    restart: unless-stopped
#    ports:
#      - 443:443/tcp

  monolithic:
    image: lancachenet/monolithic:latest
    env_file: .env
    restart: unless-stopped
    ports:
      - 80:80/tcp
      - 443:443/tcp
    volumes:
      - ${CACHE_ROOT}/cache:/data/cache
      - /tmp/logs:/data/logs

DNS Configuration

Client (e.g. 10.59.4.73) devices receives address of Ubuntu host (in my case 10.59.4.4) via DHCP from a pfSense router/firewall (10.59.4.1) which is also the Lancache's upstream DNS server.

Note that in following log, 10.59.4.75 is the Windows 10 box while 10.59.4.73 is the new Windows 11 install.

Output of container(s)

Snippet of Monolithic log output:

`[origin] 10.59.4.73 / - - - [06/Oct/2021:21:36:28 +0100] "GET /eamaster/s/shift/bejeweled/bejeweled_3/fg__ww_rtp_remaster/bejeweled_3pcfg__ww_rtp_remasterrun_1__origin__idjit_data_store9ffd15a4c5734d55950cd769b186d898.zip?nva=20211006204123&token=0d9e38b121ed254e38dfe HTTP/1.1" 206 0 "-" "Mozilla/5.0 EA Download Manager Origin/10.5.105.49133" "MISS" "lvlt.cdn.ea.com" "bytes=1384594358-1384602549"
[origin] 10.59.4.73 / - - - [06/Oct/2021:21:36:28 +0100] "GET /eamaster/s/shift/bejeweled/bejeweled_3/fg__ww_rtp_remaster/bejeweled_3pcfg__ww_rtp_remasterrun_1__origin__idjit_data_store9ffd15a4c5734d55950cd769b186d898.zip?nva=20211006204123&token=0d9e38b121ed254e38dfe HTTP/1.1" 206 0 "-" "Mozilla/5.0 EA Download Manager Origin/10.5.105.49133" "MISS" "lvlt.cdn.ea.com" "bytes=1384594358-1384602549"
[origin] 10.59.4.73 / - - - [06/Oct/2021:21:36:30 +0100] "GET /eamaster/s/shift/bejeweled/bejeweled_3/fg__ww_rtp_remaster/bejeweled_3pcfg__ww_rtp_remasterrun_1__origin__idjit_data_store9ffd15a4c5734d55950cd769b186d898.zip?nva=20211006204123&token=0d9e38b121ed254e38dfe HTTP/1.1" 206 0 "-" "Mozilla/5.0 EA Download Manager Origin/10.5.105.49133" "MISS" "lvlt.cdn.ea.com" "bytes=1384594358-1384602549"
[origin] 10.59.4.73 / - - - [06/Oct/2021:21:36:31 +0100] "GET /eamaster/s/shift/bejeweled/bejeweled_3/fg__ww_rtp_remaster/bejeweled_3pcfg__ww_rtp_remasterrun_1__origin__idjit_data_store9ffd15a4c5734d55950cd769b186d898.zip?nva=20211006204123&token=0d9e38b121ed254e38dfe HTTP/1.1" 206 0 "-" "Mozilla/5.0 EA Download Manager Origin/10.5.105.49133" "MISS" "lvlt.cdn.ea.com" "bytes=1384594358-1384602549"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:39:46 +0100] "GET /filestreamingservice/files/d380c779-ec75-4409-b889-a4bb1670ee89?P1=1633553166&P2=404&P3=2&P4=OufrapETW%2fEv4C7n4SqfYF5lv2qPPbd3LXjF8b%2bQ9xiyC5Exlpa1HziYrhCpsCLW4VT88f9CDWjpDJMcwlOcNA%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-59578"
[wsus] 10.59.4.75 / - - - [06/Oct/2021:21:39:48 +0100] "GET /filestreamingservice/files/3816e6dd-340f-4b0d-a435-297faeb7034b?P1=1633548831&P2=404&P3=2&P4=hd1KYQt6Dzpg2kbDJzJ0v0p4ohURZUvwRw8QZ4mYx4qbe9UsDSscrLZ2JHiDsxiuPlzIIzXFWbqVyOCkmD1kfw%3d%3d HTTP/1.1" 403 392 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "2.tlu.dl.delivery.mp.microsoft.com" "bytes=0-1"
[wsus] 10.59.4.75 / - - - [06/Oct/2021:21:39:48 +0100] "GET /filestreamingservice/files/ad07577e-fd57-48d9-a3b2-8067e7bc1c7a?P1=1633548790&P2=404&P3=2&P4=PAs%2f8DQqS1EsB7Hv3Wcu97AQJM4Tws0l2V%2f2vpjEW9dGqiTvJvX4Tp6ovChfSO27mWGO4Gq4pczEh1zNy5MyXQ%3d%3d HTTP/1.1" 403 392 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "2.tlu.dl.delivery.mp.microsoft.com" "bytes=0-1"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:39:52 +0100] "GET /filestreamingservice/files/223ea7ca-c16d-4fd2-a42b-bb0e0a2b2e65?P1=1633553172&P2=404&P3=2&P4=BxB0r%2f9CPPRuCDA3LGh5Mf%2f46SEmJJtPp%2b2dAPloLUfQBaT4nhg1frVUJIL0w0gL5ATH0fqVK2seytHqnu%2fjeg%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-60160"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:40:08 +0100] "GET /filestreamingservice/files/18e52a4c-c538-4bcd-a096-ba1952c1107f?P1=1633553188&P2=404&P3=2&P4=YxjxTrQFMfGTbQm9LZ1WXDLx5MGL1wm%2fVcR4KmQiSLJasCiBpzzDM9OCzCrB9TOfrPNe93rRIehczVvp6fPDdA%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-972951"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:41:06 +0100] "GET /msdownload/update/v3/static/trustedr/en/authrootstl.cab?550391f3a87e791c HTTP/1.1" 304 0 "-" "Microsoft-CryptoAPI/10.0" "-" "ctldl.windowsupdate.com" "-"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:43:46 +0100] "GET /filestreamingservice/files/d380c779-ec75-4409-b889-a4bb1670ee89?P1=1633553166&P2=404&P3=2&P4=OufrapETW%2fEv4C7n4SqfYF5lv2qPPbd3LXjF8b%2bQ9xiyC5Exlpa1HziYrhCpsCLW4VT88f9CDWjpDJMcwlOcNA%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-59578"
[wsus] 10.59.4.75 / - - - [06/Oct/2021:21:43:48 +0100] "GET /filestreamingservice/files/3816e6dd-340f-4b0d-a435-297faeb7034b?P1=1633548831&P2=404&P3=2&P4=hd1KYQt6Dzpg2kbDJzJ0v0p4ohURZUvwRw8QZ4mYx4qbe9UsDSscrLZ2JHiDsxiuPlzIIzXFWbqVyOCkmD1kfw%3d%3d HTTP/1.1" 403 392 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "2.tlu.dl.delivery.mp.microsoft.com" "bytes=0-1"
[wsus] 10.59.4.75 / - - - [06/Oct/2021:21:43:48 +0100] "GET /filestreamingservice/files/ad07577e-fd57-48d9-a3b2-8067e7bc1c7a?P1=1633548790&P2=404&P3=2&P4=PAs%2f8DQqS1EsB7Hv3Wcu97AQJM4Tws0l2V%2f2vpjEW9dGqiTvJvX4Tp6ovChfSO27mWGO4Gq4pczEh1zNy5MyXQ%3d%3d HTTP/1.1" 403 392 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "2.tlu.dl.delivery.mp.microsoft.com" "bytes=0-1"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:43:54 +0100] "GET /filestreamingservice/files/223ea7ca-c16d-4fd2-a42b-bb0e0a2b2e65?P1=1633553172&P2=404&P3=2&P4=BxB0r%2f9CPPRuCDA3LGh5Mf%2f46SEmJJtPp%2b2dAPloLUfQBaT4nhg1frVUJIL0w0gL5ATH0fqVK2seytHqnu%2fjeg%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-60160"
[wsus] 10.59.4.73 / - - - [06/Oct/2021:21:44:08 +0100] "GET /filestreamingservice/files/18e52a4c-c538-4bcd-a096-ba1952c1107f?P1=1633553188&P2=404&P3=2&P4=YxjxTrQFMfGTbQm9LZ1WXDLx5MGL1wm%2fVcR4KmQiSLJasCiBpzzDM9OCzCrB9TOfrPNe93rRIehczVvp6fPDdA%3d%3d HTTP/1.1" 206 0 "-" "Microsoft-Delivery-Optimization/10.0" "MISS" "tlu.dl.delivery.mp.microsoft.com" "bytes=0-972951"`
MathewBurnett commented 2 years ago

Do your clients have more than one DNS server set? it sounds like some requests are bypassing the cache. You snippet is demonstrating that the cache is working as those MISS lines are it fetching and returning files it did not have.

ScottishTom commented 2 years ago

No sir, only a single DNS server set - 10.59.4.4, which is the LANCache's IP address. The only machine on my network that goes to a different DNS server is the LANCache VM itself.

wiseryfendy commented 2 years ago

Hi,

I am also having the same problem with windows update... Have this issue resolve?