search

lancachenet / monolithic

A monolithic lancache service capable of caching all CDNs in a single instance
https://hub.docker.com/r/lancachenet/monolithic
Other
726 stars 73 forks source link

Getting Invalid HTTP response for depot 551 and Disabling dual-stack for this connection #107

Closed nigelks closed 1 year ago

nigelks commented 4 years ago

Describe the issue you are having

Games are not caching in full, example: CSGO is 10GBs, actual cached amount is only about 1-2GBs, logs on the lancache shows a few HITs, then pauses with no output.

How are you running the container(s)

Docker, on Ubuntu in proxmox Monolithic:

 docker run \
  --restart unless-stopped \
  --name lancache \
  -v /cache/data:/data/cache \
  -v /cache/logs:/data/logs \
  -p 192.168.1.115:80:80 \
  `lancachenet/monolithic:latest

Lancache-DNS

docker run --name lancache-dns -p 192.168.1.115:53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=192.168.1.115 lancachenet/lancache-dns:latest

Sniproxy

docker run --name sniproxy -p 443:443 `lancachenet/sniproxy:latest

DNS Configuration

C:\Users\User>nslookup steamcontent.com
Server:  UnKnown
Address:  192.168.1.115

Non-authoritative answer:
Name:    steam.cache.lancache.net
Address:  192.168.1.115
Aliases:  steamcontent.com

Output of container(s)

Nothing out of the ordinary, except when downloading from steam, at the start of the download the access logs shows a lot of "HITS" but after awhile it pauses with occasional "HITS" and "MISS".

The bigger problem here is from the Steam Content Logs:

[2020-03-20 20:08:53] Adding cache type 'LANCache' on host '::ffff:c0a8:173'
[2020-03-20 20:08:54] Got 6 download sources and 0 caching proxies via ContentServerDirectoryService::BYieldingGetServersForSteamPipe (72/0)
[2020-03-20 20:08:54] Created download interface of type 'SteamCache' (7) to host cache5-hkg1.steamcontent.com (cache5-hkg1.steamcontent.com)
[2020-03-20 20:08:54] Created download interface of type 'CDN' (2) to host steam.apac.qtlglb.com (steam.apac.qtlglb.com)
[2020-03-20 20:08:54] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): ::ffff:c0a8:173/depot/732/manifest/8652169025317368564/5 - received 200 (OK) HTTP response
[2020-03-20 20:08:54] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): CDepotHTTPDownloadInterface::BYldTestConnection - Server response 'OK' (200)
[2020-03-20 20:08:54] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): ::ffff:c0a8:173/depot/735/manifest/3867231304834558645/5 - received 200 (OK) HTTP response
[2020-03-20 20:08:55] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): ::ffff:c0a8:173/depot/731/manifest/7867263815789485437/5 - received 200 (OK) HTTP response
[2020-03-20 20:08:55] AppID 730 update changed : Running,
[2020-03-20 20:08:55] AppID 730 update changed : Running,Validating,
[2020-03-20 20:08:55] Validating files (new target,full) ...
[2020-03-20 20:08:55] File validation finished: 3008 files (23229284955 bytes) total, 3008 files (23229284955 bytes) mismatched (79 msec).
[2020-03-20 20:08:55] AppID 730 update changed : Running,
[2020-03-20 20:08:55] AppID 730 update changed : Running,Preallocating,
[2020-03-20 20:08:55] AppID 730 update changed : Running,
[2020-03-20 20:08:55] AppID 730 update started : download 0/10741793568, store 0/0, reuse 0/0, delta 0/0, stage 0/23229284955 
[2020-03-20 20:08:55] AppID 730 state changed : Update Required,Update Queued,Update Running,Update Started,
[2020-03-20 20:08:55] AppID 730 update changed : Running,Downloading,
[2020-03-20 20:08:55] AppID 730 update changed : Running,Downloading,Staging,
[2020-03-20 20:08:55] Downloading 512 chunks from depot 732
[2020-03-20 20:08:55] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): AuthenticateDepotID (732) - Success!
[2020-03-20 20:08:55] AppID 730 scheduler update : Priority Last, legacy=no, restore="", timeSinceLastPlayed=2, appDisableSecondsRemaining=0
[2020-03-20 20:08:56] Forgetting cache type 'LANCache' on host '::ffff:c0a8:173' due to chunk timeout.
[2020-03-20 20:08:56] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:08:56] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): Disabling dual-stack for this connection
[2020-03-20 20:09:00] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:00] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): Disabling dual-stack for this connection
[2020-03-20 20:09:00] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:00] HTTP (CDN,19) - steam.apac.qtlglb.com (192.168.1.115:80 / 192.168.1.115:80, host: steam.apac.qtlglb.com): Closing connection
[2020-03-20 20:09:00] Created download interface of type 'SteamCache' (7) to host cache3-tyo2.steamcontent.com (cache3-tyo2.steamcontent.com)
[2020-03-20 20:09:00] Created download interface of type 'CDN' (2) to host steampipe.akamaized.net (steampipe.akamaized.net)
[2020-03-20 20:09:01] HTTP (CDN,11) - steampipe.akamaized.net (192.168.1.115:443 / 192.168.1.115:443, host: steampipe.akamaized.net): CDepotHTTPDownloadInterface::BYldTestConnection - Server response 'OK' (200)
[2020-03-20 20:09:01] HTTP (CDN,11) - steampipe.akamaized.net (192.168.1.115:443 / 192.168.1.115:443, host: steampipe.akamaized.net): AuthenticateDepotID (732) - Success!
[2020-03-20 20:09:01] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:01] HTTP (SteamCache,289) - cache5-hkg1.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache5-hkg1.steamcontent.com): Closing connection
[2020-03-20 20:09:01] Created download interface of type 'SteamCache' (7) to host cache4-tyo2.steamcontent.com (cache4-tyo2.steamcontent.com)
[2020-03-20 20:09:01] HTTP (SteamCache,75) - cache3-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache3-tyo2.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:01] HTTP (SteamCache,75) - cache3-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache3-tyo2.steamcontent.com): Disabling dual-stack for this connection
[2020-03-20 20:09:01] HTTP (SteamCache,75) - cache3-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache3-tyo2.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:01] HTTP (SteamCache,75) - cache3-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache3-tyo2.steamcontent.com): Closing connection
[2020-03-20 20:09:01] Created download interface of type 'CDN' (2) to host f3b7q2p3.map2.ssl.hwcdn.net (f3b7q2p3.map2.ssl.hwcdn.net)
[2020-03-20 20:09:02] HTTP (CDN,4) - f3b7q2p3.map2.ssl.hwcdn.net (205.185.216.42:443 / 205.185.216.42:443, host: f3b7q2p3.map2.ssl.hwcdn.net): CDepotHTTPDownloadInterface::BYldTestConnection - Server response 'OK' (200)
[2020-03-20 20:09:02] HTTP (CDN,4) - f3b7q2p3.map2.ssl.hwcdn.net (205.185.216.42:443 / 205.185.216.42:443, host: f3b7q2p3.map2.ssl.hwcdn.net): AuthenticateDepotID (732) - Success!
[2020-03-20 20:09:04] HTTP (SteamCache,76) - cache4-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache4-tyo2.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:04] HTTP (SteamCache,76) - cache4-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache4-tyo2.steamcontent.com): Disabling dual-stack for this connection
[2020-03-20 20:09:04] HTTP (SteamCache,76) - cache4-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache4-tyo2.steamcontent.com): Received 0 (Invalid) HTTP response for depot 732
[2020-03-20 20:09:04] HTTP (SteamCache,76) - cache4-tyo2.steamcontent.com (192.168.1.115:80 / 192.168.1.115:80, host: cache4-tyo2.steamcontent.com): Closing connection
[2020-03-20 20:09:06] Current download rate: 153.900 Mbps
[2020-03-20 20:09:07] Downloading 24760 chunks from depot 731
[2020-03-20 20:09:07] HTTP (CDN,11) - steampipe.akamaized.net (192.168.1.115:443 / 192.168.1.115:443, host: steampipe.akamaized.net): AuthenticateDepotID (731) - Success!
[2020-03-20 20:09:07] HTTP (CDN,4) - f3b7q2p3.map2.ssl.hwcdn.net (205.185.216.42:443 / 205.185.216.42:443, host: f3b7q2p3.map2.ssl.hwcdn.net): AuthenticateDepotID (731) - Success!
[2020-03-20 20:10:07] Current download rate: 126.752 Mbps
[2020-03-20 20:11:09] Current download rate: 129.650 Mbps
[2020-03-20 20:12:10] Current download rate: 122.520 Mbps
[2020-03-20 20:13:11] Current download rate: 127.070 Mbps
[2020-03-20 20:14:13] Current download rate: 188.533 Mbps
[2020-03-20 20:15:14] Current download rate: 113.687 Mbps
[2020-03-20 20:16:15] Current download rate: 108.211 Mbps
[2020-03-20 20:17:17] Current download rate: 146.045 Mbps
[2020-03-20 20:18:18] Current download rate: 239.155 Mbps
[2020-03-20 20:18:36] AppID 730 update changed : Running,
[2020-03-20 20:18:36] AppID 730 update changed : Running,Verifying,
[2020-03-20 20:19:19] Current download rate: 0.000 Mbps
[2020-03-20 20:19:37] HTTP (CDN,11) - steampipe.akamaized.net (192.168.1.115:443 / 192.168.1.115:443, host: steampipe.akamaized.net): Closing connection
[2020-03-20 20:19:37] HTTP (CDN,4) - f3b7q2p3.map2.ssl.hwcdn.net (205.185.216.42:443 / 205.185.216.42:443, host: f3b7q2p3.map2.ssl.hwcdn.net): Closing connection

Note how it says " Adding cache type 'LANCache' on host '::ffff:c0a8:173' " then " Forgetting cache type 'LANCache' on host '::ffff:c0a8:173' due to chunk timeout. " Also, " Received 0 (Invalid) HTTP response for depot 732 " and " Disabling dual-stack for this connection " I've heard this could be due to IPV6, but I have disabled IPV6 to my pc (not the lancache), do I have to disable IPV6 on my whole network?

Any help is greatly appreciated.

MathewBurnett commented 4 years ago

Do you have more than one dns server available to your pc? It looks like you have two set and it is picking them when making a new connection.