lancachenet / docker-compose

Docker-compose for a full-stack lancache
288 stars 55 forks source link

CRC check failed for chunk on some games. #13

Closed liwanu closed 3 years ago

liwanu commented 4 years ago

Some games work as expected, 7 days to die is one of them. However, a few that I have tested stop downloading all together. Checking steam's content_log shows that the chunks are coming in with crc errors.
Games with issues that I have tested: Fallout 4 & Ark Survival Evolved

Some output of the steam content_log file. [2020-04-25 10:46:21] HTTP (SteamCache,20) - cache8-atl1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache8-atl1.steamcontent.com): Closing connection [2020-04-25 10:46:21] Created download interface of type 'SteamCache' (7) to host cache7-lax1.steamcontent.com (cache7-lax1.steamcontent.com) [2020-04-25 10:46:21] HTTP (SteamCache,302) - cache11-atl1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache11-atl1.steamcontent.com): CRC check failed for chunk /depot/377161/chunk/8f8692f4a6d765811f5dbd9425d1702f9bdf0f01 - converting to 404 [2020-04-25 10:46:21] HTTP (SteamCache,302) - cache11-atl1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache11-atl1.steamcontent.com): Received 404 (Not Found) HTTP response for depot 377161 [2020-04-25 10:46:21] HTTP (SteamCache,55) - cache17-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache17-lax1.steamcontent.com): CRC check failed for chunk /depot/377161/chunk/2b2ac893e60bb23d62be8775a0a5dccf9a8e7b44 - converting to 404 [2020-04-25 10:46:21] HTTP (SteamCache,55) - cache17-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache17-lax1.steamcontent.com): Received 404 (Not Found) HTTP response for depot 377161 [2020-04-25 10:46:21] HTTP (SteamCache,302) - cache11-atl1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache11-atl1.steamcontent.com): Closing connection [2020-04-25 10:46:21] Created download interface of type 'SteamCache' (7) to host cache21-lax1.steamcontent.com (cache21-lax1.steamcontent.com) [2020-04-25 10:46:21] HTTP (SteamCache,125) - cache7-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache7-lax1.steamcontent.com): CRC check failed for chunk /depot/377161/chunk/912044ed53081808cb7b52cfd91560dfd66fdddf - converting to 404 [2020-04-25 10:46:21] HTTP (SteamCache,125) - cache7-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache7-lax1.steamcontent.com): Received 404 (Not Found) HTTP response for depot 377161 [2020-04-25 10:46:21] HTTP (SteamCache,55) - cache17-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache17-lax1.steamcontent.com): CRC check failed for chunk /depot/377161/chunk/8f8692f4a6d765811f5dbd9425d1702f9bdf0f01 - converting to 404 [2020-04-25 10:46:21] HTTP (SteamCache,55) - cache17-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache17-lax1.steamcontent.com): Received 404 (Not Found) HTTP response for depot 377161 [2020-04-25 10:46:21] HTTP (SteamCache,59) - cache21-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache21-lax1.steamcontent.com): CRC check failed for chunk /depot/377161/chunk/2b2ac893e60bb23d62be8775a0a5dccf9a8e7b44 - converting to 404 [2020-04-25 10:46:21] HTTP (SteamCache,59) - cache21-lax1.steamcontent.com (172.16.8.20:80 / 172.16.8.20:80, host: cache21-lax1.steamcontent.com): Received 404 (Not Found) HTTP response for depot 377161

Lepidopterist commented 4 years ago

You can scan the cache for these corrupted chunks to remove them.

If you run:
find /your/cache/folder -type f -exec awk 'FNR>2 {nextfile} /steam\/depot\/377161\/chunk\/8f8692f4a6d765811f5dbd9425d1702f9bdf0f01/ { print FILENAME ; nextfile }' '{}' + This will return the filename that contains the corrupted chunk, which you can then just 'delete'. This parameter can be a shorter path (eg /steam\/depot\/337161/ will return every file that is storing data from the /steam/depot/337161 depot.

Be aware this will traverse every file in your cache, so can be time consuming on a busy or well-populated cache.