search

lancachenet / monolithic

A monolithic lancache service capable of caching all CDNs in a single instance
https://hub.docker.com/r/lancachenet/monolithic
Other
737 stars 73 forks source link

cache access (miss content) #26

Closed joaoview closed 5 years ago

joaoview commented 5 years ago

Describe the issue you are having

I just getting miss on the log, can anyone help?

How are you running the container(s)?

docker run --restart unless-stopped --name steamcache-dns --detach -p 53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=10.10.10.2 steamcache/steamcache-dns:latest
docker run --restart unless-stopped --name lancache --detach -v /cache/data:/data/cache -v /cache/logs:/data/logs -p 80:80  steamcache/monolithic:latest

DNS Configuration

docker run --name steamcache-dns -p 10.10.10.3:53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=10.10.10.2 steamcache/steamcache-dns:latest

Output of container(s)

[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:00 -0300] "GET /depot/1/chunk/e1156c47385927ff161f4d9033dd763c79b01bc0?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 854912 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/09171ba34a65c57f4de83e1604ddcff7f172805d?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 1039968 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/fa1e15f5436299127de5a8f9aa4829b88d8caddd?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 517584 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/c955fff3ff0771b457d4ca92f132b3647dc7baf8?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 7024 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/9731ca2fdcfe85b2ac497654e8d47d8612664f1c?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 5776 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/406153bf77af6ffe5f242e636ffe25a88546f38d?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 2400 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/feb833e7a609f5f2af9e3cb16563d557a9b81f8a?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 2272 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/05d7240cc7f5be6d1af77945aa5cd045778a80c2?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 5472 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:01 -0300] "GET /depot/1/chunk/2584202e0cc93e0269bc0cb185630cee07718b75?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 2448 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/0f291eb76fffaf8605ce13b9cec2ab9af8c26efa?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 304 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/5a34f9789af44c921b63223cf26be26aa353d984?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 304 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/fadd5742d70210f87905e72960d16d5ed27cb1e3?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 49904 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/87eb2cefc597790161725066ae2dedec4ab13f4b?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 414816 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/477602c4c50e2bc882b9241a2bec7d13a7c6e277?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 10000 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/2069d7432766cfbd8965d44919a1aacf0d4b5b9c?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 14560 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/b55333e8710847cd489e625a92fde59d02a6b834?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 28896 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
[steam] 10.10.10.254 / - - - [20/Apr/2019:03:37:02 -0300] "GET /depot/1/chunk/a32a3f6cb3575397792e1dfcb50db0d5c55502f1?l=9&e=1555976254&sid=26588943&h=16d431d51cb630ebbdd818cd5e19874bd71749c0 HTTP/1.1" 200 826800 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache2-gru1.steamcontent.com" "-"
Xaelias commented 5 years ago

I'm seeing something similar. Bunch of

[steam] 10.20.0.102 / - - - [22/May/2019:03:10:26 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache14-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:26 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache14-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:26 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache3-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache3-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache6-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache6-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache4-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache4-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache10-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache10-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:27 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache16-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:28 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache1-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:28 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache17-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:28 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache17-ord1.steamcontent.com" "-"
[steam] 10.20.0.102 / - - - [22/May/2019:03:10:29 +0000] "GET /server-status HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache1-ord1.steamcontent.com" "-"

in the access logs followed by a bunch of

2019/05/22 03:10:19 [crit] 1265#1265: *862 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000422" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.193.40:80/server-status", host: "cache8-ord1.steamcontent.com"
2019/05/22 03:10:19 [crit] 1265#1265: *866 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000423" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.193.40:80/server-status", host: "cache8-ord1.steamcontent.com"
2019/05/22 03:10:19 [crit] 1265#1265: *868 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000424" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.192.5:80/server-status", host: "cache5-iad1.steamcontent.com"
2019/05/22 03:10:19 [crit] 1265#1265: *870 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000425" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.192.5:80/server-status", host: "cache5-iad1.steamcontent.com"
2019/05/22 03:10:19 [crit] 1265#1265: *872 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000426" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.195.32:80/server-status", host: "cache21-lax1.steamcontent.com"
2019/05/22 03:10:20 [crit] 1265#1265: *874 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000427" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.195.32:80/server-status", host: "cache21-lax1.steamcontent.com"
2019/05/22 03:10:20 [crit] 1266#1266: *876 open() "/data/cache/cache/6a/28/69575c9500f62e8369313932101d286a.0000000428" failed (13: Permission denied) while reading upstream, client: 10.20.0.102, server: , request: "GET /server-status HTTP/1.1", upstream: "http://162.254.195.19:80/server-status", host: "cache8-lax1.steamcontent.com"

in the error log.

[EDIT] nvm it looks like it's an NFS permission issue on my end... will keep looking.

VibroAxe commented 5 years ago

We don't recommend running your cache data via any network share

Xaelias commented 5 years ago

That's... the whole point of network shares though.

VibroAxe commented 5 years ago

In this case the purpose of a lancache is to reduce network utilisation. By pulling the raw data from another network share you end up double accounting for all of your data transfer. In addition we usually find that this generates various permissions/security issues which we cannot support without significant information on your setup

Sorry