0xERR0R / blocky

Fast and lightweight DNS proxy as ad-blocker for local network with many features
https://0xERR0R.github.io/blocky/
Apache License 2.0
4.75k stars 209 forks source link

can't resolve request via upstream server #1301

Closed stephen-hill closed 9 months ago

stephen-hill commented 10 months ago

Suddenly for no reason, blocky will just stop resolving and will spam the error log (see below). It happens at random. Blocky could be running for weeks and then suddenly stop. The only way I can resolve the issue is to restart blocky.

I'm using block Version: v0.22 armv7 on a raspberry pi.

Below is the relevant parts of my config file.

upstream:
  default:
    - tcp-tls:1.1.1.1
    - tcp-tls:1.0.0.1
    - tcp-tls:8.8.8.8
    - tcp-tls:8.8.4.4
upstreamTimeout: 5s
minTlsServeVersion: 1.3
bootstrapDns:
  - upstream: tcp+udp:1.1.1.1
  - upstream: tcp+udp:8.8.8.8
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:56Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:56Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:57Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:57Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:57Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:57Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:58Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:58Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:58Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:59Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:59Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:59Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:59Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:32:59Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:00Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:00Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:00Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:00Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:00Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:01Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:01Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:01Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:01Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:02Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:02Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:02Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:33:02Z"}
ThinkChaos commented 10 months ago

Can you please provide details about how you run blocky?
I'm especially curious about anything that would introduce an additional network layer such as a container w/ port forwarding.

Are there any logs just before the first error that could be interesting?

stephen-hill commented 10 months ago

@ThinkChaos

This is the whole of my config

  default:
    - tcp-tls:1.1.1.1
    - tcp-tls:1.0.0.1
    - tcp-tls:8.8.8.8
    - tcp-tls:8.8.4.4
upstreamTimeout: 5s
customDNS:
  customTTL: 1h
  filterUnmappedTypes: true
conditional:
  mapping:
    arious.uk: 127.0.0.2
blocking:
  blackLists:
    ads:
      - https://s3.amazonaws.com/lists.disconnect.me/simple_ad.txt
      - https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
      - http://sysctl.org/cameleon/hosts
      - https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt
      - /etc/blocky/dns-lists/home-block-list.txt
      - /etc/blocky/dns-lists/youtube.txt
    special:
      - https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts
      - https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts
      - https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts
    tvbl:
      - /etc/blocky/dns-lists/tv-block-list.txt
  whiteLists:
    ads:
      - /etc/blocky/dns-lists/home-allow-list.txt
  clientGroupsBlock:
    default:
      - ads
      - special
    192.168.178.1/24:
      - special
    192.168.4.1/24:
      - ads
      - special
    stephenipadmini:
      - ads
      - special
    louise:
      - none
    tv:
      - tvbl
  blockType: zeroIp
  blockTTL: 6h
  refreshPeriod: 1h
  downloadTimeout: 10s
  downloadAttempts: 5
  downloadCooldown: 10s
  failStartOnListError: false

caching:
  minTime: 5m
  maxTime: 30m
  maxItemsCount: 0
  prefetching: true
  prefetchExpires: 2h
  prefetchThreshold: 5
  prefetchMaxItemsCount: 0

clientLookup:
  upstream: 172.16.32.1
  singleNameOrder:
    - 2
    - 1
  clients:
    tv:
      - 172.16.32.134
      - 172.16.32.104
prometheus:
  enable: true
  path: /metrics

queryLog:
  type: mysql
  target: blocky:<password>@tcp(172.16.40.134:3306)/blocky?charset=utf8mb4&parseTime=True&loc=Local
  logRetentionDays: 14
  creationAttempts: 1
  creationCooldown: 2s

port: 127.0.0.1:53,172.16.32.3:53
httpPort: 4000
minTlsServeVersion: 1.3
bootstrapDns:
  - upstream: tcp+udp:1.1.1.1
  - upstream: tcp+udp:8.8.8.8

filtering:
  queryTypes:
    - AAAA

hostsFile:
  filePath: /etc/hosts
  hostsTTL: 60m
  refreshPeriod: 30m
logLevel: error
logFormat: json
logTimestamp: true
logPrivacy: false

And here is my log file before the previously mentioned errors.

[2023-12-13 00:00:01]  WARN config option "upstreamTimeout" is deprecated, please use "upstreams.timeout" instead
[2023-12-13 00:00:01]  WARN config option "logLevel" is deprecated, please use "log.level" instead
[2023-12-13 00:00:01]  WARN config option "logFormat" is deprecated, please use "log.format" instead
[2023-12-13 00:00:01]  WARN config option "logPrivacy" is deprecated, please use "log.privacy" instead
[2023-12-13 00:00:01]  WARN config option "logTimestamp" is deprecated, please use "log.timestamp" instead
[2023-12-13 00:00:01]  WARN config option "port" is deprecated, please use "ports.dns" instead
[2023-12-13 00:00:01]  WARN config option "httpPort" is deprecated, please use "ports.http" instead
[2023-12-13 00:00:01]  WARN config option "blocking.downloadTimeout" is deprecated, please use "blocking.loading.downloads.timeout" instead
[2023-12-13 00:00:01]  WARN config option "blocking.downloadAttempts" is deprecated, please use "blocking.loading.downloads.attempts" instead
[2023-12-13 00:00:01]  WARN config option "blocking.downloadCooldown" is deprecated, please use "blocking.loading.downloads.cooldown" instead
[2023-12-13 00:00:01]  WARN config option "blocking.refreshPeriod" is deprecated, please use "blocking.loading.refreshPeriod" instead
[2023-12-13 00:00:01]  WARN config option "blocking.failStartOnListError" is deprecated, please use "blocking.loading.strategy" instead
[2023-12-13 00:00:01]  WARN config option "hostsFile.refreshPeriod" is deprecated, please use "hostsFile.loading.refreshPeriod" instead
[2023-12-13 00:00:01]  WARN config option "hostsFile.filePath" is deprecated, please use "hostsFile.sources" instead
[2023-12-13 00:00:01] ERROR configuration uses deprecated options, see warning logs for details
{"level":"error","msg":"configuration uses deprecated options, see warning logs for details","time":"2023-12-13T00:00:01Z"}
{"count":37481,"level":"error","msg":"parse error: line 42475: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T00:00:12Z"}
{"count":39548,"level":"error","msg":"parse error: line 44541: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T00:00:12Z"}
{"count":46103,"level":"error","msg":"parse error: line 51097: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T00:00:14Z"}
{"count":58426,"level":"error","msg":"parse error: line 63420: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T00:00:17Z"}
{"count":47895,"level":"error","msg":"parse error: line 52889: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T01:00:27Z"}
{"count":50063,"level":"error","msg":"parse error: line 55056: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T01:00:28Z"}
{"count":47896,"level":"error","msg":"parse error: line 52890: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T01:00:28Z"}
{"count":59505,"level":"error","msg":"parse error: line 64499: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T01:00:33Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T02:00:27Z"}
{"count":46107,"level":"error","msg":"parse error: line 51100: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T02:00:27Z"}
{"count":49349,"level":"error","msg":"parse error: line 54343: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T02:00:28Z"}
{"count":58425,"level":"error","msg":"parse error: line 63419: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T02:00:31Z"}
{"count":50063,"level":"error","msg":"parse error: line 55056: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T03:00:27Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T03:00:28Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T03:00:29Z"}
{"count":56489,"level":"error","msg":"parse error: line 61483: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T03:00:31Z"}
{"count":46103,"level":"error","msg":"parse error: line 51097: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T04:00:27Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T04:00:27Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T04:00:28Z"}
{"count":52118,"level":"error","msg":"parse error: line 57111: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T04:00:28Z"}
{"count":54222,"level":"error","msg":"parse error: line 59216: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T05:00:27Z"}
{"count":46103,"level":"error","msg":"parse error: line 51097: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T05:00:27Z"}
{"count":50058,"level":"error","msg":"parse error: line 55052: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T05:00:28Z"}
{"count":50063,"level":"error","msg":"parse error: line 55056: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T05:00:29Z"}
{"count":49525,"level":"error","msg":"parse error: line 54518: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T06:00:28Z"}
{"count":49530,"level":"error","msg":"parse error: line 54522: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T06:00:28Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T06:00:28Z"}
{"count":54794,"level":"error","msg":"parse error: line 59787: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T06:00:32Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T07:00:27Z"}
{"count":50372,"level":"error","msg":"parse error: line 55364: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T07:00:28Z"}
{"count":48153,"level":"error","msg":"parse error: line 53146: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T07:00:29Z"}
{"count":54794,"level":"error","msg":"parse error: line 59787: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T07:00:32Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T08:00:28Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T08:00:28Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T08:00:28Z"}
{"count":48156,"level":"error","msg":"parse error: line 53148: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T08:00:28Z"}
{"count":45473,"level":"error","msg":"parse error: line 50465: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T09:00:28Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T09:00:28Z"}
{"count":48152,"level":"error","msg":"parse error: line 53145: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T09:00:28Z"}
{"count":54794,"level":"error","msg":"parse error: line 59787: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T09:00:32Z"}
{"count":50372,"level":"error","msg":"parse error: line 55364: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T10:00:28Z"}
{"count":44053,"level":"error","msg":"parse error: line 49046: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T10:00:28Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T10:00:28Z"}
{"count":54794,"level":"error","msg":"parse error: line 59787: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T10:00:31Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T11:00:28Z"}
{"count":48152,"level":"error","msg":"parse error: line 53145: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T11:00:28Z"}
{"count":46217,"level":"error","msg":"parse error: line 51209: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T11:00:29Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T11:00:31Z"}
{"count":50372,"level":"error","msg":"parse error: line 55364: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T12:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T12:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T12:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T12:00:28Z"}
{"count":46217,"level":"error","msg":"parse error: line 51209: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T13:00:27Z"}
{"count":48150,"level":"error","msg":"parse error: line 53143: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T13:00:28Z"}
{"count":52287,"level":"error","msg":"parse error: line 57280: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T13:00:28Z"}
{"count":58688,"level":"error","msg":"parse error: line 63681: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T13:00:32Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T14:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T14:00:28Z"}
{"count":48152,"level":"error","msg":"parse error: line 53145: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T14:00:28Z"}
{"count":57931,"level":"error","msg":"parse error: line 62923: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T14:00:31Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T15:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T15:00:27Z"}
{"count":50364,"level":"error","msg":"parse error: line 55357: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T15:00:27Z"}
{"count":60679,"level":"error","msg":"parse error: line 65671: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T15:00:32Z"}
{"count":50372,"level":"error","msg":"parse error: line 55364: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts","time":"2023-12-13T16:00:28Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/fakenews/hosts","time":"2023-12-13T16:00:28Z"}
{"count":46211,"level":"error","msg":"parse error: line 51204: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/porn/hosts","time":"2023-12-13T16:00:28Z"}
{"count":54794,"level":"error","msg":"parse error: line 59787: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body)","prefix":"list_cache","source":"https://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/gambling/hosts","time":"2023-12-13T16:00:32Z"}

I've not gotten round to rewriting my config to sort out the deprecated notices, and I've not taken a look into the parsing errors. However, I wouldn't think these have anything to do with my problem.

Cheers Stephen

stephen-hill commented 10 months ago

@ThinkChaos

I've just noticed that the timestamp don't make sense. It appears as if upstreamTimeout is being ignored. Take this sample of error logs.

{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:19Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:19Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:19Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:19Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:19Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:20Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:20Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:21Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:21Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:21Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:21Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:22Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:22Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.4.4'' and 'upstream 'tcp-tls:1.1.1.1'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.0.0.1'' and 'upstream 'tcp-tls:8.8.8.8'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:8.8.8.8'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:8.8.8.8 (8.8.8.8:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:8.8.4.4'' errors: [can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:8.8.4.4 (8.8.4.4:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}
{"level":"error","msg":"error on processing request:resolution was not successful, used resolvers: 'upstream 'tcp-tls:1.1.1.1'' and 'upstream 'tcp-tls:1.0.0.1'' errors: [can't resolve request via upstream server tcp-tls:1.0.0.1 (1.0.0.1:853): context deadline exceeded can't resolve request via upstream server tcp-tls:1.1.1.1 (1.1.1.1:853): context deadline exceeded]","prefix":"server","time":"2023-12-13T16:25:23Z"}

I have 4 upstream resolvers and a upstreamTimeout of 5 seconds.

Now, the error suggests blocky has attempted to contact a resolve 21 times in 5 seconds. This to me doesn't sound right.

Unless, of course, your creating an upstream connection for every downstream request (not connection pooling).

ThinkChaos commented 10 months ago

Thanks for all the details!

I can confirm that the config warnings should have nothing to do with it, if anything the warning means the value was recognized and internally translated to the new format.

And yes there's currently no connection pooling so that could be indeed caused by a bunch of parallel requests.
I created issue #1307 so that we can tell these situations apart in the future.

In the mean time, could you please give the current development version a try?
We refactored how these timeouts work so it's worth seeing if that changed anything, and I'd rather fix the latest code.
If you need any assistance with that, let me know, but basically installing Go, cloning, and doing make build will give you a bin/blocky binary relative to the repo root.

stephen-hill commented 10 months ago

@ThinkChaos Thank you. I will take a look at this over the weekend/holiday break and will let you know how it goes.

ThinkChaos commented 10 months ago

FWIW v0.24 should be out very soon with those changes, so maybe just waiting for that will be easier for you :)

stephen-hill commented 9 months ago

@ThinkChaos I think we should close this issue because it hasn't happened again since we last spoke. I haven't had a spare moment to compile the development version. So I'm just going to assume there was some random networking event that caused the issue.

Thank you for your time.

ThinkChaos commented 9 months ago

Sounds good!
Feel free to re-open if it occurs with v0.24 or newer since that has the change I mentioned.

ThinkChaos commented 9 months ago

I meant v0.23 above!