Performance + protocol fixes

[deputinizer]

Description

Performance fixes + HTTP 1.1 protocol fix.

Fixes

• 533

• 534

• 528

Type of change

• [x] Bug fix: ctrl+C slowly responding even without prometheus metrics
• [x] New feature: tls.Config cache in metrics
• [x] Breaking change / fix: SkipBody did unintended things (makes TCP reconnect because of malformed protocol)
• [x] Breaking change: added Custom resolver from stoppropaganda
• [x] Breaking change: countrychecker using fasthttp

Tested

Tested with pprof CPU profile (svg command).

ubuntu@pc:~$ ./db1000n -pprof :6060 -log-level debug 2> logs.txt
...
ubuntu@pc:~$ go tool pprof http://localhost:6060/debug/pprof/profile?seconds=60

Logs

So i've added some more dialing debug (not in commits :smiley: ) Multiple HTTP requests on one connection proves that #534 is correct

grep -v "dial tcp" logs.txt > logs_no_dial.txt

With resp.SkipBody = true

single fasthttp job request {"atomic_id": 1452, "target": "https://kim.tektorg.ru/"}
dialing {"addr": "kim.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1453, "target": "https://kim.tektorg.ru/"}
dialing {"addr": "kim.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1454, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1455, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1456, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1457, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1458, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}
single fasthttp job request {"atomic_id": 1459, "target": "https://fin.tektorg.ru/bg"}
dialing {"addr": "fin.tektorg.ru:443"}

With resp.SkipBody = false

single fasthttp job request {"atomic_id": 1358, "target": "https://kim.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1359, "target": "https://kim.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1360, "target": "https://www.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1361, "target": "https://kim.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1362, "target": "https://irao.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1363, "target": "https://irao.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1364, "target": "https://www.tektorg.ru/"}
single fasthttp job request {"atomic_id": 1365, "target": "https://www.tektorg.ru/"}

As you can see SkipBody == true breaks the protocol and makes TLS handshakes constantly after every single HTTP request.

Screenshots

• No screenshots because tls.Config decryption disappeared in CPU profile :shrug: (that's good actually :+1: )

[deputinizer]

Lol why use lint :sob: Lint disallows this and self

[deputinizer]

[Spoiler] We can make DNS resolver use almost 0% CPU


[deputinizer]

[Spoiler] Works.

 However, I think this linter thing is bullshit

[deputinizer]

Also, stoppropaganda + db1000n authors should do some collab and on rewriting the whole thing in Rust.

[deputinizer]

These templates are not entirely necessary...

Spoiler: pprof memory


[deputinizer]

Probably fixed #528

[deputinizer]

Ok since @Arriven commited changes already, I'm closing due to merge conflicts.

[roman-kruglov]

maybe just rebase, I'm sure there isn't a lot of conflicts