What did you do? (required. The issue will be closed when not provided.)

I tried generating a report having gost via HTTP enabled.

If I disable gost in config.toml, generating reports works.
If I use the gost sqlite3 database directly, generating reports works

What did you expect to happen?

Get a report.

What happened instead?

panic: runtime error: invalid memory address or nil pointer dereference

Current Output


[root@vulstest ~]# docker-compose -f docker-compose.yml run report
Creating vuls_report_run ... done
[Aug 11 07:17:05]  INFO [localhost] vuls-v0.15.13-build-20210721_001547_5f4d68c
[Aug 11 07:17:05]  INFO [localhost] Validating config...
[Aug 11 07:17:05]  INFO [localhost] cveDict.type=http, cveDict.url=http://go-cve-dictionary:1323, cveDict.SQLite3Path=
[Aug 11 07:17:05]  INFO [localhost] ovalDict.type=http, ovalDict.url=http://goval-dictionary:1324, ovalDict.SQLite3Path=
[Aug 11 07:17:05]  INFO [localhost] gost.type=http, gost.url=http://gost:1325, gost.SQLite3Path=
[Aug 11 07:17:05]  INFO [localhost] exploit.type=http, exploit.url=http://go-exploitdb:1326, exploit.SQLite3Path=
[Aug 11 07:17:05]  INFO [localhost] metasploit.type=sqlite3, metasploit.url=, metasploit.SQLite3Path=/vuls/go-msfdb.sqlite3
[Aug 11 07:17:05]  WARN [localhost] metasploit.SQLite3Path=/vuls/go-msfdb.sqlite3 file not found
[Aug 11 07:17:05]  INFO [localhost] Loaded: /vuls/results/2021-08-11T07:16:51Z
[Aug 11 07:17:05]  INFO [localhost] OVAL centos 7.9.2009 is fresh. defs: 1296
[Aug 11 07:17:05]  INFO [localhost] OVAL centos 7.9.2009 is fresh. lastModified: 2021-08-11T06:45:37Z
[Aug 11 07:17:19]  INFO [localhost] testhost.local: 13 CVEs are detected with OVAL
[Aug 11 07:17:22]  INFO [localhost] testhost.local: 1095 unfixed CVEs are detected with gost
[Aug 11 07:17:22]  INFO [localhost] testhost.local: 0 CVEs are detected with CPE
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1050bc6]

goroutine 1 [running]: github.com/future-architect/vuls/gost.FillCVEsWithRedHat.func1(0x0, 0x0) /go/src/github.com/future-architect/vuls/gost/gost.go:49 +0x26 github.com/future-architect/vuls/gost.FillCVEsWithRedHat(0xc000200000, 0x15734b1, 0x4, 0xc0004882b0, 0x4, 0xc0000bc540, 0x10, 0x0, 0x0, 0x0, ...) /go/src/github.com/future-architect/vuls/gost/gost.go:53 +0x217 github.com/future-architect/vuls/detector.Detect(0xc0005d4c00, 0x1, 0x1, 0xc0000b6480, 0x22, 0x2, 0x2, 0xc00028e250, 0x6, 0xc00028e258) /go/src/github.com/future-architect/vuls/detector/detector.go:81 +0xf0a github.com/future-architect/vuls/subcmds.(ReportCmd).Execute(0xc00043c060, 0x1821990, 0xc0000ba010, 0xc000077680, 0x0, 0x0, 0x0, 0xc000099201) /go/src/github.com/future-architect/vuls/subcmds/report.go:241 +0x8a6 github.com/google/subcommands.(Commander).Execute(0xc0000e9780, 0x1821990, 0xc0000ba010, 0x0, 0x0, 0x0, 0xc000488180) /go/pkg/mod/github.com/google/subcommands@v1.2.0/subcommands.go:209 +0x347 github.com/google/subcommands.Execute(...) /go/pkg/mod/github.com/google/subcommands@v1.2.0/subcommands.go:492 main.main() /go/src/github.com/future-architect/vuls/cmd/vuls/main.go:37 +0x396 ERROR: 2


Please re-run the command using ```-debug``` and provide the output below.

[root@vulstest ~]# docker-compose -f docker-compose.yml run report-debug Creating vuls_report_run ... done [Aug 11 07:30:05] INFO [localhost] vuls-v0.15.13-build-20210721_001547_5f4d68c [Aug 11 07:30:05] INFO [localhost] Validating config... [Aug 11 07:30:05] INFO [localhost] cveDict.type=http, cveDict.url=http://go-cve-dictionary:1323, cveDict.SQLite3Path= [http] 2021/08/11 07:30:05 HTTP Request: GET /health HTTP/1.1 Host: go-cve-dictionary:1323

[http] 2021/08/11 07:30:05 HTTP Response: HTTP/1.1 200 OK Connection: close Content-Type: text/plain; charset=UTF-8 Date: Wed, 11 Aug 2021 07:30:05 GMT Content-Length: 0

[Aug 11 07:30:05] INFO [localhost] ovalDict.type=http, ovalDict.url=http://goval-dictionary:1324, ovalDict.SQLite3Path= [http] 2021/08/11 07:30:05 HTTP Request: GET /health HTTP/1.1 Host: goval-dictionary:1324

[http] 2021/08/11 07:30:05 HTTP Response: HTTP/1.1 200 OK Connection: close Content-Type: text/plain; charset=UTF-8 Date: Wed, 11 Aug 2021 07:30:05 GMT Content-Length: 0

[Aug 11 07:30:05] INFO [localhost] gost.type=http, gost.url=http://gost:1325, gost.SQLite3Path= [http] 2021/08/11 07:30:05 HTTP Request: GET /health HTTP/1.1 Host: gost:1325

[http] 2021/08/11 07:30:05 HTTP Response: HTTP/1.1 200 OK Connection: close Content-Type: text/plain; charset=UTF-8 Date: Wed, 11 Aug 2021 07:30:05 GMT Content-Length: 0

[Aug 11 07:30:05] INFO [localhost] exploit.type=http, exploit.url=http://go-exploitdb:1326, exploit.SQLite3Path= [http] 2021/08/11 07:30:05 HTTP Request: GET /health HTTP/1.1 Host: go-exploitdb:1326

[http] 2021/08/11 07:30:05 HTTP Response: HTTP/1.1 200 OK Connection: close Content-Type: text/plain; charset=UTF-8 Date: Wed, 11 Aug 2021 07:30:05 GMT Content-Length: 0

goroutine 1 [running]: github.com/future-architect/vuls/gost.FillCVEsWithRedHat.func1(0x0, 0x0) /go/src/github.com/future-architect/vuls/gost/gost.go:49 +0x26 github.com/future-architect/vuls/gost.FillCVEsWithRedHat(0xc000254c00, 0x15734b1, 0x4, 0xc000578af0, 0x4, 0xc000038540, 0x10, 0x0, 0x0, 0x0, ...) /go/src/github.com/future-architect/vuls/gost/gost.go:53 +0x217 github.com/future-architect/vuls/detector.Detect(0xc000253900, 0x1, 0x1, 0xc0001143c0, 0x22, 0x2, 0x2, 0xc0003fd2c8, 0x6, 0xc0003fd300) /go/src/github.com/future-architect/vuls/detector/detector.go:81 +0xf0a github.com/future-architect/vuls/subcmds.(ReportCmd).Execute(0xc0002655f0, 0x1821990, 0xc00003a060, 0xc000437560, 0x0, 0x0, 0x0, 0xc000514a01) /go/src/github.com/future-architect/vuls/subcmds/report.go:241 +0x8a6 github.com/google/subcommands.(Commander).Execute(0xc000141780, 0x1821990, 0xc00003a060, 0x0, 0x0, 0x0, 0xc0005789c0) /go/pkg/mod/github.com/google/subcommands@v1.2.0/subcommands.go:209 +0x347 github.com/google/subcommands.Execute(...) /go/pkg/mod/github.com/google/subcommands@v1.2.0/subcommands.go:492 main.main() /go/src/github.com/future-architect/vuls/cmd/vuls/main.go:37 +0x396 ERROR: 2


# Steps to reproduce the behaviour
- initialize databases

[root@vulstest ~]# for i in seq 2002 $(date +"%Y"); do docker run -v /srv/vuls/data/go-cve-dictionary:/vuls vuls/go-cve-dictionary:latest fetchnvd -years ${i} done [root@vulstest ~]# docker run -v /srv/vuls/data/go-exploitdb:/vuls vuls/go-exploitdb:latest fetch exploitdb [root@vulstest ~]# docker run -v /srv/vuls/data/gost:/vuls vuls/gost:latest fetch redhat [root@vulstest ~]# docker run -v /srv/vuls/data/gost:/vuls vuls/gost:latest fetch ubuntu [root@vulstest ~]# docker run -v /srv/vuls/data/goval-dictionary:/goval-dictionary vuls/goval-dictionary:latest fetch redhat 7 8 [root@vulstest ~]# docker run -v /srv/vuls/data/goval-dictionary:/goval-dictionary vuls/goval-dictionary:latest fetch ubuntu 20


- startup services

[root@vulstest ~]# docker-compose -f docker-compose.yml up -d go-cve-dictionary goval-dictionary gost go-exploitdb


- build local vuls image

[root@vulstest vuls]# docker build -t vuls:local . Sending build context to Docker daemon 12.29kB Step 1/9 : FROM vuls/vuls:latest latest: Pulling from vuls/vuls 5843afab3874: Already exists 3ea833f22c62: Pull complete e354ce46e961: Pull complete 4f4fb700ef54: Pull complete Digest: sha256:7544e6d357df1b52f7f76bad12416c07a3273c9671762c378c169a271f2ea90e Status: Downloaded newer image for vuls/vuls:latest ---> 2eda8c8f4101 Step 2/9 : COPY .ssh /root/.ssh ---> f02fd8730493 Step 3/9 : RUN chmod 0700 /root/.ssh && chmod 0600 /root/.ssh/id_rsa && chmod 0644 /root/.ssh/id_rsa.pub ---> Running in 6426a50fbd98 Removing intermediate container 6426a50fbd98 ---> 3d73e8caae0d Step 4/9 : RUN mkdir /config ---> Running in 1413cd972c8b Removing intermediate container 1413cd972c8b ---> 8b8c6668d9a3 Step 5/9 : COPY config.toml /config/config.toml ---> 6ecf7f10326a Step 6/9 : COPY servers.toml /tmp/servers.toml ---> 776a8447bfa4 Step 7/9 : RUN ssh-keyscan $(cat /tmp/servers.toml |grep "^host\s=\s\"(.*)\"" | cut -d"\"" -f2) >> /root/.ssh/known_hosts ---> Running in a722aee6259b

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

Removing intermediate container a722aee6259b ---> 821854d8d593 Step 8/9 : RUN cat /tmp/servers.toml >> /config/config.toml ---> Running in 192602dd2b76 Removing intermediate container 192602dd2b76 ---> 43e2d9b50352 Step 9/9 : RUN chmod 0600 /root/.ssh/known_hosts ---> Running in a57cc9f72fbb Removing intermediate container a57cc9f72fbb ---> b2fedb04b252 Successfully built b2fedb04b252 Successfully tagged vuls:local


- run scan

[root@vulstest ~]# docker-compose -f docker-compose.yml run scan Creating vuls_scan_run ... done [Aug 11 07:16:50] INFO [localhost] vuls-v0.15.13-build-20210721_001547_5f4d68c [Aug 11 07:16:50] INFO [localhost] Start scanning [Aug 11 07:16:50] INFO [localhost] config: /config/config.toml [Aug 11 07:16:50] INFO [localhost] Validating config... [Aug 11 07:16:50] INFO [localhost] Detecting Server/Container OS... [Aug 11 07:16:50] INFO [localhost] Detecting OS of servers... [Aug 11 07:16:50] INFO [localhost] (1/1) Detected: testhost.local: centos 7.9.2009 [Aug 11 07:16:50] INFO [localhost] Detecting OS of containers... [Aug 11 07:16:50] INFO [localhost] Checking Scan Modes... [Aug 11 07:16:50] INFO [localhost] Detecting Platforms... [Aug 11 07:16:51] INFO [localhost] (1/1) testhost.local is running on other [Aug 11 07:16:52] INFO [testhost.local] Scanning OS pkg in fast mode [Aug 11 07:16:54] INFO [testhost.local] Scanning listen port... [Aug 11 07:16:54] INFO [testhost.local] Using Port Scanner: Vuls built-in Scanner

Scan Summary

testhost.local centos7.9.2009 822 installed, 0 updatable

To view the detail, vuls tui is useful. To send a report, run vuls report -h.


- run report

[root@vulstest ~]# docker-compose -f docker-compose.yml run report Creating vuls_report_run ... done [Aug 11 07:17:05] INFO [localhost] vuls-v0.15.13-build-20210721_001547_5f4d68c [Aug 11 07:17:05] INFO [localhost] Validating config... [Aug 11 07:17:05] INFO [localhost] cveDict.type=http, cveDict.url=http://go-cve-dictionary:1323, cveDict.SQLite3Path= [Aug 11 07:17:05] INFO [localhost] ovalDict.type=http, ovalDict.url=http://goval-dictionary:1324, ovalDict.SQLite3Path= [Aug 11 07:17:05] INFO [localhost] gost.type=http, gost.url=http://gost:1325, gost.SQLite3Path= [Aug 11 07:17:05] INFO [localhost] exploit.type=http, exploit.url=http://go-exploitdb:1326, exploit.SQLite3Path= [Aug 11 07:17:05] INFO [localhost] metasploit.type=sqlite3, metasploit.url=, metasploit.SQLite3Path=/vuls/go-msfdb.sqlite3 [Aug 11 07:17:05] WARN [localhost] metasploit.SQLite3Path=/vuls/go-msfdb.sqlite3 file not found [Aug 11 07:17:05] INFO [localhost] Loaded: /vuls/results/2021-08-11T07:16:51Z [Aug 11 07:17:05] INFO [localhost] OVAL centos 7.9.2009 is fresh. defs: 1296 [Aug 11 07:17:05] INFO [localhost] OVAL centos 7.9.2009 is fresh. lastModified: 2021-08-11T06:45:37Z [Aug 11 07:17:19] INFO [localhost] testhost.local: 13 CVEs are detected with OVAL [Aug 11 07:17:22] INFO [localhost] testhost.local: 1095 unfixed CVEs are detected with gost [Aug 11 07:17:22] INFO [localhost] testhost.local: 0 CVEs are detected with CPE panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1050bc6]


# Configuration (**MUST** fill this out):

* Go version (`go version`): using your official docker images

* Go environment (`go env`): using your official docker images

* Vuls environment: vuls-v0.15.13-build-20210721_001547_5f4d68c

* config.toml:

[cveDict] type = "http" url = "http://go-cve-dictionary:1323"

[ovalDict] type = "http" url = "http://goval-dictionary:1324"

[gost] type = "http" url = "http://gost:1325"

[exploit] type = "http" url = "http://go-exploitdb:1326"

[default] port = "22" user = "vuls" keyPath = "/root/.ssh/id_rsa" # path to ssh private key in docker


* servers.toml:

[servers]

[servers.testhost.local] host = "192.168.1.2"


* Dockerfile:

FROM vuls/vuls:latest COPY .ssh /root/.ssh RUN chmod 0700 /root/.ssh && \ chmod 0600 /root/.ssh/id_rsa && \ chmod 0644 /root/.ssh/id_rsa.pub RUN mkdir /config COPY config.toml /config/config.toml COPY servers.toml /tmp/servers.toml RUN ssh-keyscan $(cat /tmp/servers.toml |grep "^host\s=\s\"(.*)\"" | cut -d"\"" -f2) >> /root/.ssh/known_hosts RUN cat /tmp/servers.toml >> /config/config.toml RUN chmod 0600 /root/.ssh/known_hosts


* docker-compose.yml:

version: '2' services: go-cve-dictionary: image: vuls/go-cve-dictionary:latest restart: always volumes:

/srv/vuls/data/go-cve-dictionary:/vuls command: server --bind=0.0.0.0 goval-dictionary: image: vuls/goval-dictionary:latest restart: always volumes:
/srv/vuls/data/goval-dictionary:/goval-dictionary command: server --bind=0.0.0.0 gost: image: vuls/gost:latest restart: always volumes:
/srv/vuls/data/gost:/vuls command: server --bind=0.0.0.0 go-exploitdb: image: vuls/go-exploitdb:latest restart: always volumes:
/srv/vuls/data/go-exploitdb:/vuls command: server --bind=0.0.0.0

scan and report services

scan: image: vuls:local volumes:

/srv/vuls/data/vuls:/vuls depends_on:
go-cve-dictionary
goval-dictionary
gost
go-exploitdb command: scan -config=/config/config.toml report: image: vuls:local volumes:
/srv/vuls/data/vuls:/vuls depends_on:
go-cve-dictionary
goval-dictionary
gost
go-exploitdb command: report -format-list -config=/config/config.toml report-debug: image: vuls:local volumes:
/srv/vuls/data/vuls:/vuls depends_on:
go-cve-dictionary
goval-dictionary
gost
go-exploitdb command: report -debug -format-list -config=/config/config.toml version: image: vuls:local volumes:
/srv/vuls/data/vuls:/vuls depends_on:
go-cve-dictionary
goval-dictionary
gost
go-exploitdb command: -v

command:

docker-compose -f docker-compose.yml run report

future-architect / vuls

runtime error while creating report having gost enabled #1281

What did you do? (required. The issue will be closed when not provided.)

What did you expect to happen?

What happened instead?

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

192.168.1.2:22 SSH-2.0-OpenSSH_7.4

Scan Summary

scan and report services

scan and report services

Scan Summary