nestoru commented 2 years ago

Describe the bug The published docker images do not have scan configs

To Reproduce

Run the container: docker run --detach --publish 9332:9392 --name gvm securecompliance/gvm
Wait till you can reach https://localhost:9332 and login with admin/adminpassword
Go to https://localhost:8080/scanconfigs Error: A blank list

Expected behavior Scan configs should show up

Host Device:

OS: Ubuntu
Version: 20.04.2 LTS

Image in use: securecompliance/gvm AND securecompliance/gvm:21.4.2-v3-data-full Both exhibit the same issue.

Output from docker image inspect <image> :

$ docker image inspect securecompliance/gvm
[
{
    "Id": "sha256:ed6308f4227f0153ea0c4df5c0f648fd7064eb12c0c96331f996e4aed026e050",
    "RepoTags": [
        "securecompliance/gvm:latest"
    ],
    "RepoDigests": [
        "securecompliance/gvm@sha256:b11df7b3ec5416d6409920ea2400d7ad65a193ae3bd077a13b2dbc1dead4939a"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2021-08-08T20:29:21.015414376Z",
    "Container": "",
    "ContainerConfig": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": null,
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": null
    },
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "22/tcp": {},
            "5432/tcp": {},
            "8081/tcp": {},
            "9392/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "SUPVISD=supervisorctl",
            "USERNAME=admin",
            "PASSWORD=adminpassword",
            "PASSWORD_FILE=none",
            "TIMEOUT=15",
            "DEBUG=N",
            "RELAYHOST=smtp",
            "SMTPPORT=25",
            "AUTO_SYNC=true",
            "HTTPS=true",
            "CERTIFICATE=none",
            "CERTIFICATE_KEY=none",
            "TZ=Etc/UTC",
            "SSHD=false",
            "DB_PASSWORD=none",
            "DB_PASSWORD_FILE=none",
            "LANG=en_US.UTF-8",
            "LANGUAGE=en_US.UTF-8",
            "LC_ALL=en_US.UTF-8",
            "MUSL_LOCPATH=/usr/share/i18n/locales/musl",
            "SETUP=0",
            "OPT_PDF=0"
        ],
        "Cmd": [
            "/usr/bin/supervisord",
            "-n",
            "-c",
            "/etc/supervisord.conf"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": {
            "/etc/ssh": {},
            "/opt/database": {},
            "/var/lib/gvm": {},
            "/var/lib/openvas/plugins": {}
        },
        "WorkingDir": "",
        "Entrypoint": [
            "/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2021-08-08T20:27:54.303Z",
            "org.opencontainers.image.description": "Greenbone Vulnerability Management Docker Image with OpenVAS",
            "org.opencontainers.image.licenses": "MIT",
            "org.opencontainers.image.revision": "45166f1b9bc1c5314303b99ee1a94bb7552bc153",
            "org.opencontainers.image.source": "https://github.com/Secure-Compliance-Solutions-LLC/GVM-Docker",
            "org.opencontainers.image.title": "GVM-Docker",
            "org.opencontainers.image.url": "https://github.com/Secure-Compliance-Solutions-LLC/GVM-Docker",
            "org.opencontainers.image.version": "21.4.3-v1"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 485948891,
    "VirtualSize": 485948891,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/9a3be639e5815d9b307a62718dc125b9a966d1fab9894cbf014c66238e4bb544/diff:/var/lib/docker/overlay2/0bc7595cfe7deb337f0b0f4e06978061a74c8426a82547b7f80d88ee6f597166/diff:/var/lib/docker/overlay2/e885071c0f625140f36b49998daa174104f8153227f0649aa52fd4b8ddd48312/diff:/var/lib/docker/overlay2/f0e4399f2732e8f54e4bdb2c0af39460c666f4fe871ecdf860da941ac756fe98/diff:/var/lib/docker/overlay2/2a143cdbe043f01bdd8fa7eb163c01b2e0621f31cd154755531ddd6c663e632e/diff:/var/lib/docker/overlay2/583dfb9308ab5230da97bee6dec731870e0b30f2bd72f84dfe7e948c95fc126f/diff:/var/lib/docker/overlay2/28ad89a941e9000c6483f55bd20d8f834287656c7a2a00ad20a245daf17dc677/diff:/var/lib/docker/overlay2/7a793019cfb30493d539b5574e1333780b6451576b47d78fc3313cde140a360b/diff:/var/lib/docker/overlay2/1f75d8165a364e3ed40db1bfb9773358031a6048466b6baf5f58c10539fd92ea/diff:/var/lib/docker/overlay2/b5f451b644a802169970c0e6f86aca0f26171cde04c581dcc6b09d8e8e162429/diff:/var/lib/docker/overlay2/a746eaea6f213beb63072c8b79d88ad9ccc673f617e19111925a131ef532bd05/diff:/var/lib/docker/overlay2/6b6d072be4e4450615562e02ac0d30cdc1bfd65a4cebb11bb3a69ed17265d3ac/diff:/var/lib/docker/overlay2/6c2523f6f4f1739c985cd6dff7b47e7d0811f66355525696d8ca92cea22e7d7e/diff",
            "MergedDir": "/var/lib/docker/overlay2/dd104c1cbff0d4715c4539586eec2f034b08e7f4b85b4be6003512c1f4f61b37/merged",
            "UpperDir": "/var/lib/docker/overlay2/dd104c1cbff0d4715c4539586eec2f034b08e7f4b85b4be6003512c1f4f61b37/diff",
            "WorkDir": "/var/lib/docker/overlay2/dd104c1cbff0d4715c4539586eec2f034b08e7f4b85b4be6003512c1f4f61b37/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:bc276c40b172b1c5467277d36db5308a203a48262d5f278766cf083947d05466",
            "sha256:0c4ac070c4f03cca7c16a747fd9d467b485c061795399010bd3100581ec41c0a",
            "sha256:5d6bbd2dcce5feb5424d1e3ee6b44049d37071d175d18eb303a73a79916848d8",
            "sha256:16695a3a00062961220ed6f18b64cfd35358523af07e29a8883d0cafa5c96527",
            "sha256:a59e5a6ab44c1b2ed1afea4e2f931ef547f4bf63c6fdd8285b67fe8a5a2ce99f",
            "sha256:9036d1e8e0173202f37107495ca936ea7212936b6ee822bc0b9382e486a99e3d",
            "sha256:ee290c784570e9d71576d06e5c05cb1174d72c1c2b280d4cfa8018ccda0fed88",
            "sha256:b0a7804131f6cd5ae9b6527379c0a374fa76e960f2201e4d3dd2df94bb3cdde6",
            "sha256:2e640983d7088266c796b233ed6c949e118a8b043108b1e3c98e74413fec2383",
            "sha256:a9ae95a9e54ee4eeb73c72bf88e5d799274f94daa6f984924531d12633469129",
            "sha256:02b18ec11a49495185b7cef99d3ed5a332123c17fd699a460cbd7bfda57d0cae",
            "sha256:1a0a0799c42ce65f726c5454d3d6656b80dd854dbb05747e6d43f497e124535a",
            "sha256:93ce1cb27fbd99165639d00f5b8626d938ccf9de99aecbddb21c9a474eede731",
            "sha256:106dac59b237fff04639b08c14355f895c3b5b6c90e88df1623df54248daca4e"
        ]
    },
    "Metadata": {
        "LastTagTime": "0001-01-01T00:00:00Z"
    }
}
]

Additional context The scan configs are necessary to run any scan. Note that we have the same problem with port lists however these can be created as needed. Scan configs can't be created as we get errors like "Failed to find config 'd21f6c81-2b88-4ac1-b7b4-a2a9f2ad4663'" when we try to create a new scan config with base "Base with a minimum set of NVTs", "Failed to find config '085569ce-73ed-11df-83c3-002264764cea'" with base "Empty, static and fast", and "Failed to find config 'daba56c8-73ec-11df-a475-002264764cea'" with base "Full and fast".

The scanners do show up in the new Task form but when we select OpenVAS scanner we get the error "Failed to find config 'daba56c8-73ec-11df-a475-002264764cea'". We can create a Task with the CVE scanner, however such a task when run will finish immediately generating blank reports.

These problems make the docker published images not useful. The alternative is to build the image ourselves however building it is not straightforward as explained in https://github.com/Secure-Compliance-Solutions-LLC/GVM-Docker/issues/270 (we are waiting for clearer documentation there).

Dexus commented 2 years ago

How long did the container run? What says the feed page? The system is not final initialized. The creator it self says it can take up to hours based on system and network connection. If you not have run the system for at least 60minutes and the feed is not ready, you would wait until it’s up 2 date.

Von meinem iPhone gesendet

Am 18.09.2021 um 17:22 schrieb Nestor Urquiza @.***>:

Assigned #281 to @Dexus.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub, or unsubscribe.

nestoru commented 2 years ago

Thanks for the quick reply. Yes I have left the container run for hours before I realized it was not about the time. That is when I tried an older image, same thing. I searched about it and saw others having the same issues but 100% of them were installing all components from scratch rather than using the securecompliance/gvm docker image(s).

The feed status output is below. Note that the GVMD_DATA says to be too old but I looked into this and what I learned is that weeks or even a month is fine for it:

Type | Content | Origin | Version | Status
-- | -- | -- | -- | --
NVT | NVTs | Greenbone Community Feed | 20210917T1029 | Current
SCAP | CVEsCPEsOVAL Definitions | Greenbone Community SCAP Feed | 20210917T0130 | Current
CERT | CERT-Bund AdvisoriesDFN-CERT Advisories | Greenbone Community CERT Feed | 20210917T0030 | Current
GVMD_DATA | Compliance PoliciesPort ListsReport FormatsScan Configs | Greenbone Community gvmd Data Feed | 20210809T1427 | Too old (40 days)

nestoru commented 2 years ago

Just to re-confirm that I re-tested this issue after 16 hours and the scan configs are still missing. Below are all error and warning lines from all log files just in case something helps. Please let me know of any change you might want me to try out to help making the docker image usable.

nurquiza@udesktop-nestor:~$ docker exec -ti gvm bash
bash-5.1# find /var/log/supervisor/ -name "*.log" | xargs grep -i error|grep -v sql
bash-5.1# find /var/log/gvm/ -name "*.log" | xargs grep -i error
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.02 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.02 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.06 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.06 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.17 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.27 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.44 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.44 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h14.21 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.52 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.52 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h27.31 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.23 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.23 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.30 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.31 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.32 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.36 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.36 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.51 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.37 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.37 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h59.25 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h03.04 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h05.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h10.19 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.48 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.49 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.53 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.53 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h14.43 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h14.43 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.08 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.08 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.14 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.15 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.26 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.54 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.47 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.52 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.10 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.10 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.22 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.22 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.37 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.37 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/openvas.log:lib  nasl:MESSAGE:2021-09-18 14h04.02 utc:484: [484]()(/var/lib/openvas/plugins/2012/secpod_apache_http_srv_cookie_info_disc_vuln.nasl:0) Line 93: Cannot compile regex: Cookie: c[0-9]=X{820}; path=/; (error 10: Invalid contents of {})
bash-5.1# find /var/log/supervisor/ -name "*.log" | xargs grep -i warning|grep -v sql
/var/log/supervisor/redis.log:95:M 18 Sep 2021 13:56:00.416 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
/var/log/supervisor/redis.log:92:M 18 Sep 2021 14:53:32.773 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
bash-5.1# find /var/log/gvm/ -name "*.log" | xargs grep -i warning
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.02 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.02 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.06 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.06 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.07 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h11.17 utc:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad  gmp:WARNING:2021-09-18 14h11.21 utc:539: Authentication failure for 'admin' from 172.17.0.1. Status was 2.
/var/log/gvm/gsad.log:gsad  gmp:WARNING:2021-09-18 14h11.27 utc:539: Authentication failure for 'admin' from 172.17.0.1. Status was 2.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.27 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.44 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h13.44 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h14.21 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.38 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.52 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h24.52 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h27.31 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.23 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.23 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.24 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h44.25 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.30 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.31 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.32 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.36 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.36 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.37 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.39 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h45.51 UTC:539: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.37 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.37 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h55.38 utc:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad  gmp:WARNING:2021-09-18 14h55.48 utc:267: Authentication failure for 'admin' from 172.17.0.1. Status was 2.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 14h59.25 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h03.04 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h05.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h10.19 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h11.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.36 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.48 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.49 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.53 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h12.53 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h14.43 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h14.43 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.08 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.08 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.14 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.15 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.26 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h16.54 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.47 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h52.52 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.06 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.07 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.10 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.10 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad  gmp:WARNING:2021-09-18 15h53.17 UTC:267: Authentication failure for 'admin' from 172.17.0.1. Status was 2.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.22 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.22 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-18 15h53.23 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.37 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.37 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.38 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.40 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
/var/log/gvm/gsad.log:gsad main:WARNING:2021-09-19 08h19.46 UTC:267: MHD: Error: received handshake message out of context.
bash-5.1#

nestoru commented 2 years ago

I also tried to run a remote openvas scanner but that did not work either. Per https://securecompliance.gitbook.io/projects/openvas_image:

run gvm

docker stop gvm docker rm gvm docker run --detach --publish 9392:9392 --publish 2222:22 --volume ${HOME}/storage/postgres-db:/opt/database --volume ${HOME}/storage/openvas-plugins:/var/lib/openvas/plugins --volume ${HOME}/storage/gvm:/var/lib/gvm --volume ${HOME}/storage/ssh:/etc/ssh --name gvm securecompliance/gvm

get local IP of the host from where docker is run

MASTER_ADDRESS=hostname -I | cut -d' ' -f1

run scanner

docker stop scanner docker rm scanner docker run --detach --volume ${HOME}/storage/openvas-plugins:/var/lib/openvas/plugins --env MASTER_ADDRESS=${MASTER_ADDRESS} --env MASTER_PORT=2222 --name scanner securecompliance/openvas

find out the "Scanner id" and "Public key" from the scanner

docker logs -f scanner

But here is what I got with no chance to see the scanner id and the public key to be able to set this openvas scanner back in GVM:

Generating scanner id...
GVM Started but with > supervisor <
Running first start configuration...
2021-09-22 09:08:56,426 INFO Set uid to user 0 succeeded
2021-09-22 09:08:56,437 INFO RPC interface 'supervisor' initialized
2021-09-22 09:08:56,437 CRIT Server 'inet_http_server' running without any HTTP authentication checking
2021-09-22 09:08:56,437 INFO RPC interface 'supervisor' initialized
2021-09-22 09:08:56,438 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2021-09-22 09:08:56,438 INFO supervisord started with pid 1
2021-09-22 09:08:57,441 INFO spawned: 'init' with pid 15
2021-09-22 09:08:57,444 INFO spawned: 'GVMUpdate' with pid 16
Getting Master SSH key...
Downloading data TAR to speed up first sync...
Extracting internal data TAR...
10.142.0.3: Connection closed by remote host
2021-09-22 09:08:57,452 INFO exited: init (exit status 1; not expected)
2021-09-22 09:08:58,455 INFO spawned: 'init' with pid 21
Getting Master SSH key...
10.142.0.3: Connection closed by remote host
2021-09-22 09:08:58,466 INFO exited: init (exit status 1; not expected)
2021-09-22 09:09:00,471 INFO spawned: 'init' with pid 23
Getting Master SSH key...
10.142.0.3: Connection closed by remote host
2021-09-22 09:09:00,481 INFO exited: init (exit status 1; not expected)
2021-09-22 09:09:03,487 INFO spawned: 'init' with pid 25
Getting Master SSH key...
10.142.0.3: Connection closed by remote host
2021-09-22 09:09:03,498 INFO exited: init (exit status 1; not expected)
2021-09-22 09:09:04,500 INFO gave up: init entered FATAL state, too many start retries too quickly
2021-09-22 09:09:07,504 INFO success: GVMUpdate entered RUNNING state, process has stayed up for > than 10 seconds (startsecs)
Running Automatic NVT update...

rfma commented 2 years ago

i got the same situation! Did you have any solution?

austinsonger commented 2 years ago

I will be spending some time on it this weekend and will try to reproduce and make changes if needed.

stackcoder commented 2 years ago

Any updates to this? Are there any other workarounds instead of rolling back the latest v20.8.1-v1?

austinsonger commented 2 years ago

Still working on it.

stackcoder commented 2 years ago

This Issue have not been fixed:

The change is only commited (in a draft style) to the dev branch
The latest container available on Docker Hub is still broken, last update: 2021-08-08

I've tried to backport the new start.sh into the latest container with out success. Beside gvm-cli (contained in the gvm-tools package) is not installed in the container, the command fails:

apt add gvm-tools
echo "<get_feeds/>" > get-feeds.xml
gvm-cli --gmp-username admin --gmp-password adminpassword --protocol GMP tls get-feeds.xml
ERROR:gvmtools.cli:Response Error 400. Only command GET_VERSION is allowed before AUTHENTICATE

I know software development is a hard task, and I really liked the past versions of this container. Right now something is really going wrong here.

austinsonger commented 2 years ago

This Issue have not been fixed:

The change is only commited (in a draft style) to the dev branch

The latest container available on Docker Hub is still broken, last update: 2021-08-08

I've tried to backport the new start.sh into the latest container with out success. Beside gvm-cli (contained in the gvm-tools package) is not installed in the container, the command fails:
apt add gvm-tools
echo "<get_feeds/>" > get-feeds.xml
gvm-cli --gmp-username admin --gmp-password adminpassword --protocol GMP tls get-feeds.xml
ERROR:gvmtools.cli:Response Error 400. Only command GET_VERSION is allowed before AUTHENTICATE
I know software development is a hard task, and I really liked the past versions of this container. Right now something is really going wrong here.

@stackcoder

Yeah we are working a debian version right now as well, so these issues will be resolve with it.

stackcoder commented 2 years ago

So there is no plan to fix the current version? Can you propose another workaround?

austinsonger commented 2 years ago

@stackcoder can you docker log <containername>

Dexus commented 2 years ago

Hi, the problem exists only for -data images. And it is not a real big issue, because the gvmd page said it need some time to build the DB and also the scanconfigs.

It is not a start and direct use image. Same way you get when you build it your self and need to initialized the gvmd.

So nothing we need to do here.

And also we can't fix anything on alpine but on Debian, it's the only Supported os from Greenbone.

If you have other experience and knowledge we will love to see your PR for alpine images, and also everything else you may love to see supported.

Please use your rights to open PR for fixes if you are able to do this. If you're not able to do this, you need to live with that we can offer.

Our passion is to provide the best gvmd image, and love to see everyone's input. But it's not a one man show - even if it looks currently like that...

nestoru commented 2 years ago

Just for the record and to help others struggling with this, the new gvm:debian... images should be used. The below worked for me:

docker run --detach --publish 8080:9392 --env PASSWORD="admin" --volume gvm-data:/data/gvm-data --name gvm securecompliance/gvm:debian-master-data-full

Secure-Compliance-Solutions-LLC / GVM-Docker

[Bug]The published docker images do not have scan configs #281

run gvm

get local IP of the host from where docker is run

run scanner

find out the "Scanner id" and "Public key" from the scanner