HASecuritySolutions / VulnWhisperer

Create actionable data from your Vulnerability Scans
https://twitter.com/VulnWhisperer
Apache License 2.0
1.36k stars 267 forks source link

Dashboards not working - Fielddata is disabled #191

Open ghost opened 4 years ago

ghost commented 4 years ago

Hello Vulnwhisperes, I'm in a trouble with import kibana.json to generate the graphics

I've tried more than 5 times importing new logs and different ways, but always I got the same problem.

image

I'm capable to download nessus scan, convert it to csv, import to kibana but only when I import kibana.json I got this message.

I'm using ELK version 7.3 Ubuntu 16.04, If you guys need more information please tell me.

jww1232002 commented 4 years ago

Does anyone know if there is a workaround to this issue? I'm currently experiencing the same issue within Kibana (I'm running CentOS 7 w/ docker vulnwhisperer. If no workaround, any insight on when it'll be resolved? I would like to see vulnwhisperer up & running completely in my environment.

Error Message: image

Thanks in advance!

SHolzhauer commented 4 years ago

Looks to be an issue with mapping.

Have a look at your index mapping, you will likely see something along the lines of

"plugin_name": {
  "type": "text"
  "properties": {
    "keyword": {
      "type": "keyword"
    }
  }
}

It looks like this should be:

"plugin_name": {
  "type": "keyword"
}

Have a google around, there are some pretty good materials on index mapping. You can also have a read through a [thread]() I had with someone on the [elastic slack]() on how to update your index settings.

ps: Not sure if this is an issue with vulnwhisperer or not, this is just a potential fix

SHolzhauer commented 4 years ago

Had a quick read through the index templates provided by VulnWhisperer. The ELK7 compatible should be correct. Did you use this one?

jww1232002 commented 4 years ago

@SHolzhauer thanks for the info that’s exactly my problem. I’m new to ELK & not sure how to update the index to use the ELK7 vulnwhisperer json file. I’ll keep looking/ searching, any additional info / steps are greatly appreciated.

SHolzhauer commented 4 years ago

@SHolzhauer thanks for the info that’s exactly my problem. I’m new to ELK & not sure how to update the index to use the ELK7 vulnwhisperer json file. I’ll keep looking/ searching, any additional info / steps are greatly appreciated.

Have a look at the tread I linked, i basically go trough it step by step. Read it before you do it ;)

jww1232002 commented 4 years ago

@SHolzhauer I read through the Slack channel post that you referenced and started going through it today & ran into the following error with step 1: curl --user --location -k --request PUT "https://:9200/logstash-vulnwhisperer-2020.01/_settings" --header 'Content-Type: application/json' -d '{ "settings": { "index.blocks.write": "true" } }' Enter host password for user '': curl: (35) SSL received a record that exceeded the maximum permissible length.

Any insight? Is there an easier way to accomplish this? I really need to get this up & running to see if its going to work for us or not. Thanks again for the assistance.

jww1232002 commented 4 years ago

@SHolzhauer - command should read: curl --user username --location -k --request PUT 'https://hostname:9200/logstash-vulnwhisperer-2020.01/_settings' --header 'Content-Type: application/json' -d '{ "settings": { "index.blocks.write": "true" } }'

SHolzhauer commented 4 years ago

@SHolzhauer - command should read: curl --user username --location -k --request PUT 'https://hostname:9200/logstash-vulnwhisperer-2020.01/_settings' --header 'Content-Type: application/json' -d '{ "settings": { "index.blocks.write": "true" } }'

Depends on your cluster, if this is your command then you don't need to authenticate in order to index events ;)

shacthulu commented 4 years ago

@SHolzhauer I'm having the same issue but the links no longer work. Do you still have the instructions by chance?

SHolzhauer commented 4 years ago

@SHolzhauer I'm having the same issue but the links no longer work. Do you still have the instructions by chance?

Have a read through the Elastic docs on index templates and mappings. The issue is elasticsearch is dynamically interpreting the data being ingested by Vulnwhisperer, and interpret it differently as used by the visualizations.

To solve this you should, before sending data, setup an index template with the correct mapping as provided.

The Elastic docs should guide you through it.