EDIT THIS TITLE BEFORE POSTING. Use this template for bug reports. If you'd like to request a feature, please be as descriptive as possible and delete the template except the first section (Request Type)
Request Type
(select Bug or Feature Request and remove this part)
Bug / Feature Request
Work Environment
Question
Answer
OS version (server)
RedHat 7
Hippocampe version / git hash
1.x, hash of the commit
Package Type
From source
Browser type & version
Chrome
Problem Description
When I run thei command curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook, I am getting below error:
**<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
500 Internal Server Error
Internal Server Error
The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
**
### Steps to Reproduce
1. step 1: I did fresh installed on a different VM running RedHat 7
1. step 2: I run the command again, and got the same error
### Possible Solutions
(keep this section if you have suggestions on how to solve the problem. **Otherwise delete it**)
**First running Hippocampe**
[iranalyst@hippo core]$ sudo python app.py
* Serving Flask app "app" (lazy loading)
* Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
* Debug mode: off
* Running on http://0.0.0.0:5000/ (Press CTRL+C to quit)
**Initial hippo.conf file**
hippo.conf
[api]
debug : False
host : 0.0.0.0
port : 5000
threaded : True
[elasticsearch]
ip : 127.0.0.1
port : 9200
#indexNameES MUST BE LOWERCASE
indexNameES : hippocampe
typeNameESSource : source
typeNameESNew : new
typeNameESJobs: jobs
[shadowbook]
nbThreadPerCPU : 2
[freshness]
#in days
threshold : 1
[schedReport]
#in hours
threshold: 12
After added IP Address
hippo.conf
[api]
debug : False
host : 192.168.153.10
port : 5000
threaded : True
[elasticsearch]
ip : 127.0.0.1
port : 9200
#indexNameES MUST BE LOWERCASE
indexNameES : hippocampe
typeNameESSource : source
typeNameESNew : new
typeNameESJobs: jobs
[shadowbook]
nbThreadPerCPU : 2
[freshness]
#in days
threshold : 1
[schedReport]
#in hours
threshold: 12
**I ran the python app.py command again and below is the is result**
[iranalyst@hippo core]$ sudo python app.py
* Serving Flask app "app" (lazy loading)
* Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
* Debug mode: off
* Running on http://192.168.153.10:5000/ (Press CTRL+C to quit)
**Same error message shown below when I run curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook**
500 Internal Server Error
Internal Server Error
The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
**Also, below are the logs I get when I run curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook**
[iranalyst@hippo core]$ sudo python app.py
* Serving Flask app "app" (lazy loading)
* Environment: production
WARNING: This is a development server. Do not use it in a production deployment.
Use a production WSGI server instead.
* Debug mode: off
* Running on http://192.168.152.132:5000/ (Press CTRL+C to quit)
[2019-10-31 14:24:26,492] ERROR in app: Exception on /hippocampe/api/v1.0/shadowbook [GET]
Traceback (most recent call last):
File "/usr/lib64/python2.7/site-packages/flask/app.py", line 2446, in wsgi_app
response = self.full_dispatch_request()
File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1951, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1820, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1949, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1935, in dispatch_request
return self.view_functions[rule.endpoint](**req.view_args)
File "app.py", line 168, in shadowbookService
if 'error' in reportJob:
TypeError: argument of type 'NoneType' is not iterable
192.168.152.132 - - [31/Oct/2019 14:24:26] "GET /hippocampe/api/v1.0/shadowbook HTTP/1.1" 500 -
**Below are the Hippocampe logs**
2019-10-31 14:20:30,591 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:30,921 :: services :: INFO :: type service requested
2019-10-31 14:20:30,921 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:30,925 :: services :: INFO :: sizeByType service requested
2019-10-31 14:20:30,926 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:30,927 :: services :: INFO :: sizeBySources service requested
2019-10-31 14:20:30,927 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:30,936 :: services :: INFO :: monitorSources service requested
2019-10-31 14:20:30,936 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:31,180 :: services.modules.common.ES :: INFO :: ES.checkData launched
2019-10-31 14:20:31,181 :: services.modules.common.ES :: INFO :: []
2019-10-31 14:20:31,238 :: services.modules.common.ES :: INFO :: ES.checkData launched
2019-10-31 14:20:31,238 :: services.modules.common.ES :: INFO :: ['sourceType']
2019-10-31 14:20:31,239 :: services.modules.common.ES :: INFO :: ES.checkData launched
2019-10-31 14:20:31,240 :: services.modules.common.ES :: INFO :: ['sourceType']
2019-10-31 14:20:31,240 :: services.modules.common.ES :: INFO :: ES.checkData launched
2019-10-31 14:20:31,244 :: services.modules.common.ES :: INFO :: ['sourceType']
2019-10-31 14:20:31,500 :: services.modules.common.ES :: INFO :: index hippocampe does not exist
2019-10-31 14:20:31,500 :: services :: ERROR :: no data
2019-10-31 14:20:31,501 :: services.modules.common.ES :: INFO :: index hippocampe does not exist
2019-10-31 14:20:31,503 :: services :: ERROR :: no data
2019-10-31 14:20:31,505 :: services :: INFO :: type service requested
2019-10-31 14:20:31,505 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:20:31,511 :: services.modules.common.ES :: INFO :: index hippocampe does not exist
2019-10-31 14:20:31,512 :: services :: ERROR :: no data
2019-10-31 14:20:31,514 :: services.modules.common.ES :: INFO :: ES.checkData launched
2019-10-31 14:20:31,514 :: services.modules.common.ES :: INFO :: []
2019-10-31 14:20:31,703 :: services.modules.common.ES :: INFO :: index hippocampe does not exist
2019-10-31 14:20:31,703 :: services :: ERROR :: no data
2019-10-31 14:20:31,705 :: services.modules.common.ES :: INFO :: index hippocampe does not exist
2019-10-31 14:20:31,706 :: services :: ERROR :: no data
2019-10-31 14:24:26,090 :: services :: INFO :: shadowbook service requested
2019-10-31 14:24:26,091 :: services.modules.common.ES :: INFO :: ES.checkES launched
2019-10-31 14:24:26,099 :: services.shadowbook :: INFO :: shadowbook.initJob launched
2019-10-31 14:24:26,490 :: services.shadowbook :: ERROR :: search() got an unexpected keyword argument 'doc_type'
Traceback (most recent call last):
File "/opt/Hippocampe/core/services/shadowbook.py", line 80, in initJob
nbOngoingJob = job.searchOngoingJob()
File "/opt/Hippocampe/core/services/modules/shadowbook/objects/Job.py", line 76, in searchOngoingJob
nbOngoingJob = self.search()
File "/opt/Hippocampe/core/services/modules/shadowbook/objects/ObjToIndex.py", line 67, in search
self.resSearch = self.es.search(index = self.indexNameES, doc_type = self.typeNameES, body = self.docSearch)
File "/usr/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 84, in _wrapped
return func(*args, params=params, **kwargs)
TypeError: search() got an unexpected keyword argument 'doc_type'
Can somebody help me please?
samsowa
commented
5 years ago
EDIT THIS TITLE BEFORE POSTING. Use this template for bug reports. If you'd like to request a feature, please be as descriptive as possible and delete the template except the first section (Request Type)
Request Type
(select Bug or Feature Request and remove this part) Bug / Feature Request
Work Environment
Problem Description
When I run thei command curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook, I am getting below error: **<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
Internal Server Error
The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
** ### Steps to Reproduce 1. step 1: I did fresh installed on a different VM running RedHat 7 1. step 2: I run the command again, and got the same error ### Possible Solutions (keep this section if you have suggestions on how to solve the problem. **Otherwise delete it**) **First running Hippocampe** [iranalyst@hippo core]$ sudo python app.py * Serving Flask app "app" (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: off * Running on http://0.0.0.0:5000/ (Press CTRL+C to quit) **Initial hippo.conf file** hippo.conf [api] debug : False host : 0.0.0.0 port : 5000 threaded : True [elasticsearch] ip : 127.0.0.1 port : 9200 #indexNameES MUST BE LOWERCASE indexNameES : hippocampe typeNameESSource : source typeNameESNew : new typeNameESJobs: jobs [shadowbook] nbThreadPerCPU : 2 [freshness] #in days threshold : 1 [schedReport] #in hours threshold: 12 After added IP Address hippo.conf [api] debug : False host : 192.168.153.10 port : 5000 threaded : True [elasticsearch] ip : 127.0.0.1 port : 9200 #indexNameES MUST BE LOWERCASE indexNameES : hippocampe typeNameESSource : source typeNameESNew : new typeNameESJobs: jobs [shadowbook] nbThreadPerCPU : 2 [freshness] #in days threshold : 1 [schedReport] #in hours threshold: 12 **I ran the python app.py command again and below is the is result** [iranalyst@hippo core]$ sudo python app.py * Serving Flask app "app" (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: off * Running on http://192.168.153.10:5000/ (Press CTRL+C to quit) **Same error message shown below when I run curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook**Internal Server Error
The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
**Also, below are the logs I get when I run curl -XGET 192.168.153.10:5000/hippocampe/api/v1.0/shadowbook** [iranalyst@hippo core]$ sudo python app.py * Serving Flask app "app" (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: off * Running on http://192.168.152.132:5000/ (Press CTRL+C to quit) [2019-10-31 14:24:26,492] ERROR in app: Exception on /hippocampe/api/v1.0/shadowbook [GET] Traceback (most recent call last): File "/usr/lib64/python2.7/site-packages/flask/app.py", line 2446, in wsgi_app response = self.full_dispatch_request() File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1951, in full_dispatch_request rv = self.handle_user_exception(e) File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1820, in handle_user_exception reraise(exc_type, exc_value, tb) File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1949, in full_dispatch_request rv = self.dispatch_request() File "/usr/lib64/python2.7/site-packages/flask/app.py", line 1935, in dispatch_request return self.view_functions[rule.endpoint](**req.view_args) File "app.py", line 168, in shadowbookService if 'error' in reportJob: TypeError: argument of type 'NoneType' is not iterable 192.168.152.132 - - [31/Oct/2019 14:24:26] "GET /hippocampe/api/v1.0/shadowbook HTTP/1.1" 500 - **Below are the Hippocampe logs** 2019-10-31 14:20:30,591 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:30,921 :: services :: INFO :: type service requested 2019-10-31 14:20:30,921 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:30,925 :: services :: INFO :: sizeByType service requested 2019-10-31 14:20:30,926 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:30,927 :: services :: INFO :: sizeBySources service requested 2019-10-31 14:20:30,927 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:30,936 :: services :: INFO :: monitorSources service requested 2019-10-31 14:20:30,936 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:31,180 :: services.modules.common.ES :: INFO :: ES.checkData launched 2019-10-31 14:20:31,181 :: services.modules.common.ES :: INFO :: [] 2019-10-31 14:20:31,238 :: services.modules.common.ES :: INFO :: ES.checkData launched 2019-10-31 14:20:31,238 :: services.modules.common.ES :: INFO :: ['sourceType'] 2019-10-31 14:20:31,239 :: services.modules.common.ES :: INFO :: ES.checkData launched 2019-10-31 14:20:31,240 :: services.modules.common.ES :: INFO :: ['sourceType'] 2019-10-31 14:20:31,240 :: services.modules.common.ES :: INFO :: ES.checkData launched 2019-10-31 14:20:31,244 :: services.modules.common.ES :: INFO :: ['sourceType'] 2019-10-31 14:20:31,500 :: services.modules.common.ES :: INFO :: index hippocampe does not exist 2019-10-31 14:20:31,500 :: services :: ERROR :: no data 2019-10-31 14:20:31,501 :: services.modules.common.ES :: INFO :: index hippocampe does not exist 2019-10-31 14:20:31,503 :: services :: ERROR :: no data 2019-10-31 14:20:31,505 :: services :: INFO :: type service requested 2019-10-31 14:20:31,505 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:20:31,511 :: services.modules.common.ES :: INFO :: index hippocampe does not exist 2019-10-31 14:20:31,512 :: services :: ERROR :: no data 2019-10-31 14:20:31,514 :: services.modules.common.ES :: INFO :: ES.checkData launched 2019-10-31 14:20:31,514 :: services.modules.common.ES :: INFO :: [] 2019-10-31 14:20:31,703 :: services.modules.common.ES :: INFO :: index hippocampe does not exist 2019-10-31 14:20:31,703 :: services :: ERROR :: no data 2019-10-31 14:20:31,705 :: services.modules.common.ES :: INFO :: index hippocampe does not exist 2019-10-31 14:20:31,706 :: services :: ERROR :: no data 2019-10-31 14:24:26,090 :: services :: INFO :: shadowbook service requested 2019-10-31 14:24:26,091 :: services.modules.common.ES :: INFO :: ES.checkES launched 2019-10-31 14:24:26,099 :: services.shadowbook :: INFO :: shadowbook.initJob launched 2019-10-31 14:24:26,490 :: services.shadowbook :: ERROR :: search() got an unexpected keyword argument 'doc_type' Traceback (most recent call last): File "/opt/Hippocampe/core/services/shadowbook.py", line 80, in initJob nbOngoingJob = job.searchOngoingJob() File "/opt/Hippocampe/core/services/modules/shadowbook/objects/Job.py", line 76, in searchOngoingJob nbOngoingJob = self.search() File "/opt/Hippocampe/core/services/modules/shadowbook/objects/ObjToIndex.py", line 67, in search self.resSearch = self.es.search(index = self.indexNameES, doc_type = self.typeNameES, body = self.docSearch) File "/usr/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 84, in _wrapped return func(*args, params=params, **kwargs) TypeError: search() got an unexpected keyword argument 'doc_type' Can somebody help me please?