search

nasa-jpl-memex / GeoParser

Extract and Visualize location from any file
Apache License 2.0
52 stars 23 forks source link

Loading Solr index to GeoParser #59

Closed jung-jung-yeh closed 8 years ago

jung-jung-yeh commented 8 years ago

We are trying to pass an indexed data to GeoParser through the GeoParser webpage,

However, we got the following errors from server log

[30/Mar/2016 07:53:37] "GET /return_points_khooshe/http://25.150.29.198:8984/solr/ HTTP/1.1" 500 13158 Internal Server Error: /return_points_khooshe/http://25.150.29.198:8984/solr/ Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py", line 149, in get_response response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py", line 147, in get_response response = wrapped_callback(request, _callback_args, *_callback_kwargs) File "/home/599/hw2/GeoParser/geoparser_app/views.py", line 210, in return_points_khooshe results["rows_processed"] = GetIndexSize(core_name) File "/home/599/hw2/GeoParser/geoparser_app/solr.py", line 300, in GetIndexSize rows_processed = requests.get(url, headers=headers).json()['response']['numFound'] File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 763, in json return json.loads(self.text, kwargs) File "/usr/lib/python2.7/json/init.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python2.7/json/decoder.py", line 384, in raw_decode raise ValueError("No JSON object could be decoded") ValueError: No JSON object could be decoded [30/Mar/2016 07:53:39] "GET /return_points_khooshe/http://25.150.29.198:8984/solr/ HTTP/1.1" 500 13158**

Could you please help us how to successfully pass our indexed core to GeoParser? Thanks! Solr 5.3 used by GeoParser runs on port 8983

and Solr 4.10 is running on port 8984 contained our indexed core.

25.150.29.198 is virtual IP so you won't be able to access it :(

thanks!

2016-03-30 12 50 23 2016-03-30 12 50 02

smadha commented 8 years ago

Hi @jung-jung-yeh , Can you please tell if there is geo parsed data stored at http://localhost:8983/solr/#/ with core as test1_* * should be 1 ??

Also you might want to debug at geoparser_app/solr.py, line 300 to see what is getting returned from requests.get(url, headers=headers)

Thanks

jung-jung-yeh commented 8 years ago

Hi Madhav,

We tried again with the wiki page https://github.com/MBoustani/GeoParser/wiki/Steps-for-geoparsing-a-Index, with our newly indexed data. we checked the response is

[30/Mar/2016 23:02:32] "GET /return_points_khooshe/http://25.150.29.198:8985/solr/solr/test_domain HTTP/1.1" 500 12821 {"responseHeader":{"status":400,"QTime":1},"error":{"msg":"Exception writing document id test_domain to the index; possible analysis error.","code":400}} Internal Server Error: /query_crawled_index/http://25.150.29.198:8985/solr/solr/test_domain/user/pass

Is this issue related to localhost? We run our program on a linux server, and we use our computer to browse MEMEX GeoParser through IP instead of localhost, will it be a problem?

Will you have time today at school so we could maybe debug this together? Thanks 2016-03-30 4 02 34 2016-03-30 4 02 07

smadha commented 8 years ago

Ok so I didn't noticed that you deployed on remote machine.

You can ping me on hangouts - msharan@usc.edu. Also @antrromet and @adityardesai have successfully installed GeoParser from your course in case they can help

jung-jung-yeh commented 8 years ago

we finally loaded the data and see the visualization! thanks for the help! the explanation is very nice