If I select a band which I have not specified in my threshold list, I get logged out and errors on the server log

[jkubNTIA]

I noticed there was a 4th band shown in the list of bands on the map page for LTE_UL_DL_bc17_bc13_ts109_p2.dat LTE data:

745960000, 756040000

I selected this band on the map page and then I clicked on 'generate occupancy' report. I get logged out and this is my stack trace:

Log Message : URL = http://localhost:8000/spectrumbrowser/generateSingleAcquisitionSpectrogramAndOccupancy/ECR16W4XS/1405048115/LTE/745960000/756040000/user-142677459434143578040 updated session ID expireTime {'SensorID': u'ECR16W4XS', 'freqRange': u'LTE:745960000:756040000', 't': 1405048115} Unexpected error: <class 'pymongo.errors.OperationFailure'> (<class 'pymongo.errors.OperationFailure'>, OperationFailure(u'database error: bad offset:0 accessing file: /home/jkub/Documents/SpectrumBrowser/flask/data/db/spectrumdb.0. See http://dochub.mongodb.org/core/data-recovery',), <traceback object at 0x7fbe97126998>) Traceback (most recent call last): File "/home/jkub/Documents/SpectrumBrowser/flask/flaskr.py", line 1496, in generateSingleAcquisitionSpectrogramWorker result = GenerateSpectrogram.generateSingleAcquisitionSpectrogramAndOccupancyForFFTPower(msg, sessionId) File "/home/jkub/Documents/SpectrumBrowser/flask/GenerateSpectrogram.py", line 254, in generateSingleAcquisitionSpectrogramAndOccupancyForFFTPower messageBytes = fs.get(ObjectId(msg[DATA_KEY])).read() File "/usr/lib/python2.7/dist-packages/gridfs/init.py", line 140, in get return GridOut(self.collection, file_id) File "/usr/lib/python2.7/dist-packages/gridfs/grid_file.py", line 388, in __init self._file = file_document or files.find_one({"_id": file_id}) File "/usr/lib/python2.7/dist-packages/pymongo/collection.py", line 604, in find_one for result in self.find(spec_or_id, _args, _kwargs).limit(-1): File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 904, in next if len(self.data) or self._refresh(): File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 848, in _refresh self.uuid_subtype)) File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 800, in __send_message self.__uuid_subtype) File "/usr/lib/python2.7/dist-packages/pymongo/helpers.py", line 100, in _unpack_response error_object["$err"]) OperationFailure: database error: bad offset:0 accessing file: /home/jkub/Documents/SpectrumBrowser/flask/data/db/spectrumdb.0. See http://dochub.mongodb.org/core/data-recovery Unexpected error: <class 'pymongo.errors.OperationFailure'> (<class 'pymongo.errors.OperationFailure'>, OperationFailure(u'database error: bad offset:0 accessing file: /home/jkub/Documents/SpectrumBrowser/flask/data/db/spectrumdb.0. See http://dochub.mongodb.org/core/data-recovery',), <traceback object at 0x7fbe970ece18>) Traceback (most recent call last): File "/home/jkub/Documents/SpectrumBrowser/flask/flaskr.py", line 160, in testcase_decorator return original_function(_args, _kwargs) File "/home/jkub/Documents/SpectrumBrowser/flask/flaskr.py", line 1496, in generateSingleAcquisitionSpectrogramWorker result = GenerateSpectrogram.generateSingleAcquisitionSpectrogramAndOccupancyForFFTPower(msg, sessionId) File "/home/jkub/Documents/SpectrumBrowser/flask/GenerateSpectrogram.py", line 254, in generateSingleAcquisitionSpectrogramAndOccupancyForFFTPower messageBytes = fs.get(ObjectId(msg[DATA_KEY])).read() File "/usr/lib/python2.7/dist-packages/gridfs/init.py", line 140, in get return GridOut(self.collection, file_id) File "/usr/lib/python2.7/dist-packages/gridfs/grid_file.py", line 388, in __init self._file = file_document or files.find_one({"_id": file_id}) File "/usr/lib/python2.7/dist-packages/pymongo/collection.py", line 604, in find_one for result in self.find(spec_or_id, _args, *_kwargs).limit(-1): File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 904, in next if len(self.data) or self._refresh(): File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 848, in _refresh self.uuid_subtype)) File "/usr/lib/python2.7/dist-packages/pymongo/cursor.py", line 800, in __send_message self.__uuid_subtype) File "/usr/lib/python2.7/dist-packages/pymongo/helpers.py", line 100, in _unpack_response error_object["$err"]) OperationFailure: database error: bad offset:0 accessing file: /home/jkub/Documents/SpectrumBrowser/flask/data/db/spectrumdb.0. See http://dochub.mongodb.org/core/data-recovery Log Message : Error communicating with server

[ranganathanm]

Unable to reproduce. Please delete and repopulate your db. You can just purge the sensors. Please revert back to me with traces after you have done so. Thanks.

[jkubNTIA]

Rather than just doing a 'purge' of the data which leaves the 'spectrumdb' collection, I instead did a rm spectrumdb.* from the disk. Now I cannot reproduce this either, even if I purge and add my data again. Something must have been left around in the database. Ranga will look at a better way of storing the data in one collection per sensor instead of all the data in the same collection.