dexcom_reader.constants.CrcError: Could not parse Calibration with Dexcom G4 connected to USB

[PieterGit]

With current oref0@dev and Dexcom G4 connected to USB (CGM=G4-upload) I get the following stack trace.

$ cd ~/myopens-cgm-loop
$ openaps extras
cgm://JSON/nightscout_calibrations/monitor/cal.json
monitor/cal.json  raised  Could not parse Calibration
Traceback (most recent call last):
  File "/usr/local/bin/openaps-report", line 82, in <module>
    app( )
  File "/usr/local/lib/python2.7/dist-packages/openaps/cli/__init__.py", line 51, in __call__
    self.run(self.args)
  File "/usr/local/bin/openaps-report", line 75, in run
    output = app(args, self)
  File "/usr/local/lib/python2.7/dist-packages/openaps/cli/subcommand.py", line 52, in __call__
    return self.method.main(args, app)
  File "/usr/local/lib/python2.7/dist-packages/openaps/reports/invoke.py", line 40, in main
    output = task.method(args, app)
  File "/usr/local/lib/python2.7/dist-packages/openaps/uses/use.py", line 45, in __call__
    output = self.main(args, app)
  File "/usr/local/lib/python2.7/dist-packages/openaps/vendors/dexcom.py", line 830, in main
    results = super(iter_calibrations, self).main(args, app)
  File "/usr/local/lib/python2.7/dist-packages/openaps/vendors/dexcom.py", line 420, in main
    for item in candidates:
  File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 301, in iter_records
    records = list(self.ReadDatabasePage(record_type, x))
  File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 267, in GenericRecordYielder
    yield record_type.Create(data, x)
  File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 158, in Create
    return cls(unpacked_data, raw_data)
  File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 180, in __init__
    self.check_crc()
  File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 47, in check_crc
    raise constants.CrcError('Could not parse %s' % self.__class__.__name__)
dexcom_reader.constants.CrcError: Could not parse Calibration

This seems like a dexcom_reader issue. Reading the calibration records with a G4 Dexcom Reader with AndroidUploader app works fine, and the Dexcom G4 can also be read with Dexcom Studio fine. So I think there is a bug in the dexcom_reader logic but I'm incapable of finding the root cause.

@bewest or @LorelaiL or somebody else: Can you help me debug/fix this issue?

References which might be usefull:

• https://github.com/nightscout/android-uploader/blob/master/core/src/main/java/com/nightscout/core/dexcom/records/CalRecord.java
• https://github.com/openaps/dexcom_reader/blob/master/dexcom_reader/database_records.py
• commit of cal_set https://github.com/openaps/dexcom_reader/commit/cf10d70fe0c724286d6e84c869d63eefd077e331
• https://github.com/nightscout/android-uploader/blob/master/core/src/test/java/com/nightscout/core/dexcom/CalRecordTest.java

[jbwittmer]

Getting same error with 3 receivers. I'll append the message and Firmware info for each.

Here's the first (oldest):

pi@Raspi3:~/myopenaps-cgm-loop $ openaps use cgm GetFirmwareHeader { "DexBootVersion": "3", "RFVersion": "1.0.0.27", "ApiVersion": "2.3.0.0", "ProductName": "Dexcom G4 Receiver", "SoftwareNumber": "SW10557", "TestApiVersion": "2.4.0.0", "SchemaVersion": "1", "PortVersion": "4.6.4.50", "FirmwareVersion": "2.0.1.192", "ProductId": "G4Receiver" }pi@Raspi3:~/myopenaps-cgm-loop $

]pi@Raspi3:~/myopenaps-cgm-loop $ openaps use cgm calibrations Traceback (most recent call last): File "/usr/local/bin/openaps-use", line 63, in app( ) File "/usr/local/lib/python2.7/dist-packages/openaps/cli/init.py", line 51, in call self.run(self.args) File "/usr/local/bin/openaps-use", line 57, in run output = app(args, self) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/init.py", line 92, in call return self.method.selected(args)(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/init.py", line 31, in call return self.method(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/use.py", line 45, in call output = self.main(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/vendors/dexcom.py", line 275, in main records = self.dexcom.ReadRecords(self.RECORD_TYPE) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 314, in ReadRecords records.extend(self.ReadDatabasePage(record_type, x)) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 267, in GenericRecordYielder yield record_type.Create(data, x) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 158, in Create return cls(unpacked_data, raw_data) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 180, in init self.check_crc() File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 47, in check_crc raise constants.CrcError('Could not parse %s' % self.class.name) dexcom_reader.constants.CrcError: Could not parse Calibration pi@Raspi3:~/myopenaps-cgm-loop $

[jbwittmer]

The second receiver gives similar output. Here's the firmware header message:
$ openaps use cgm GetFirmwareHeader { "DexBootVersion": "3", "RFVersion": "1.0.0.27", "ApiVersion": "2.3.0.0", "ProductName": "Dexcom G4 Receiver", "SoftwareNumber": "SW10557", "TestApiVersion": "2.4.0.0", "SchemaVersion": "1", "PortVersion": "4.6.4.50", "FirmwareVersion": "2.0.1.192", "ProductId": "G4Receiver" }pi@Raspi3:~/myope

And here's the output from use cgm calibrations:

pi@Raspi3:~/myopenaps-cgm-loop $ openaps use cgm calibrations Traceback (most recent call last): File "/usr/local/bin/openaps-use", line 63, in app( ) File "/usr/local/lib/python2.7/dist-packages/openaps/cli/init.py", line 51, in call self.run(self.args) File "/usr/local/bin/openaps-use", line 57, in run output = app(args, self) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/init.py", line 92, in call return self.method.selected(args)(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/init.py", line 31, in call return self.method(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/uses/use.py", line 45, in call output = self.main(args, app) File "/usr/local/lib/python2.7/dist-packages/openaps/vendors/dexcom.py", line 275, in main records = self.dexcom.ReadRecords(self.RECORD_TYPE) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 314, in ReadRecords records.extend(self.ReadDatabasePage(record_type, x)) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/readdata.py", line 267, in GenericRecordYielder yield record_type.Create(data, x) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 158, in Create return cls(unpacked_data, raw_data) File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 180, in init self.check_crc() File "/usr/local/lib/python2.7/dist-packages/dexcom_reader/database_records.py", line 47, in check_crc raise constants.CrcError('Could not parse %s' % self.class.name) dexcom_reader.constants.CrcError: Could not parse Calibration pi@Raspi3:

[PieterGit]

I think it's ApiVersion 2.3.0.0 related. Here is my info:

# openaps use cgm GetFirmwareHeader
{
  "DexBootVersion": "6",
  "RFVersion": "1.0.0.28",
  "ApiVersion": "2.3.0.0",
  "ProductName": "Dexcom G4 Receiver",
  "SoftwareNumber": "SW10324",
  "TestApiVersion": "2.4.0.0",
  "SchemaVersion": "1",
  "PortVersion": "4.6.4.60",
  "FirmwareVersion": "2.0.1.216",
  "ProductId": "G4Receiver"
}

@danamlewis (or others): Could you post your firmware / api version for which calibrations work fine?