search

tcgoetz / GarminDB

Download and parse data from Garmin Connect or a Garmin watch, FitBit CSV, and MS Health CSV files into and analyze data in Sqlite serverless databases with Jupyter notebooks.
GNU General Public License v2.0
1.1k stars 138 forks source link

SQL Failed to write message - INSTERT INTO activities_devices - Fenix 7 support? #187

Closed philosowaffle closed 1 year ago

philosowaffle commented 1 year ago

Is your feature request related to a problem? Please describe. Error thrown on some activity files. Possibly need to add support for Fenix 7 device? FIT files mentioned in logs are attached. Error seems to be thrown during the "Analyzing Data" step.

Additional context

garmindb    | Running incremental sync
garmindb    | ___Downloading Latest Data___
garmindb    | Getting activities: '/root/HealthData/FitFiles/Activities' (250) temp /tmp/tmp83718yoh
100%|██████████| 250/250 [00:00<00:00, 3635.28activities/s]
garmindb    | ___Importing Latest Data___
garmindb    | Processing profile data
100%|██████████| 1/1 [00:00<00:00,  2.76files/s]
garmindb    | Processing [<FileType.settings: 2>] FIT data from /root/HealthData/FitFiles
garmindb    | Processing activities tcx data
garmindb    | Processing latest activities summary data from /root/HealthData/FitFiles/Activities
100%|██████████| 3/3 [00:00<00:00,  3.78files/s]
garmindb    | Processing activities detail data
100%|██████████| 3/3 [00:00<00:00, 18.84files/s]
garmindb    | Processing [<FileType.activity: 4>] FIT data from /root/HealthData/FitFiles/Activities
  0%|          | 0/3 [00:00<?, ?files/s]Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(1), device_type(<LocalDeviceType.barometer: 4> (4)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely)
garmindb    | (sqlite3.OperationalError) disk I/O error
garmindb    | [SQL: INSERT INTO activities_devices (activity_id, device_serial_number) VALUES (?, ?)]
garmindb    | [parameters: ('11501966489', 3436739231)]
garmindb    | (Background on this error at: https://sqlalche.me/e/20/e3q8)
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number(3412596433), cum_operating_time(datetime.time(0, 0, 10, 951272) (10951272)), unknown_8([invalid] (4294967295)), ant_related(2.0), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2172131025), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(2), device_type(<AntplusDeviceType.heart_rate: 120> (120)), hardware_version(66.0), unknown_9([invalid] (255)), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number(3412596433), cum_operating_time(datetime.time(0, 0, 10, 951272) (10951272)), unknown_8([invalid] (4294967295)), ant_related(3.0), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2166232785), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(4), device_type(<AntplusDeviceType.run: 30> (30)), hardware_version(66.0), unknown_9([invalid] (255)), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(5), device_type(<LocalDeviceType.accelerometer: 3> (3)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(6), device_type(<LocalDeviceType.bluetooth_low_energy_chipset: 8> (8)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 14, tzinfo=datetime.timezone.utc) (1057599074)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('24.22' (2422)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(7), device_type(<LocalDeviceType.sensor_hub: 12> (12)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 17, 31, 57, tzinfo=datetime.timezone.utc) (1057599117)), serial_number(3412596433), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related(168.0), unknown_16(4.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2239502033), unknown_31(4.0), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(3), device_type(<AntplusDeviceType.stride_speed_distance: 124> (124)), hardware_version(66.0), unknown_9(98.0), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number(3436739231), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(0), device_type(<MainDeviceType.other: 254> (255)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(1), device_type(<LocalDeviceType.barometer: 4> (4)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number(3412596433), cum_operating_time(datetime.time(0, 0, 0, 468872) (468872)), unknown_8([invalid] (4294967295)), ant_related(6986.0), unknown_16(190.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2172131025), unknown_31(137.0), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(2), device_type(<AntplusDeviceType.heart_rate: 120> (120)), hardware_version(66.0), unknown_9(97.0), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number(3412596433), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related(6841.0), unknown_16(145.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2239502033), unknown_31(269.0), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(3), device_type(<AntplusDeviceType.stride_speed_distance: 124> (124)), hardware_version(66.0), unknown_9(98.0), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number(3412596433), cum_operating_time(datetime.time(0, 0, 10, 953044) (10953044)), unknown_8([invalid] (4294967295)), ant_related(6896.0), unknown_16(162.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2166232785), unknown_31(255.0), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(4), device_type(<AntplusDeviceType.run: 30> (30)), hardware_version(66.0), unknown_9(98.0), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(5), device_type(<LocalDeviceType.accelerometer: 3> (3)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(6), device_type(<LocalDeviceType.bluetooth_low_energy_chipset: 8> (8)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 1, 15, tzinfo=datetime.timezone.utc) (1057600875)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('24.22' (2422)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(7), device_type(<LocalDeviceType.sensor_hub: 12> (12)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to parse /root/HealthData/FitFiles/Activities/11501966489_ACTIVITY.fit: Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
 33%|███▎      | 1/3 [00:02<00:04,  2.06s/files]Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 4, 49, tzinfo=datetime.timezone.utc) (1057601089)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(1), device_type(<LocalDeviceType.barometer: 4> (4)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely)
garmindb    | (sqlite3.OperationalError) disk I/O error
garmindb    | [SQL: INSERT INTO activities_devices (activity_id, device_serial_number) VALUES (?, ?)]
garmindb    | [parameters: ('11502265972', 3436739231)]
garmindb    | (Background on this error at: https://sqlalche.me/e/20/e3q8)
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 4, 49, tzinfo=datetime.timezone.utc) (1057601089)), serial_number(3412596433), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related(3.0), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2172131025), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(2), device_type(<AntplusDeviceType.heart_rate: 120> (120)), hardware_version(66.0), unknown_9([invalid] (255)), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 4, 49, tzinfo=datetime.timezone.utc) (1057601089)), serial_number(1288462089), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related(2.0), unknown_16(1.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(92036873), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product(<UnknownEnumValue.UnknownEnumValue_4660: 4660>), software_version('0.10' (10)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(3), device_type(<AntplusDeviceType.stride_speed_distance: 124> (124)), hardware_version([invalid] (255)), unknown_9(67.0), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 4, 49, tzinfo=datetime.timezone.utc) (1057601089)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(4), device_type(<LocalDeviceType.bluetooth_low_energy_chipset: 8> (8)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 4, 49, tzinfo=datetime.timezone.utc) (1057601089)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('24.22' (2422)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(5), device_type(<LocalDeviceType.sensor_hub: 12> (12)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 37, 55, tzinfo=datetime.timezone.utc) (1057603075)), serial_number(3436739231), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(0), device_type(<MainDeviceType.other: 254> (255)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 37, 55, tzinfo=datetime.timezone.utc) (1057603075)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('13.22' (1322)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(1), device_type(<LocalDeviceType.barometer: 4> (4)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 37, 55, tzinfo=datetime.timezone.utc) (1057603075)), serial_number(3412596433), cum_operating_time(datetime.time(0, 0, 0, 471094) (471094)), unknown_8([invalid] (4294967295)), ant_related(7828.0), unknown_16(239.0), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id(2172131025), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<GarminProduct.HRM_Pro: 3300> (3300)), software_version('8.80' (880)), battery_voltage(2.9765625 v (762)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(2), device_type(<AntplusDeviceType.heart_rate: 120> (120)), hardware_version(66.0), unknown_9(97.0), battery_status(<BatteryStatus.ok: 3> (3)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network(<AntNetwork.antplus: 1> (1)), unknown_23([invalid] (255)), source_type(<SourceType.antplus: 1> (1)), unknown_29([198.0, 186.0, 62.0, 173.0, 212.0, 254.0]), unknown_30(1.0), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 37, 55, tzinfo=datetime.timezone.utc) (1057603075)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer([invalid] (65535)), product([invalid] (65535)), software_version([invalid] (65535)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(4), device_type(<LocalDeviceType.bluetooth_low_energy_chipset: 8> (8)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to write message <MessageType.device_info: 23> type DataMessage(<MessageType.device_info: 23>: [timestamp(datetime.datetime(2023, 7, 6, 18, 37, 55, tzinfo=datetime.timezone.utc) (1057603075)), serial_number([invalid] (0)), cum_operating_time([invalid] (4294967295)), unknown_8([invalid] (4294967295)), ant_related([invalid] (4294967295)), unknown_16([invalid] (4294967295)), unknown_17([invalid] ([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])), sensor_id([invalid] (0)), unknown_31([invalid] (4294967295)), manufacturer(<Manufacturer.Garmin: 1> (1)), product(<UnknownEnumValue.UnknownEnumValue_3905: 3905>), software_version('24.22' (2422)), battery_voltage([invalid] v (65535)), unknown_13([invalid] (65535)), ant_device_number([invalid] (0)), device_index(5), device_type(<LocalDeviceType.sensor_hub: 12> (12)), hardware_version([invalid] (255)), unknown_9([invalid] (255)), battery_status([invalid] (255)), sensor_position([invalid] (255)), ant_transmission_type([invalid] (0)), ant_network([invalid] (255)), unknown_23([invalid] (255)), source_type(<SourceType.local: 5> (5)), unknown_29([invalid] ([255, 255, 255, 255, 255, 255])), unknown_30([invalid] (255)), unknown_32([invalid] (255))]): Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
garmindb    | Failed to parse /root/HealthData/FitFiles/Activities/11502265972_ACTIVITY.fit: Can't operate on closed transaction inside context manager.  Please complete the context manager before emitting further commands.
 67%|██████▋   | 2/3 [00:03<00:01,  1.40s/files]Failed to parse /root/HealthData/FitFiles/Activities/11508407598_ACTIVITY.fit: (sqlite3.OperationalError) disk I/O error
garmindb    | [SQL: SELECT devices.serial_number AS devices_serial_number, devices.timestamp AS devices_timestamp, devices.device_type AS devices_device_type, devices.manufacturer AS devices_manufacturer, devices.product AS devices_product, devices.hardware_version AS devices_hardware_version 
garmindb    | FROM devices 
garmindb    | WHERE devices.serial_number = ?]
garmindb    | [parameters: (3436739231,)]
garmindb    | (Background on this error at: https://sqlalche.me/e/20/e3q8)
100%|██████████| 3/3 [00:06<00:00,  2.26s/files]
garmindb    | ___Analyzing Data___
garmindb    | Summary Tables Generation:
garmindb    | Traceback (most recent call last):
garmindb    |   File "/usr/local/bin/garmindb_cli.py", line 358, in <module>
garmindb    |     main(sys.argv[1:])
garmindb    |   File "/usr/local/bin/garmindb_cli.py", line 345, in main
garmindb    |     analyze_data(args.trace)
garmindb    |   File "/usr/local/bin/garmindb_cli.py", line 238, in analyze_data
garmindb    |     analyze.summary()
garmindb    |   File "/usr/local/lib/python3.11/site-packages/garmindb/analyze.py", line 192, in summary
garmindb    |     for year in sorted(list(set(Monitoring.get_years(self.garmin_mon_db) + Activities.get_years(self.garmin_act_db)))):
garmindb    |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
garmindb    | TypeError: '<'

FIT.zip

tcgoetz commented 1 year ago

Which Fenix 7 watch is this?

tcgoetz commented 1 year ago

There should be a file garmindb.log that will have more information then was displayed on the screen.

tcgoetz commented 1 year ago

Fenix 7 support: https://github.com/tcgoetz/Fit/commit/f7e1d799e307eaa2221719530a681ef9796bf7f0

philosowaffle commented 1 year ago

fenix 7S Sapphire Solar

Currently running this script inside a docker container, I will see if I can get the more detailed log file exposed.

tcgoetz commented 1 year ago

fixed in: https://github.com/tcgoetz/GarminDB/releases/tag/v3.4.0