Precision issue when validating infusion rate

BUG DESCRIPTION

Problem

FAILED: col013a_tracebase_studydoc.xlsx
ConflictingValueErrors
Conflicting values encountered during loading:
    During the processing of sheet [Animals] in col013a_tracebase_studydoc.xlsx...
    Creation of the following Animal record(s) encountered conflicts:
        File record:     {'name': 'col013a_M01', 'genotype': 'C57BL/6', 'infusate': <Infusate: serine-[13C3][142]>, 'infusion_rate': 0.11583011583011583, 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 2)
        Database record: {'name': 'col013a_M01', 'infusate': 68, 'infusion_rate': 0.115830115830116, 'genotype': 'C57BL/6', 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4043, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
            [infusion_rate] values differ:
            - database: [0.115830115830116]
            - file:     [0.11583011583011583]

Steps to reproduce

Validate file: col013a_tracebase_studydoc.xlsx

Current behavior

A number of conflicting value errors are generated. See the Problem section above.

Expected behavior

The numbers are close enough such that they should not trigger this error.

Suggested Change

See the first comment below.

This is probably related to the fact that the field calculates the infusion rate using a formula. In either case, probably Math.is_close (I might have the method name wrong) would be good to use. In the abocve error, the actual value displayed in Excel in the Animals sheet is calculated via the formula: =3/F2 which evaluates to 0.115830116. F3 is the Animal Body Weight column.

Comment

None

ISSUE OWNER SECTION

Assumptions

List of assumptions made WRT the code
E.g. We will assume input is correct (explaining why there is no validation)

Limitations

A list of things this work will specifically not do
E.g. This feature will only handle the most frequent use case X

Affected Components

change: File path or DB table ...
add: Environment variable or server setting
delete: External executable or cron job

Requirements

[ ] 1. List of numbered conditions to be met for the feature
[ ] 2. E.g. Every column/row must display a value, i.e. cannot be empty
[ ] 3. Numbers for reference & checkboxes for progress tracking

DESIGN

GUI Change description

None provided

Code Change Description

None provided

Tests

[ ] 1. A description of at least one test for each requirement above.
[ ] 2. E.g. Test for req 2 that there's an exception when display value is ''
[ ] 3. Numbers for reference & checkboxes for progress tracking

Note, I just learned that I do not get these errors from the file linked in the issue in my sandbox (on my laptop - check my iMac) - only on the dev site, so this could have to do with either postgres or a dependency. I should check the versions and see if we need to increase the version number in the dependencies...

branch: water_fixes

[Sun Sep 01 13:18:44.332710 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 567, in dispatch
[Sun Sep 01 13:18:44.332867 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return super(DataValidationView, self).dispatch(request, *args, **kwargs)
[Sun Sep 01 13:18:44.332951 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 599, in post
[Sun Sep 01 13:18:44.333022 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self.form_valid(form)
[Sun Sep 01 13:18:44.333095 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 608, in form_valid
[Sun Sep 01 13:18:44.333157 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     study_data = self.get_download_data()
[Sun Sep 01 13:18:44.333233 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 653, in get_download_data
[Sun Sep 01 13:18:44.333294 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.validate_study()
[Sun Sep 01 13:18:44.333365 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 2633, in validate_study
[Sun Sep 01 13:18:44.333444 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     sl.load_data()
[Sun Sep 01 13:18:44.333523 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
[Sun Sep 01 13:18:44.333584 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     retval = fn(*args, **kwargs)
[Sun Sep 01 13:18:44.333655 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
[Sun Sep 01 13:18:44.333716 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     fn(*args, **kwargs)
[Sun Sep 01 13:18:44.333787 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/study_loader.py", line 430, in load_data
[Sun Sep 01 13:18:44.333848 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     loader.load_data()
[Sun Sep 01 13:18:44.333919 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2196, in load_wrapper
[Sun Sep 01 13:18:44.333980 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.aggregated_errors_object.buffer_exception(
[Sun Sep 01 13:18:44.334046 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2337, in buffer_exception
[Sun Sep 01 13:18:44.334113 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     buffered_tb_str = self.get_buffered_traceback_string()
[Sun Sep 01 13:18:44.334178 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2317, in get_buffered_traceback_string
[Sun Sep 01 13:18:44.334255 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     for step in traceback.format_stack()
[Sun Sep 01 13:18:44.334327 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] EXCEPTION1(ERROR): ConflictingValueErrors: Conflicting values encountered during loading:
[Sun Sep 01 13:18:44.334399 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \tDuring the processing of sheet [Animals] in col013a_tracebase_studydoc.xlsx...
[Sun Sep 01 13:18:44.334465 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \tCreation of the following Animal record(s) encountered conflicts:
[Sun Sep 01 13:18:44.334531 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M01', 'genotype': 'C57BL/6', 'infusate': <Infusate: serine-[13C3][142]>, 'infusion_rate': 0.11583011583011583, 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 2)
[Sun Sep 01 13:18:44.334605 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M01', 'infusate': 68, 'infusion_rate': 0.115830115830116, 'genotype': 'C57BL/6', 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4043, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.334677 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.334747 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.115830115830116]
[Sun Sep 01 13:18:44.334812 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.11583011583011583]
[Sun Sep 01 13:18:44.334876 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M02', 'genotype': 'C57BL/6', 'infusate': <Infusate: serine-[13C3][142]>, 'infusion_rate': 0.12396694214876033, 'body_weight': 24.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 3)
[Sun Sep 01 13:18:44.334941 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M02', 'infusate': 68, 'infusion_rate': 0.12396694214876, 'genotype': 'C57BL/6', 'body_weight': 24.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4073, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.335010 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.335081 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.12396694214876]
[Sun Sep 01 13:18:44.335146 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.12396694214876033]
[Sun Sep 01 13:18:44.335211 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M03', 'genotype': 'C57BL/6', 'infusate': <Infusate: histidine-[13C6,15N3][33.3]>, 'infusion_rate': 0.11029411764705882, 'body_weight': 27.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fed', 'treatment': <Protocol: no treatment>} (on row(s): 4)
[Sun Sep 01 13:18:44.335274 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M03', 'infusate': 66, 'infusion_rate': 0.110294117647059, 'genotype': 'C57BL/6', 'body_weight': 27.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fed', 'treatment': 6, 'last_serum_sample': 3923, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.335349 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.335428 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.110294117647059]
[Sun Sep 01 13:18:44.335497 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.11029411764705882]
[Sun Sep 01 13:18:44.335562 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M04', 'genotype': 'C57BL/6', 'infusate': <Infusate: histidine-[13C6,15N3][33.3]>, 'infusion_rate': 0.1195219123505976, 'body_weight': 25.1, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 5)
[Sun Sep 01 13:18:44.335626 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M04', 'infusate': 66, 'infusion_rate': 0.119521912350598, 'genotype': 'C57BL/6', 'body_weight': 25.1, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 3968, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.335697 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.335766 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.119521912350598]
[Sun Sep 01 13:18:44.335831 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.1195219123505976]
[Sun Sep 01 13:18:44.335896 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M05', 'genotype': 'C57BL/6', 'infusate': <Infusate: methionine-[13C5][33.3]>, 'infusion_rate': 0.10948905109489052, 'body_weight': 27.4, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 6)
[Sun Sep 01 13:18:44.335960 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M05', 'infusate': 67, 'infusion_rate': 0.109489051094891, 'genotype': 'C57BL/6', 'body_weight': 27.4, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 3983, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.336030 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.336102 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.109489051094891]
[Sun Sep 01 13:18:44.336166 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.10948905109489052]
[Sun Sep 01 13:18:44.336231 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tFile record:     {'name': 'col013a_M06', 'genotype': 'C57BL/6', 'infusate': <Infusate: methionine-[13C5][33.3]>, 'infusion_rate': 0.10830324909747292, 'body_weight': 27.7, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 7)
[Sun Sep 01 13:18:44.336295 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M06', 'infusate': 67, 'infusion_rate': 0.108303249097473, 'genotype': 'C57BL/6', 'body_weight': 27.7, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4013, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.336369 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
[Sun Sep 01 13:18:44.336448 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- database: [0.108303249097473]
[Sun Sep 01 13:18:44.336516 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t- file:     [0.10830324909747292]

Without the timestamps

   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 567, in dispatch
     return super(DataValidationView, self).dispatch(request, *args, **kwargs)
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 599, in post
     return self.form_valid(form)
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 608, in form_valid
     study_data = self.get_download_data()
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 653, in get_download_data
     self.validate_study()
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 2633, in validate_study
     sl.load_data()
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
     retval = fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
     fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/loaders/study_loader.py", line 430, in load_data
     loader.load_data()
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2196, in load_wrapper
     self.aggregated_errors_object.buffer_exception(
   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2337, in buffer_exception
     buffered_tb_str = self.get_buffered_traceback_string()
   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2317, in get_buffered_traceback_string
     for step in traceback.format_stack()
 EXCEPTION1(ERROR): ConflictingValueErrors: Conflicting values encountered during loading:
 \tDuring the processing of sheet [Animals] in col013a_tracebase_studydoc.xlsx...
 \tCreation of the following Animal record(s) encountered conflicts:
 \t\tFile record:     {'name': 'col013a_M01', 'genotype': 'C57BL/6', 'infusate': <Infusate: serine-[13C3][142]>, 'infusion_rate': 0.11583011583011583, 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 2)
 \t\tDatabase record: {'name': 'col013a_M01', 'infusate': 68, 'infusion_rate': 0.115830115830116, 'genotype': 'C57BL/6', 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4043, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
 \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.115830115830116]
 \t\t\t- file:     [0.11583011583011583]
 \t\tFile record:     {'name': 'col013a_M02', 'genotype': 'C57BL/6', 'infusate': <Infusate: serine-[13C3][142]>, 'infusion_rate': 0.12396694214876033, 'body_weight': 24.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 3)
 \t\tDatabase record: {'name': 'col013a_M02', 'infusate': 68, 'infusion_rate': 0.12396694214876, 'genotype': 'C57BL/6', 'body_weight': 24.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4073, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
 \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.12396694214876]
 \t\t\t- file:     [0.12396694214876033]
 \t\tFile record:     {'name': 'col013a_M03', 'genotype': 'C57BL/6', 'infusate': <Infusate: histidine-[13C6,15N3][33.3]>, 'infusion_rate': 0.11029411764705882, 'body_weight': 27.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fed', 'treatment': <Protocol: no treatment>} (on row(s): 4)
[Sun Sep 01 13:18:44.335274 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tDatabase record: {'name': 'col013a_M03', 'infusate': 66, 'infusion_rate': 0.110294117647059, 'genotype': 'C57BL/6', 'body_weight': 27.2, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fed', 'treatment': 6, 'last_serum_sample': 3923, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
[Sun Sep 01 13:18:44.335349 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.110294117647059]
 \t\t\t- file:     [0.11029411764705882]
 \t\tFile record:     {'name': 'col013a_M04', 'genotype': 'C57BL/6', 'infusate': <Infusate: histidine-[13C6,15N3][33.3]>, 'infusion_rate': 0.1195219123505976, 'body_weight': 25.1, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 5)
 \t\tDatabase record: {'name': 'col013a_M04', 'infusate': 66, 'infusion_rate': 0.119521912350598, 'genotype': 'C57BL/6', 'body_weight': 25.1, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 3968, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
 \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.119521912350598]
 \t\t\t- file:     [0.1195219123505976]
 \t\tFile record:     {'name': 'col013a_M05', 'genotype': 'C57BL/6', 'infusate': <Infusate: methionine-[13C5][33.3]>, 'infusion_rate': 0.10948905109489052, 'body_weight': 27.4, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 6)
 \t\tDatabase record: {'name': 'col013a_M05', 'infusate': 67, 'infusion_rate': 0.109489051094891, 'genotype': 'C57BL/6', 'body_weight': 27.4, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 3983, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
 \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.109489051094891]
 \t\t\t- file:     [0.10948905109489052]
 \t\tFile record:     {'name': 'col013a_M06', 'genotype': 'C57BL/6', 'infusate': <Infusate: methionine-[13C5][33.3]>, 'infusion_rate': 0.10830324909747292, 'body_weight': 27.7, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': <Protocol: no treatment>} (on row(s): 7)
 \t\tDatabase record: {'name': 'col013a_M06', 'infusate': 67, 'infusion_rate': 0.108303249097473, 'genotype': 'C57BL/6', 'body_weight': 27.7, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4013, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}
 \t\t\t[infusion_rate] values differ:
 \t\t\t- database: [0.108303249097473]
 \t\t\t- file:     [0.10830324909747292]

The above were the summary errors. Here's the trace of one of the specific errors:

[Sun Sep 01 13:18:44.144372 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 567, in dispatch
[Sun Sep 01 13:18:44.144550 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return super(DataValidationView, self).dispatch(request, *args, **kwargs)
[Sun Sep 01 13:18:44.144634 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 599, in post
[Sun Sep 01 13:18:44.144705 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self.form_valid(form)
[Sun Sep 01 13:18:44.144779 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 608, in form_valid
[Sun Sep 01 13:18:44.144848 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     study_data = self.get_download_data()
[Sun Sep 01 13:18:44.144920 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 653, in get_download_data
[Sun Sep 01 13:18:44.144983 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.validate_study()
[Sun Sep 01 13:18:44.145054 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 2633, in validate_study
[Sun Sep 01 13:18:44.145115 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     sl.load_data()
[Sun Sep 01 13:18:44.145186 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
[Sun Sep 01 13:18:44.145247 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     retval = fn(*args, **kwargs)
[Sun Sep 01 13:18:44.145318 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
[Sun Sep 01 13:18:44.145392 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     fn(*args, **kwargs)
[Sun Sep 01 13:18:44.145463 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/study_loader.py", line 430, in load_data
[Sun Sep 01 13:18:44.145523 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     loader.load_data()
[Sun Sep 01 13:18:44.145594 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
[Sun Sep 01 13:18:44.145656 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     retval = fn(*args, **kwargs)
[Sun Sep 01 13:18:44.145727 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
[Sun Sep 01 13:18:44.145794 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     fn(*args, **kwargs)
[Sun Sep 01 13:18:44.145869 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 285, in load_data
[Sun Sep 01 13:18:44.145930 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     animal, _ = self.get_or_create_animal(row, infusate, treatment)
[Sun Sep 01 13:18:44.145997 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/lib64/python3.9/contextlib.py", line 79, in inner
[Sun Sep 01 13:18:44.146064 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return func(*args, **kwds)
[Sun Sep 01 13:18:44.146135 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 398, in get_or_create_animal
[Sun Sep 01 13:18:44.146196 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.handle_load_db_errors(e, Animal, rec_dict)
[Sun Sep 01 13:18:44.146260 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2625, in handle_load_db_errors
[Sun Sep 01 13:18:44.146331 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     errs_found = self.check_for_inconsistencies(
[Sun Sep 01 13:18:44.146411 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2481, in check_for_inconsistencies
[Sun Sep 01 13:18:44.146482 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.aggregated_errors_object.buffer_exception(
[Sun Sep 01 13:18:44.146559 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2337, in buffer_exception
[Sun Sep 01 13:18:44.146631 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     buffered_tb_str = self.get_buffered_traceback_string()
[Sun Sep 01 13:18:44.146697 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2317, in get_buffered_traceback_string
[Sun Sep 01 13:18:44.146764 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     for step in traceback.format_stack()
[Sun Sep 01 13:18:44.146839 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] 
[Sun Sep 01 13:18:44.146908 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] The above caught exception had a partial traceback:
[Sun Sep 01 13:18:44.146968 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] 
[Sun Sep 01 13:18:44.147042 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 387, in get_or_create_animal
[Sun Sep 01 13:18:44.147104 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     rec, created = Animal.objects.get_or_create(**rec_dict)
[Sun Sep 01 13:18:44.147171 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/manager.py", line 87, in manager_method
[Sun Sep 01 13:18:44.147241 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return getattr(self.get_queryset(), name)(*args, **kwargs)
[Sun Sep 01 13:18:44.147311 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 923, in get_or_create
[Sun Sep 01 13:18:44.147369 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self.create(**params), True
[Sun Sep 01 13:18:44.147439 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 658, in create
[Sun Sep 01 13:18:44.147491 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     obj.save(force_insert=True, using=self.db)
[Sun Sep 01 13:18:44.147538 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 557, in save
[Sun Sep 01 13:18:44.147587 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     super().save(*args, **kwargs)
[Sun Sep 01 13:18:44.147634 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/var/www/tracebase/DataRepo/models/hier_cached_model.py", line 187, in save
[Sun Sep 01 13:18:44.147682 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     super().save(*args, **kwargs)  # Call the "real" save() method.
[Sun Sep 01 13:18:44.147730 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 814, in save
[Sun Sep 01 13:18:44.147778 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     self.save_base(
[Sun Sep 01 13:18:44.147826 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 877, in save_base
[Sun Sep 01 13:18:44.147875 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     updated = self._save_table(
[Sun Sep 01 13:18:44.147923 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 1020, in _save_table
[Sun Sep 01 13:18:44.147976 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     results = self._do_insert(
[Sun Sep 01 13:18:44.148024 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 1061, in _do_insert
[Sun Sep 01 13:18:44.148072 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return manager._insert(
[Sun Sep 01 13:18:44.148120 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/manager.py", line 87, in manager_method
[Sun Sep 01 13:18:44.148169 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return getattr(self.get_queryset(), name)(*args, **kwargs)
[Sun Sep 01 13:18:44.148217 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 1805, in _insert
[Sun Sep 01 13:18:44.148266 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return query.get_compiler(using=using).execute_sql(returning_fields)
[Sun Sep 01 13:18:44.148314 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1822, in execute_sql
[Sun Sep 01 13:18:44.148362 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     cursor.execute(sql, params)
[Sun Sep 01 13:18:44.148419 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 102, in execute
[Sun Sep 01 13:18:44.148470 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return super().execute(sql, params)
[Sun Sep 01 13:18:44.148518 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute
[Sun Sep 01 13:18:44.148567 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self._execute_with_wrappers(
[Sun Sep 01 13:18:44.148615 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
[Sun Sep 01 13:18:44.148664 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return executor(sql, params, many, context)
[Sun Sep 01 13:18:44.148711 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute
[Sun Sep 01 13:18:44.148760 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self.cursor.execute(sql, params)
[Sun Sep 01 13:18:44.148808 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__
[Sun Sep 01 13:18:44.148856 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     raise dj_exc_value.with_traceback(traceback) from exc_value
[Sun Sep 01 13:18:44.148904 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute
[Sun Sep 01 13:18:44.148953 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666]     return self.cursor.execute(sql, params)
[Sun Sep 01 13:18:44.149000 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] EXCEPTION1(ERROR): ConflictingValueError: Conflicting field values encountered in row [2] of sheet [Animals] in col013a_tracebase_studydoc.xlsx in Animal record [{'name': 'col013a_M01', 'infusate': 68, 'infusion_rate': 0.115830115830116, 'genotype': 'C57BL/6', 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4043, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}]:
[Sun Sep 01 13:18:44.149060 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \tinfusion_rate in
[Sun Sep 01 13:18:44.149108 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tdatabase: [0.115830115830116]
[Sun Sep 01 13:18:44.149156 2024] [wsgi:error] [pid 1804084:tid 1804192] [remote 172.20.196.21:53666] \t\tfile: [0.11583011583011583]

And without the leaders:

   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 567, in dispatch
     return super(DataValidationView, self).dispatch(request, *args, **kwargs)
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 599, in post
     return self.form_valid(form)
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 608, in form_valid
     study_data = self.get_download_data()
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 653, in get_download_data
     self.validate_study()
   File "/var/www/tracebase/DataRepo/views/upload/submission.py", line 2633, in validate_study
     sl.load_data()
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
     retval = fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
     fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/loaders/study_loader.py", line 430, in load_data
     loader.load_data()
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2123, in load_wrapper
     retval = fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 1241, in wrapper
     fn(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 285, in load_data
     animal, _ = self.get_or_create_animal(row, infusate, treatment)
   File "/usr/lib64/python3.9/contextlib.py", line 79, in inner
     return func(*args, **kwds)
   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 398, in get_or_create_animal
     self.handle_load_db_errors(e, Animal, rec_dict)
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2625, in handle_load_db_errors
     errs_found = self.check_for_inconsistencies(
   File "/var/www/tracebase/DataRepo/loaders/base/table_loader.py", line 2481, in check_for_inconsistencies
     self.aggregated_errors_object.buffer_exception(
   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2337, in buffer_exception
     buffered_tb_str = self.get_buffered_traceback_string()
   File "/var/www/tracebase/DataRepo/utils/exceptions.py", line 2317, in get_buffered_traceback_string
     for step in traceback.format_stack()

 The above caught exception had a partial traceback:

   File "/var/www/tracebase/DataRepo/loaders/animals_loader.py", line 387, in get_or_create_animal
     rec, created = Animal.objects.get_or_create(**rec_dict)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/manager.py", line 87, in manager_method
     return getattr(self.get_queryset(), name)(*args, **kwargs)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 923, in get_or_create
     return self.create(**params), True
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 658, in create
     obj.save(force_insert=True, using=self.db)
   File "/var/www/tracebase/DataRepo/models/maintained_model.py", line 557, in save
     super().save(*args, **kwargs)
   File "/var/www/tracebase/DataRepo/models/hier_cached_model.py", line 187, in save
     super().save(*args, **kwargs)  # Call the "real" save() method.
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 814, in save
     self.save_base(
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 877, in save_base
     updated = self._save_table(
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 1020, in _save_table
     results = self._do_insert(
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/base.py", line 1061, in _do_insert
     return manager._insert(
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/manager.py", line 87, in manager_method
     return getattr(self.get_queryset(), name)(*args, **kwargs)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/query.py", line 1805, in _insert
     return query.get_compiler(using=using).execute_sql(returning_fields)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1822, in execute_sql
     cursor.execute(sql, params)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 102, in execute
     return super().execute(sql, params)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute
     return self._execute_with_wrappers(
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
     return executor(sql, params, many, context)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute
     return self.cursor.execute(sql, params)
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__
     raise dj_exc_value.with_traceback(traceback) from exc_value
   File "/usr/local/tracebase/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute
     return self.cursor.execute(sql, params)
 EXCEPTION1(ERROR): ConflictingValueError: Conflicting field values encountered in row [2] of sheet [Animals] in col013a_tracebase_studydoc.xlsx in Animal record [{'name': 'col013a_M01', 'infusate': 68, 'infusion_rate': 0.115830115830116, 'genotype': 'C57BL/6', 'body_weight': 25.9, 'age': datetime.timedelta(days=70), 'sex': 'M', 'diet': 'PicoLab Rodent 20 5053', 'feeding_status': 'fasted', 'treatment': 6, 'last_serum_sample': 4043, 'studies': [<Study: MDN_col013a_Perturbative Infusions>]}]:
 \tinfusion_rate in
 \t\tdatabase: [0.115830115830116]
 \t\tfile: [0.11583011583011583]

I have read up a bit on this topic and as I see it, there are a couple of options. We could change infusion_rate to a DecimalField and set a number of decimal places. That would solve this one field issue. It wouldn't solve any other FloatFields for which a decimal place limit is not appropriate.

Long term, another option would be to preprocess float field values using significant figures logic, such that any number supplied, before it is ever loaded (e.g. whenever it is used in a get_or_create), it would round to the set number of significant figures. There could also be a clean method check that enforces this.

A quick fix for this issue (in the study that has this issue) would be to manually swap out the formula-computed values to static values that match the values currently in the DB.

Note that this issue popped up because of the following process that was employed:

Animal data was loaded.
Re-running the loaders should be supported, because it does a get_or_create, but the value from the excel formula has 2 more decimal places than what was saved in the DB, resulting in an integrity error when it tries to do the create (since the attempted get didn't have a perfect match with those extra decimal places)

This issue is somewhat moot. Since the animal data was already loaded, in this instance, it doesn't matter that the new animal load fails. There are no other problems to solve.

Princeton-LSI-ResearchComputing / tracebase