mikeaintworkin
commented
11 months ago bash-3.2$ pwd
/Users/ceilynboyd/Harvard University/Reekie, Mike - iq_reporting_collab/bin
bash-3.2$ ls
ceilyn-setvars.sh input_file.yaml mike-setvars.sh readme.txt
bash-3.2$ bash ceilyn-setvars.sh
YAML data is valid!
------------------------------
Defaults currently mapped to Command Line input:
Any changes you just made will be written back to the yaml file
you can run this file repeatedly to update the defaults
collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:''_'' no
trailing /. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''_''.
No trailing /. api=ignored. file=Optional'
v: /Users/ceilynboyd/Harvard University/Reekie, Mike - iq_reporting_collab/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''_''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:''_'' no
trailing /. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
.api=ignored. file=required.'
v: ''
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'
==========================================================================
You have set the run parameters.
Summary:
collection_flag:
data_collected_time:
v: ''
organization_name:
v: IQSS
output_base_dir:
v: /Users/ceilynboyd/Harvard University/Reekie, Mike - iq_reporting_collab/
output_file_base_name:
v: ''
project_name:
v: IQSS/dataverse
sprint_name:
v: snaps_collection
src_dir_name:
v: ''
src_file_name:
v: ''
src_type:
v: api
workflow_name:
v: '000'
To actually run the analysis or collection and analysis run
create_iq_snapshot
from this same directory.
bash-3.2$ create_iq_snapshot
Running /Users/ceilynboyd/anaconda3/bin/create_iq_snapshot as the main program
YAML data is valid!
input arguments:
collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:''_'' no trailing
/. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''_''. No
trailing /. api=ignored. file=Optional'
v: /Users/ceilynboyd/Harvard University/Reekie, Mike - iq_reporting_collab/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''_''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:''_'' no trailing
/. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv .api=ignored.
file=required.'
v: ''
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'
output_file_base_name 4api: snaps_collection-snapshot-000-api-2023_11_28_134957
directory exists or was created now: /Users/ceilynboyd/Harvard University/Reekie, Mike - iq_reporting_collab/snaps_collection
projects: looking to match IQSS/dataverse with IQSS/consilience
projects: looking to match IQSS/dataverse with IQSS/dataverse
start: 0 cards processed: IQSS/dataverse, Column ā¶ SPRINT READY
end: 8 cards processed: IQSS/dataverse, Column ā¶ SPRINT READY
start: 8 cards processed: IQSS/dataverse, Column This Sprint šāāļø š
end: 20 cards processed: IQSS/dataverse, Column This Sprint šāāļø š
start: 20 cards processed: IQSS/dataverse, Column IQSS Team - In Progress š»
Traceback (most recent call last):
File "/Users/ceilynboyd/anaconda3/bin/create_iq_snapshot", line 167, in <module>
main()
File "/Users/ceilynboyd/anaconda3/bin/create_iq_snapshot", line 72, in main
sprint_data.df = pdio.LegacyProjectCards(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/iqss_gh_reporting/legacy.py", line 74, in __init__
self._fetch_data()
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/iqss_gh_reporting/legacy.py", line 88, in _fetch_data
if not self._get_project_cards_api_obj():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/iqss_gh_reporting/legacy.py", line 155, in _get_project_cards_api_obj
self._project_cards = pd.concat([self._project_cards, pd.DataFrame([new_row])], ignore_index=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/reshape/concat.py", line 385, in concat
return op.get_result()
^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/reshape/concat.py", line 616, in get_result
new_data = concatenate_managers(
^^^^^^^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/internals/concat.py", line 242, in concatenate_managers
values = _concatenate_join_units(join_units, copy=copy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/internals/concat.py", line 581, in _concatenate_join_units
to_concat = [
^
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/internals/concat.py", line 582, in <listcomp>
ju.get_reindexed_values(empty_dtype=empty_dtype, upcasted_na=upcasted_na)
File "/Users/ceilynboyd/anaconda3/lib/python3.11/site-packages/pandas/core/internals/concat.py", line 513, in get_reindexed_values
i8values = np.full(self.shape, fill_value._value)
^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute '_value'
bash-3.2$
The hints are in the output from her script run which is in the first comment. Her code builds fine.