This pull request includes several changes to the pyprobe/cyclers/basecycler.py file and its corresponding test file. The changes focus on improving the handling of dataframes with missing columns and updating the concatenation method for dataframes. Additionally, a new test case has been added to verify the handling of missing columns.
Changes to dataframe handling:
pyprobe/cyclers/basecycler.py: Modified the _get_dataframe_list method to fill missing columns with null values instead of excluding dataframes with missing columns.
pyprobe/cyclers/basecycler.py: Updated the get_imported_dataframe method to use the "diagonal" concatenation method instead of "vertical".
tests/cyclers/test_basecycler.py: Added a new test case test_with_missing_columns to ensure dataframes with missing columns are handled correctly by filling missing values with nulls.
This pull request includes several changes to the
pyprobe/cyclers/basecycler.pyfile and its corresponding test file. The changes focus on improving the handling of dataframes with missing columns and updating the concatenation method for dataframes. Additionally, a new test case has been added to verify the handling of missing columns.Changes to dataframe handling:
pyprobe/cyclers/basecycler.py: Modified the_get_dataframe_listmethod to fill missing columns with null values instead of excluding dataframes with missing columns.pyprobe/cyclers/basecycler.py: Updated theget_imported_dataframemethod to use the "diagonal" concatenation method instead of "vertical".Changes to tests:
tests/cyclers/test_basecycler.py: Added import fornumpyto support new test cases.tests/cyclers/test_basecycler.py: Added a new test casetest_with_missing_columnsto ensure dataframes with missing columns are handled correctly by filling missing values with nulls.