knowledgesystems / cmo-pipelines

GNU Affero General Public License v3.0
3 stars 10 forks source link

Determine how many lines to skip at beginning of file #1175

Closed callachennault closed 4 months ago

callachennault commented 4 months ago

This PR fixes a bug in the combine_files_py3.py script. Previously, the script passed the argument comment='#' to the pd.read_table() function, intending to ignore commented lines beginning with a '#'. This caused an unintended bug where any string values in the table were truncated after '#' character if present. This PR removes the comment='#' argument and programmatically determines which comment lines at the beginning of a file to skip.