gavinr / github-csv-tools

Import and export GitHub issues via CSV
https://npmjs.com/github-csv-tools
MIT License
650 stars 116 forks source link

Data leaking in the csv file #104

Closed HaDoyle12 closed 1 year ago

HaDoyle12 commented 1 year ago

Discussed in https://github.com/gavinr/github-csv-tools/discussions/103

Originally posted by **HaDoyle12** May 9, 2023 When pulling from a private repo, I am getting info from the issues in the rows of the csv file, this is causing issues cause we have to clean up the file before using. I also am not sure if all of the issues are being downloaded. This is a newer issue when running the tool. I am not even sure what could be causing the problem.
gavinr commented 1 year ago

Hi, can you please clarify a bit more with an example and a replication case? Thank you.

HaDoyle12 commented 1 year ago

Hi, yes I am using the tool to pull the issues from an internal repo, but the output looks like it contains data from the body of some of the issues. I have removed all sensitive data, but this is what my export files look like. Essentially there is data with breaks in the data set that looks like it is coming from the issues body. There isnt a pattern that I can see on how this data is getting into the file. *I also want to note this is a relatively new issue. My exports before March 23rd worked fine.

image

HaDoyle12 commented 1 year ago

Also while cleaning out the excess data there seems to be points at which there are issues missing. For instance issue 13522... 13520.. 13529 can be seen below.

HaDoyle12 commented 1 year ago

image

HaDoyle12 commented 1 year ago

The red boxes indicate the correct data, this shows that issue #13521 is missing from the data set and shows the spillover data from row 2194 to row 2240

gavinr commented 1 year ago

What program are you using to display the data? Most likely it's simply not handling multi-line csv cells gracefully. See related:

HaDoyle12 commented 1 year ago

I am using excel, I am working in Modern CSV and it is working perfectly! Thank you so much!