Flaw in the logic generated by Chat-GPT4 repo URL ends up in column 'a'

[julianharty]

Context

I used Chat-GPT4 to generate a short program to experiment with loading the tsv file into a pandas dataframe. Sadly, it didn't process rows that contained only an additional code repo URL correctly.

Proposed approach

Create another experiment as a python file and load the data row by row where these rows would have the code repo URL stored in the final (third) column. While the code may be very inefficient there are only roughly 630 rows so the overall performance loss does not materially affect running the code from a human/wall-clock perspective.

[julianharty]

Note: Commit 752f7e99c7f21823daff4f9b770aaad237145069 also fixed this issue.

[julianharty]

Some commentary on how I learned sufficient code to implement the hand-crafted python. Perhaps it'll help others who have similar skills in python learn how I approached the learning (and - I hope - help them to learn better ways than the approach I used).

What did I need to learn?

 How/where did I learn?

In short, online, mainly via Google Searches.

• How to print a specific range of rows in the DataFrame (to illustrate the code has added the appropriate project code and NLnet page) https://discuss.codecademy.com/t/when-using-iloc-to-select-ranges-of-pandas-dataframe-rows-can-we-skip-rows/353063 And https://www.statology.org/pandas-print-row/ provided a useful introduction but didn't explain how to select a range of rows to be printed.
• Creating Pandas Dataframes from tuples:
  • https://www.geeksforgeeks.org/creating-a-pandas-dataframe-using-list-of-tuples/ (this was the page that unlocked my comprehension and helped me most).
  • https://www.geeksforgeeks.org/creating-a-pandas-dataframe/
  • https://www.datacamp.com/tutorial/pandas-tutorial-dataframe-python didn't unlock my thinking, however it's got plenty of useful info on Dataframes.
  • https://nathancarter.github.io/MA346-course-notes/_build/html/chapter-13-etl.html wasn't quite what I needed, nonetheless it appears to be useful course material.
  • Reading in the file line by line was based on https://stackoverflow.com/a/15244074/340175 an answer to https://stackoverflow.com/questions/15242746/handling-variable-number-of-columns-with-pandas-python
  • I wanted to select the last column per row rather than the last column of the Dataframe. That turned out to be hard to do. Selecting the last column in the Dataframe is covered in https://stackoverflow.com/questions/40144769/how-to-select-the-last-column-of-dataframe