Curated dataset of RSE repos

[karacolada]

We have true and false positives for repositories created for the publication and those used in it / referenced as related work.

• [x] check whether we can observe clustering around the publication and repo creation dates - I'd expect used software to be older. This would also give us an interesting insight into how long it takes for software to be widespread. There might be a difference between whether software was cited as "used tools" or "related work".
• [x] bring labelled dataset into a publishable form

[karacolada]

Dataset prepared at data/outputs/eprints_w_intent.csv. Schema:

Data columns (total 11 columns):
 #   Column                      Non-Null Count  Dtype         
---  ------                      --------------  -----         
 0   github_repo_id              130 non-null    object        
 1   mention_created             130 non-null    bool          
 2   pub_title                   130 non-null    object        
 3   pub_author_for_reference    130 non-null    object        
 4   pdf_url                     130 non-null    object        
 5   page_no                     130 non-null    int64         
 6   detected_github_url         130 non-null    object        
 7   pattern_matched_github_url  130 non-null    object        
 8   eprints_date                130 non-null    datetime64[ns]
 9   eprints_pub_year            130 non-null    int64         
 10  eprints_repo                130 non-null    object        
dtypes: bool(1), datetime64[ns](1), int64(2), object(7)
memory usage: 15.4+ KB

[karacolada]

Regarding first checkbox: yes!

Grey filled areas are one, two, three years respectively.