Where is "It also creates/appends data to 2 all_* files in the present folder that increase in size every time you run the script" coded?

TWJolly / fundraising_data_pull

Pulls data from the JustGiving API for a defined set of charities and highlights new pages

1 stars 1 forks source link

Where is "It also creates/appends data to 2 all_* files in the present folder that increase in size every time you run the script" coded? #14

Closed daaronr closed 6 years ago

TWJolly commented 6 years ago

I think that's outdated - was unnecessary - we should update the Read-Me

daaronr commented 6 years ago

So, we no longer want to create the 'all' file I guess? I suppose it shouldn't be needed in the process of the experiment; every time we run it it tells us all the fundraising pages that are currently live, and then treatments.csv uses this to tell us the ones we still need to seed. (I'll look at that closer).

TWJolly commented 6 years ago

Yes, that should be what it's doing now!