investigate "string", "integer", "provided" string patterns in variable names

[jacobmpeters]

There are many columns in the tables that have "CID.string", "CID.integer" and "CID.provided" fields. This occurs when the value for CID has both string and integer data types in Firestore.

We need to:

• [ ] 1. Compile a list of these variables in the flattened tables.
• [ ] 2. Investigate whether they exist in the source tables.
• [ ] 3. Ask Tony if he can fix them in Firestore.
• [ ] 4. If Tony cannot fix them manually in Firestore, we need to combine them in BQ2.

[jeannewu]

@jacobmpeters It will work for me. Also, we might clean up some nested variables which were historically passed down to the FlatConnect, too.

[jacobmpeters]

@jeannewu will investigate items one and two.

[jeannewu]

@jacobmpeters all the variables related to "provided", "integer" and "string" are in both biospecimen table and participants table (shown below):	table_name	column_name	last.CID
1	biospecimen_JP	d_646899796_integer	6.47E+08
2	biospecimen_JP	d_646899796_provided	6.47E+08
3	biospecimen_JP	d_646899796_string	6.47E+08
4	biospecimen_JP	d_928693120_integer	9.29E+08
5	biospecimen_JP	d_928693120_provided	9.29E+08
6	biospecimen_JP	d_928693120_string	9.29E+08
7	participants_JP	state_d_821247024_integer	8.21E+08
8	participants_JP	state_d_821247024_provided	8.21E+08
9	participants_JP	state_d_821247024_string	8.21E+08
10	participants_JP	state_studyId_integer	integer
11	participants_JP	state_studyId_provided	provided
12	participants_JP	state_studyId_string	string