Send Extracted Records for Chemical Curation

[Sakshi-Handa]

This is a ticket to send a new batch of extracted chemical records to ChemReg for chemical registration/curation to DTXSIDs.

This process includes

• [ ] downloading the chemical lists from Factotum https://ccte-factotum.epa.gov/chemical_curation/
• [ ] separating out chemical records with multiple CAS numbers
• [ ] running the pre-curation cleaning script.
• [ ] Generating cleaned chemical lists to submit to Chemreg.

Lets send these large groups first, since we can only submit 10,000 records at a time. These csv's can be downloaded directly from Factotum and cleaned.

37. Airgas_Hardgoods
38. Airgas_Mixedgases
39. Tyco Fire Protection
40. FracFocus Wells
41. DCPS 180 - DIY Products
42. Harris Products Group
43. Lincoln Electric
44. Dollar General

For this set of lists, let's group the datasets from similar sources together. We can send one file for each of these sources, since they likely used similar scripts and have similar chemicals.

• NFLIS Drug Reports (1072, 1082, 1088, 1091, 1092, 1093, 1094, 1102)
• FDA Pesticide Residue Monitoring Reports (1097, 1098, 1099, 1101, 1104, 1105, 1106, 1107, 1108, 1109, 1112, 1113, 1114)
• CDER Drug and Biologic Approvals (1118, 1119, 1120, 1121, 1123, 1124, 1125, 1126, 1127, 1128, 1129)

Finally, we can combine everything else into a 'combined group csv. This would be datagroups with less than 500 chemical records.