OpenConceptLab / ocl_issues

Issues for all OCL repos. NOTE: Install ZenHub Browser Extension and request access to the OCL Roadmap board to view all issues and to contribute
4 stars 2 forks source link

Search Results Download for concepts has offset columns #1945

Open jamlung-ri opened 1 month ago

jamlung-ri commented 1 month ago

I attempted to download a list of concepts in CSV format using the method pictured below, but the CSVs are coming out in a way that has offset columns. Probably due to the commas in the search_meta field.

This might be happening for mappings too.

Example failed CSV files: https://drive.google.com/file/d/1-sUqTxmQltxji1AGGVHyv-U3fffBSMhO/view?usp=sharing https://drive.google.com/file/d/16LyJ5JJ4Fn5yxWfDpRme4NhdDYAI01z3/view?usp=sharing

Method: image

Offset CSV: (note that there are synonyms in the "id" column) image

snyaggarwal commented 1 month ago

@jamlung-ri Excluded search_meta from CSV download. This is deployed on QA.

jamlung-ri commented 1 month ago

@snyaggarwal This helped, but there's still one shifted column header, due to checksum. That column is getting split between it's smart and standard checksum i.e. {smart":"ac6fb10713d942d008d5119b54530049", standard:"b1ef7fbf4d38b43729e3b81c378a2cef"}" is being split across two CSV columns.

I think we should either omit checksums from that export, or the checksums should be delimited by a character that isn't a comma e.g. a semicolon or a vertical pipe.

Screenshot of the current state (note the external IDs in the concept_class field, the "standard checksum" in the id field, etc.): image

snyaggarwal commented 1 month ago

@jamlung-ri I have removed checksums from the CSV download. I tried with checksums and search_meta and on mac Numbers (alternate for Excel) it works fine, it doesn't get spilled over to the next columns.