search

turbomam / biosample-xmldb-sqldb

Tools for loading NCBI Biosample into an XML database and then transforming that into a SQL database
MIT License
0 stars 1 forks source link

Incomplete XQuery results need to be trimmed before `copy`ing into Postgres #20

Closed turbomam closed 6 months ago

turbomam commented 6 months ago

This shouldn't be as much of a problem now since it's easy to work with small chunks and/or a low total number of BioSamples.

sed -n -e :a -e '1,2!{P;N;D;};N;ba' \
  shared-xq/non-attribute-metadata-file.tsv > \
  shared-xq/non-attribute-metadata-file-minus_two_lines.tsv