jakelever / biotext

Get a nicely-chunked local copy of the biomedical literature (to use for other projects)!
MIT License
13 stars 5 forks source link

Disabling tables as default #13

Closed jakelever closed 1 year ago

jakelever commented 1 year ago

Converted table text isn't well represented in the BioC format. Currently the code is trying to pull the text through into BioC passages into a tab-delimited format. But this is causing some issues downstream with attempts to detect sentences within these tables. For now, tables are being disabled by default and can be reenabled as needed.

jakelever commented 1 year ago

Immediately decided to undo this and work around tables another way