search

smart-on-fhir / cumulus-library

https://docs.smarthealthit.org/cumulus/library/
Apache License 2.0
2 stars 0 forks source link

Consider using pyarrow cursors instead of pandas cursors #250

Open dogversioning opened 2 weeks ago

dogversioning commented 2 weeks ago

Right now in export, we're hopping between dataframes and pyarrow for writing files to disk.

We could/should look into pyathena's ArrowCursor, which has some nice features and may make the logic in this method generally cleaner.