Closed tcmetzger closed 1 year ago
@giancastro @tcmetzger Hey I have a PR up here: https://github.com/CartoDB/raster-loader/pull/23/files
@brendancol Chunking needs to remain a user decision, because there is an upload limit in BigQuery that needs to be respected.
@brendancol the BigQuery module should include a simple integration test (without the complex BigQuery SQL), i.e. a bytestring comparison as non regression test. (Integration test is its own task, see Issue #18)
When generating the bytestring record (currently in .tobytes()
), we need to use endian-independent code. See https://github.com/CartoDB/raster-loader/issues/29 for details!
To future-proof this package and make it easier to add additional functionalities, we need to modularize the code.
We propose three functional areas:
io.py
). This core module always takes a NumPy array as input and only has minimal dependencies.