Added functions to read/write Apache Parquet using the object_store crate instead of std::fs. These new functions are used throughout the code instead of the old functions that used std::fs. Since we now use an ObjectStore when reading and writing files, the local data folder is now also represented with an object store instead of PathBuf. This makes file I/O consistent since we now always use the object_store crate, no matter if it is local or remote file I/O.
It should also be noted that all uses of std:fs, std::Path, and PathBuf have been removed and replaced with corresponding functionality from the object_store crate.
Added functions to read/write Apache Parquet using the
object_storecrate instead ofstd::fs. These new functions are used throughout the code instead of the old functions that usedstd::fs. Since we now use anObjectStorewhen reading and writing files, the local data folder is now also represented with an object store instead ofPathBuf. This makes file I/O consistent since we now always use theobject_storecrate, no matter if it is local or remote file I/O.It should also be noted that all uses of
std:fs,std::Path, andPathBufhave been removed and replaced with corresponding functionality from theobject_storecrate.