12 enh automatically recognize the mime type of the file being cataloged

databricks-industry-solutions / pixels

Facilitates simple large scale processing of HLS Medical images, documents, zip files. Previously at https://github.com/dmoore247/pixels

Other

25 stars 15 forks source link

Closed erinaldidb closed 5 months ago

erinaldidb commented 6 months ago

Added unzip and file type detection feature
create from the setup catalog, schema and volume if they don't exist
By default we are going to read s3://hls-eng-data-public/dicom/ddsm/benigns_2*.zip instead of full folder
Non DICOM files will be ignored

dmoore247 commented 5 months ago

I'm re-running the Test and Lint because it failed @erinaldidb

dmoore247 commented 5 months ago

@erinaldidb Could you check out the Build/Integration test failures? Thanks.