search

ai-cfia / azure-db

Operations related to semantic search on our Azure document index.
MIT License
0 stars 1 forks source link

Create a package for Azure Blob Storage interactions in azure-db #3

Closed k-allagbe closed 6 months ago

k-allagbe commented 9 months ago

Develop a Python package for Azure Blob Storage to facilitate blob operations like uploading, downloading, and managing blobs, with a focus on adding metadata during uploads.

Tasks

  1. Package Structure: Establish a modular package structure.
  2. Connection Utilities: Functions for Azure Blob Storage connections.
  3. Blob Operations: Implement upload, download, and blob management functions. Ensure upload functions include metadata handling capabilities.
  4. Error Handling and Security: Ensure robust error handling and secure access key management.
  5. Performance Optimization: Optimize for large files and high throughput.
  6. Testing: Develop a comprehensive test suite.
  7. Documentation: Provide clear usage documentation.

Acceptance Criteria

ibrahim-kabir commented 6 months ago

No longer relevant

rngadam commented 6 months ago

No longer relevant

Why no longer relevant? Seems like it was completed and there's a setup.py in azure-db/azure-ai-search to turn this into a package and used from finesse-backend?

https://github.com/ai-cfia/finesse-backend/blob/95788cbdfbb2f31bb7b70d4a22c3a0b42de7c391/requirements.txt#L6

To me looks like @k-allagbe completed part of the work.

k-allagbe commented 6 months ago

No longer relevant

Why no longer relevant? Seems like it was completed and there's a setup.py in azure-db/azure-ai-search to turn this into a package and used from finesse-backend?

https://github.com/ai-cfia/finesse-backend/blob/95788cbdfbb2f31bb7b70d4a22c3a0b42de7c391/requirements.txt#L6

To me looks like @k-allagbe completed part of the work.

I meant this issue to have a centralized way of interacting with our BLOB storages. It is actually a non issue because the azure python package is comprehensive and easy to use enough not to need this. This would not add value.