danphenderson / baldin

0 stars 0 forks source link

Feat: data lake re-structure to definition #38

Open danphenderson opened 6 months ago

danphenderson commented 6 months ago

Data Lake Structure

public/
 - seeds/
   - leads.json
   - companies.json
   - users.json
   ... 
 - logs/
 - lake/
    - leads/
       - <lead-id>.json
       - enriched/
            - <lead-id>.json
    - cover-letters/
       - <cover-letter>.pdf
       - templates/
            - <cover-letter>.pdf
    - resumes/
        - <resume-pdf>.pdf
        - templates/
            - <resume-id>.pdf

Requirements

Make .env's shared between all backend namespaces
Implement backend changes for data lake structure
- app.conf.settings.py, app.logging.py, ...

danphenderson commented 3 months ago

Merge this with #56