callumrollo / erddaplogs

Quick utilities for parsing nginx and apache logs for ERDDAP requests
MIT License
0 stars 4 forks source link

Revamp saving of anonymised data #51

Closed callumrollo closed 3 days ago

callumrollo commented 3 days ago

With this PR we make several improvements to how anonymized data are stored:

All of these changes should make it much easier to integrate the anonymised user data into ERDDAP, following discussions in https://github.com/ERDDAP/erddap/discussions/162

Another PR will follow with instructions on how to make these stats available as datasets on ERDDAP

This PR also increases reliablility with timezone flexible datestamp parsing and using the newly released polars v1.0.0