ecmwf / anemoi-training

Apache License 2.0
17 stars 17 forks source link

Mlflow log_params string truncation #69

Closed anaprietonem closed 1 week ago

anaprietonem commented 1 month ago

What happened?

When logging parameters in mlflow we are truncating the strings to 250 characters. This might be an issue with very long string but also with lists of strings or nested dicts.

What are the steps to reproduce the bug?

Run anemoi-training train with MlFlow tracking enabled

Version

0.1.0

Platform (OS and architecture)

ATOS

Relevant log output

No response

Accompanying data

No response

Organisation

No response

MeraX commented 1 month ago

Thanks for opening the issue.

HCookie commented 1 month ago

Apologies, #88, merely provides a mitigation for this issue, but more work will be needed to fully address the problem.