TranslatorSRI / NodeNormalization

Service that produces Translator compliant nodes given a curie
MIT License
9 stars 6 forks source link

Restore partial load messages #192

Open gaurav opened 1 year ago

gaurav commented 1 year ago

Some change made before PR #177 caused the partial load messages (e.g. "1000 rows loaded") to no longer be displayed. This is a valuable way to look at the rate at which the load is occurring, so we should put it back when we can.

gaurav commented 1 year ago

This appears to be because these partial load messages are logged at log level INFO, but the default log level is ERROR. So, our options are:

  1. Change the default log level to INFO.
  2. Set the default log level to INFO in Kubernetes.

I'm inclined to go for the first approach: I think we should assume that INFO is a useful level of logging for NodeNorm (both the loader and the web server) in most cases, with an option for reducing that level of logs in production environments where we might not want to see all log messages.