search

logix-project / logix

AI Logging for Interpretability and Explainability🔬
Apache License 2.0
74 stars 6 forks source link

Configurable CPU Offloading #82

Closed sangkeun00 closed 8 months ago

sangkeun00 commented 8 months ago

Following #81, we enable users to configure the CPU offloading option with config.yaml as:

logging:
  cpu_offload: true

By default, it's set to False. This would allow users to make a flexible trade-off between GPU memory usage and throughput.