FedML-AI / FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
https://TensorOpera.ai
Apache License 2.0
4.11k stars 772 forks source link

Add 10 minutes TTL Cache for config fetch #2123

Closed alaydshah closed 2 months ago

alaydshah commented 2 months ago

Reduces Egress Data from 10GB to 0.0179GB per day