julep-ai / julep

A new DSL and server for AI agents and multi-step tasks
https://julep.ai
Apache License 2.0
4.13k stars 903 forks source link

fix(agents-api): Limit activities per worker, tune temporal config #899

Closed Ahmad-mtos closed 4 days ago

Ahmad-mtos commented 4 days ago

[!IMPORTANT] Limit activities per worker to 100 and adjust Temporal configuration for improved performance.

  • Behavior:
    • Set MAX_CONCURRENT_ACTIVITIES to 100 in worker.py to limit activities per worker.
    • Set MAX_CONCURRENT_WORKFLOW_TASKS to None in worker.py (default behavior).
  • Configuration:
    • Update temporal-postgres.yaml to increase matching.rps to 600 (default 1200).
    • Increase limit.blobSize.error to 4MB, limit.historySize.error to 100MB, limit.historyCount.error to 100k, limit.numPendingActivities.error to 4000, and limit.numPendingChildExecutions.error to 4000 in temporal-postgres.yaml.

This description was created by Ellipsis for e5f52cd57e9c51bdc377633d15cec5c1fe1d3a81. It will automatically update as commits are pushed.