JumpMind / metl

Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview
GNU General Public License v3.0
208 stars 82 forks source link

Add throttling to I/O components. (Discovery) #929

Open abrougher opened 5 years ago

abrougher commented 5 years ago

This is a discovery task to look into adding throttling to control how aggressively we read/write to external endpoints.

What endpoints should support this? How should this be configured? Delays between batches? How to manage throughput? How to configure? Entities per minute? Messages per minute?