Function start time benchmark - camel

funktionio / funktion

a CLI tool for working with funktion

https://funktion.fabric8.io/

Apache License 2.0

297 stars 25 forks source link

Function start time benchmark - camel #39

Open markrey opened 7 years ago

markrey commented 7 years ago

Hi Everyone,

Great work on the system! Has anyone done testing on flow start time for camel?

I am trying to send error logs from Kafka to CouchDb via camel. They come any frequency from 1 second to 1 minute.

Thank you Mark

jstrachan commented 7 years ago

Thanks!

There are definitely lots of errors to process right?

I guess the underlying camel metrics on the flow & steps might highlight possible slow downs. A quick way to isolate the cause may be to try switch the couch db endpoint with log - then Kafka with a timer and see which still has odd timings - there could be an issue with the configuration of one of the connectors.

Any chance you could share the flow & config you used for Kafka & couch then we can try reproduce?

markrey commented 7 years ago

Hi @jstrachan ,

finally got time to circle back. There were lots of SSL errors for some reason! ( So it is not entirely funktion fault )

There are definitely lots of errors to process right?

Yes indeed. Logs are 0.1 KB to 1 MB. Might take few seconds to parse.

Any chance you could share the flow & config you used for Kafka & couch then we can try reproduce?

I will surely share the same.

On the side, i see less activity on funktion github. Is it being developed on another/private repo?

Thanks, Mark