wlandau / crew

A distributed worker launcher
https://wlandau.github.io/crew/
Other
129 stars 4 forks source link

Documentation Suggestions #71

Closed shikokuchuo closed 1 year ago

shikokuchuo commented 1 year ago

Prework

Description

On the docs, a couple of things I came across re. mirai:

1. https://github.com/wlandau/crew/blob/cb976e035d3b0b4a9f4e00f7e5ba2448153c3d80/R/crew_launcher.R#L43 The argument name is 'timerstart'.

2. https://github.com/wlandau/crew/blob/cb976e035d3b0b4a9f4e00f7e5ba2448153c3d80/R/crew_launcher.R#L33 Suggest: (when a worker exits after reaching a timeout or having completed a certain number of tasks) As (i) there is no exit signal and (ii) if for example daemons(0) closes the socket on the client side, the exit is immediate with no linger.

  1. The current default for seconds_exit of 0.1 is quite low and could be problematic for sending/receiving large objects. The default in mirai has been 1000 ms = 1L for the past couple of builds. I'd assume this might only be an issue re. autoscaling, but I'd take the performance hit for the extra safety.
wlandau commented 1 year ago

Thanks for explaining, and especially for catching the low default for seconds_exit. Should all be fixed now. With the new seconds_exit, I am going to retest for hanging just in case it helped that particular issue.