Open hansedong opened 4 years ago
Currently, we collect the std error and std out, and store the messages in mysql.
@youlu-cn Thanks for the reply, I would like to ask, if it is stored in the database, is there a limit on the size of each task(stdout and stderr) ? In addition, suppose the machine has 3000 nodes, each node is running 20 tasks at the same time (both write the database), how to solve the problem that there may be a limited number of connections?
@hansedong Task logs are written in batch by each agent node. Besides, this operation is an interface that you can implement your own behavior.
Is it stored in a database or written to a file? Or is there any architecture documentation?