huajiao-tv / peppercron

PepperCron is a distributed cron job management system
MIT License
33 stars 9 forks source link

how is the task log recorded? #1

Open hansedong opened 4 years ago

hansedong commented 4 years ago

Is it stored in a database or written to a file? Or is there any architecture documentation?

youlu-cn commented 4 years ago

Currently, we collect the std error and std out, and store the messages in mysql.

hansedong commented 4 years ago

@youlu-cn Thanks for the reply, I would like to ask, if it is stored in the database, is there a limit on the size of each task(stdout and stderr) ? In addition, suppose the machine has 3000 nodes, each node is running 20 tasks at the same time (both write the database), how to solve the problem that there may be a limited number of connections?

youlu-cn commented 4 years ago

@hansedong Task logs are written in batch by each agent node. Besides, this operation is an interface that you can implement your own behavior.