Fixed the issues and commit the changes separately:
1.Added a shell script to build and start all components.
2.Fixed the issue: The warc files were not copyed to wayback.
3.Fixed the issue: Too many open files.
4.Adjusted the process of harvest heartbeat to handle the job which doesn't exist on Crawler, and update the TI entity instantly.
Fixed the issues and commit the changes separately: 1.Added a shell script to build and start all components. 2.Fixed the issue: The warc files were not copyed to wayback. 3.Fixed the issue: Too many open files. 4.Adjusted the process of harvest heartbeat to handle the job which doesn't exist on Crawler, and update the TI entity instantly.