ninja-build / ninja

a small build system with a focus on speed
https://ninja-build.org/
Apache License 2.0
10.79k stars 1.57k forks source link

Make job submission system configurable #890

Open elfring opened 9 years ago

elfring commented 9 years ago

The tool "ninja" supports the parallel execution of build jobs by default. These jobs will be run by a local build environment so far. It can happen that the computing resources can become too limited for a challenging data processing application there.

I suggest to extend corresponding resources with capabilities from distributed systems. Some programming interfaces are available for such a purpose. How do you think about to make it possible to choose from various job submission systems by configuration variables?

nico commented 9 years ago

Chromium does remote compilation by letting "cc" send build jobs to local machines. Users then run ninja -j1000. This seems to work well, without ninja having to know about networking. Could this approach work for you?

elfring commented 9 years ago

I assume that you would prefer to say '… by letting "cc" send build jobs to remote machines'.

A job parameter like 1000 looks promising. Which programming tools are reused for your example?