yahoo / storm-yarn

Storm-yarn enables Storm clusters to be deployed into machines managed by Hadoop YARN.
Other
417 stars 161 forks source link

Add two resource configuration options for each supervisor #67

Open clockfly opened 10 years ago

clockfly commented 10 years ago

Currently storm-yarn will just use max resource capacity yarn cluster offer to start a supervisor.

It may be a good idea to add two other option in master.yaml, so that we can config the resource limiation.

supervisor.size-mb: 16192
supervisor.vcores: 8

If yarn cluster returns max resource capatity

 vcore:32, memory: 8G 
we will pick the smaller one, to
vcores: 8, Memory: 8G.