compiler.sortmemory configuration parameter not propagated properly in system

[GoogleCodeExporter]

Trying to increase compiler.sortmemory parameter in asterix-configuration.xml 
fails, as this value seems not to get propagated effectively and as expected in 
system, during instance creation using managix.

Our observation:
(1) Set value of compiler.sortmemory parameter in asterix-configuration.xml to 
be 4GB (4294967296)
(2) Try to run a workload that needs sorting (such as bulkload)
(3) Add a line to report number of available frames for sort in External Sort 
Operator to check how many frames are available for sorter:
- Expectation: as frameSize is 128KB (by default), we expect to see 4GB/128KB = 
32K frames
- Reality: We see just 1K frames are available for sorter
- If we redo the exact same workload (in our case doing bulkload) again 
*without restarting the instance*, we see that for the 2nd run, number of 
available frames for sorter becomes the correct one (32KB)
- This observation happened with 2 different values for compiler.sortmemory 
parameter (4GB and 1GB)

It seems that for some reason system always picks some default (but 
not-desired) number for the 1st run, and then it switches to correct number

** Assigning to Raman as it is exposed from managix, please feel free to 
re-assign it to others if needed **

Original issue reported on code.google.com by pouria.p...@gmail.com on 28 Nov 2013 at 6:49

[GoogleCodeExporter]

I verified that the compiler.sortmemory parameter is being correctly passed by 
(via Managix). It is being correctly  picked up prior to job creation and set 
into ExternalSortOpDescriptor. 
From the initial look at the usage of the parameter inside 
ExternalSortRunGenerator, it was not  clear why an undesired value is used 
during the first experiment.

@Yingyi, let me know if it does not belong to you. 

Original comment by RamanGro...@gmail.com on 28 Nov 2013 at 7:41

[GoogleCodeExporter]

asterix branch yingyi/asterix_test

Original comment by buyingyi@gmail.com on 21 May 2014 at 4:02

• Changed state: FixedInBranch

[GoogleCodeExporter]

Original comment by buyingyi@gmail.com on 2 Jun 2014 at 11:15

• Changed state: Fixed