Checking for duplicates in load statements (without the the pre-sorted assertion) is omitted

[GoogleCodeExporter]

What steps will reproduce the problem?
If a load statement does not have the "pre-sorted" assertion, we will sort the 
data internally before the load. Therefore, we won't verify if the data is 
sorted during the load. This also include omitting the duplicate key 
verification, which could cause index corruption if duplicates records were 
loaded.
We should always check for duplicates when loading a data regardless if it is 
pre-sorted or not.

Original issue reported on code.google.com by salsuba...@gmail.com on 1 Aug 2013 at 1:05

[GoogleCodeExporter]

Original comment by salsuba...@gmail.com on 16 Aug 2013 at 5:46

• Changed state: UnderReview

[GoogleCodeExporter]

Original comment by salsuba...@gmail.com on 20 Aug 2013 at 5:32

• Changed state: Fixed