krux / starport

Apache License 2.0
2 stars 7 forks source link

deceptive log lines mask failure #44

Closed talbright closed 5 years ago

talbright commented 5 years ago

Notice line INFO 20:02:50 [ForkJoinPool-2-worker-1] c.k.s.StartScheduledPipelines$ - deployed pipeline com.salesforce.mce.exemplar.tasks.EMRSparkPipeline in 16 even though the pipeline failed.

INFO: <-- END HTTP (98-byte body)
INFO  20:02:48 [main] c.k.h.c.UploadPipelineObjectsTrans - Creating pipeline and uploading 14 objects
INFO  20:02:48 [main] c.k.h.c.UploadPipelineObjectsTrans - Created pipeline df-089902423AWIS47KWSWO (mce_noted-grubworm2019-09-02T20:02:34Z_14_com.salesforce.mce.exemplar.tasks.EMRSparkPipeline#spark)
INFO  20:02:48 [main] c.k.h.c.UploadPipelineObjectsTrans - Uploading pipeline definition to df-089902423AWIS47KWSWO
ERROR 20:02:49 [main] c.k.h.c.UploadPipelineObjectsTrans - EmrCluster_7c8beb37-7b40-42a5-92a0-0d9a0defd130: No more than 3 digits are allowed after decimal place in Spot Price ('masterInstanceBidPrice')
ERROR 20:02:49 [main] c.k.h.c.UploadPipelineObjectsTrans - EmrCluster_7c8beb37-7b40-42a5-92a0-0d9a0defd130: No more than 3 digits are allowed after decimal place in Spot Price ('coreInstanceBidPrice')
ERROR 20:02:49 [main] c.k.h.c.UploadPipelineObjectsTrans - Failed to upload pipeline definition to pipeline df-089902423AWIS47KWSWO
ERROR 20:02:49 [main] c.k.h.c.UploadPipelineObjectsTrans - Deleting the just created pipeline df-089902423AWIS47KWSWO
INFO  20:02:49 [main] c.k.hyperion.client.AwsClientForId - Deleting pipeline df-089902423AWIS47KWSWO

INFO  20:02:50 [ForkJoinPool-2-worker-1] c.k.s.StartScheduledPipelines$ - deployed pipeline com.salesforce.mce.exemplar.tasks.EMRSparkPipeline in 16
INFO  20:02:50 [main] c.k.s.StartScheduledPipelines$ - All pipelines scheduled in 23.413328854 seconds
realstraw commented 5 years ago

This one is fixed in 5.9.5