Closed HariprasadAllaka1612 closed 4 years ago
Does the path : s3a://gat-datalake-refined-dev/reports/player/dat/2020/04/23 actually exist. Have you enabled eventual consistency guard ?
@HariprasadAllaka1612 : Just pinging to see if you are still having issues
Closing due to inactivity.
I am trying to write data into existing Hoodie COW format and also trying to sync hive table along with it as spark data set. I have 2 datasets which i need UPSERT based on the ids that are present in the existing data set that is fetched from hive table synced with hoodie data set. The first dataset UPSERT is working fine but 2nd one is failing when trying to fetch the data using sc.sql to hive. Steps to reproduce has better explanation on this.
To Reproduce
Steps to reproduce the behavior:
Remember to do this under one spark session.
Expected behavior sc.sql called 2nd time on hive table whose fileformat is HoodieparquetFormat in the same session should give results properly.
Environment Description
Hudi version : 0.4.7
Spark version :2.4.0
Hive version :2.3.4
Hadoop version : 2.8.5
Storage (HDFS/S3/GCS..) : S3
Running on Docker? (yes/no) : No
The irony is its not able to find the S3 path even though path exists and s3 consistency check is enabled when writing the data
/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/bin/java -Dconfig.resource=dev.conf "-javaagent:/Applications/IntelliJ IDEA CE.app/Contents/lib/idea_rt.jar=61373:/Applications/IntelliJ IDEA CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath /Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_202.jdk/Contents/Home/lib/tools.jar:/Users/hari/git/data.analytics/playngoplatformdataengg/data-refinement-data-lake/target/classes:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk/1.11.665/aws-java-sdk-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-workmailmessageflow/1.11.665/aws-java-sdk-workmailmessageflow-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/jmespath-java/1.11.665/jmespath-java-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-qldbsession/1.11.665/aws-java-sdk-qldbsession-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-qldb/1.11.665/aws-java-sdk-qldb-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-forecastquery/1.11.665/aws-java-sdk-forecastquery-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-forecast/1.11.665/aws-java-sdk-forecast-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-lakeformation/1.11.665/aws-java-sdk-lakeformation-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-eventbridge/1.11.665/aws-java-sdk-eventbridge-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ec2instanceconnect/1.11.665/aws-java-sdk-ec2instanceconnect-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-applicationinsights/1.11.665/aws-java-sdk-applicationinsights-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-servicequotas/1.11.665/aws-java-sdk-servicequotas-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-personalizeevents/1.11.665/aws-java-sdk-personalizeevents-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-personalize/1.11.665/aws-java-sdk-personalize-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-personalizeruntime/1.11.665/aws-java-sdk-personalizeruntime-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ioteventsdata/1.11.665/aws-java-sdk-ioteventsdata-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iotevents/1.11.665/aws-java-sdk-iotevents-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iotthingsgraph/1.11.665/aws-java-sdk-iotthingsgraph-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-groundstation/1.11.665/aws-java-sdk-groundstation-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediapackagevod/1.11.665/aws-java-sdk-mediapackagevod-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-managedblockchain/1.11.665/aws-java-sdk-managedblockchain-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-textract/1.11.665/aws-java-sdk-textract-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-worklink/1.11.665/aws-java-sdk-worklink-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-backup/1.11.665/aws-java-sdk-backup-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-docdb/1.11.665/aws-java-sdk-docdb-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.665/aws-java-sdk-apigatewayv2-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.665/aws-java-sdk-apigatewaymanagementapi-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-kafka/1.11.665/aws-java-sdk-kafka-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-appmesh/1.11.665/aws-java-sdk-appmesh-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-licensemanager/1.11.665/aws-java-sdk-licensemanager-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-securityhub/1.11.665/aws-java-sdk-securityhub-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-fsx/1.11.665/aws-java-sdk-fsx-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediaconnect/1.11.665/aws-java-sdk-mediaconnect-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.665/aws-java-sdk-kinesisanalyticsv2-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.665/aws-java-sdk-comprehendmedical-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.665/aws-java-sdk-globalaccelerator-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-transfer/1.11.665/aws-java-sdk-transfer-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-datasync/1.11.665/aws-java-sdk-datasync-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-robomaker/1.11.665/aws-java-sdk-robomaker-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-amplify/1.11.665/aws-java-sdk-amplify-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-quicksight/1.11.665/aws-java-sdk-quicksight-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-rdsdata/1.11.665/aws-java-sdk-rdsdata-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-route53resolver/1.11.665/aws-java-sdk-route53resolver-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ram/1.11.665/aws-java-sdk-ram-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-s3control/1.11.665/aws-java-sdk-s3control-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.665/aws-java-sdk-pinpointsmsvoice-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-pinpointemail/1.11.665/aws-java-sdk-pinpointemail-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-chime/1.11.665/aws-java-sdk-chime-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-signer/1.11.665/aws-java-sdk-signer-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-dlm/1.11.665/aws-java-sdk-dlm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-macie/1.11.665/aws-java-sdk-macie-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-eks/1.11.665/aws-java-sdk-eks-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediatailor/1.11.665/aws-java-sdk-mediatailor-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-neptune/1.11.665/aws-java-sdk-neptune-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-pi/1.11.665/aws-java-sdk-pi-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.665/aws-java-sdk-iot1clickprojects-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.665/aws-java-sdk-iot1clickdevices-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iotanalytics/1.11.665/aws-java-sdk-iotanalytics-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-acmpca/1.11.665/aws-java-sdk-acmpca-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-secretsmanager/1.11.665/aws-java-sdk-secretsmanager-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-fms/1.11.665/aws-java-sdk-fms-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-connect/1.11.665/aws-java-sdk-connect-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-transcribe/1.11.665/aws-java-sdk-transcribe-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.665/aws-java-sdk-autoscalingplans-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-workmail/1.11.665/aws-java-sdk-workmail-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-servicediscovery/1.11.665/aws-java-sdk-servicediscovery-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloud9/1.11.665/aws-java-sdk-cloud9-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.665/aws-java-sdk-serverlessapplicationrepository-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.665/aws-java-sdk-alexaforbusiness-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-resourcegroups/1.11.665/aws-java-sdk-resourcegroups-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-comprehend/1.11.665/aws-java-sdk-comprehend-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-translate/1.11.665/aws-java-sdk-translate-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-sagemaker/1.11.665/aws-java-sdk-sagemaker-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.665/aws-java-sdk-iotjobsdataplane-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.665/aws-java-sdk-sagemakerruntime-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.665/aws-java-sdk-kinesisvideo-1.11.665.jar:/Users/hari/.m2/repository/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar:/Users/hari/.m2/repository/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-appsync/1.11.665/aws-java-sdk-appsync-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-guardduty/1.11.665/aws-java-sdk-guardduty-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mq/1.11.665/aws-java-sdk-mq-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediaconvert/1.11.665/aws-java-sdk-mediaconvert-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediastore/1.11.665/aws-java-sdk-mediastore-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediastoredata/1.11.665/aws-java-sdk-mediastoredata-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-medialive/1.11.665/aws-java-sdk-medialive-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mediapackage/1.11.665/aws-java-sdk-mediapackage-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-costexplorer/1.11.665/aws-java-sdk-costexplorer-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-pricing/1.11.665/aws-java-sdk-pricing-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mobile/1.11.665/aws-java-sdk-mobile-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.665/aws-java-sdk-cloudhsmv2-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-glue/1.11.665/aws-java-sdk-glue-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-migrationhub/1.11.665/aws-java-sdk-migrationhub-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-dax/1.11.665/aws-java-sdk-dax-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-greengrass/1.11.665/aws-java-sdk-greengrass-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-athena/1.11.665/aws-java-sdk-athena-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.665/aws-java-sdk-marketplaceentitlement-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-codestar/1.11.665/aws-java-sdk-codestar-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.665/aws-java-sdk-lexmodelbuilding-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.665/aws-java-sdk-resourcegroupstaggingapi-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-pinpoint/1.11.665/aws-java-sdk-pinpoint-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-xray/1.11.665/aws-java-sdk-xray-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-opsworkscm/1.11.665/aws-java-sdk-opsworkscm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-support/1.11.665/aws-java-sdk-support-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-simpledb/1.11.665/aws-java-sdk-simpledb-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-servicecatalog/1.11.665/aws-java-sdk-servicecatalog-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-servermigration/1.11.665/aws-java-sdk-servermigration-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.665/aws-java-sdk-simpleworkflow-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-storagegateway/1.11.665/aws-java-sdk-storagegateway-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-route53/1.11.665/aws-java-sdk-route53-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.665/aws-java-sdk-s3-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-importexport/1.11.665/aws-java-sdk-importexport-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-sts/1.11.665/aws-java-sdk-sts-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-sqs/1.11.665/aws-java-sdk-sqs-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-rds/1.11.665/aws-java-sdk-rds-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-redshift/1.11.665/aws-java-sdk-redshift-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.665/aws-java-sdk-elasticbeanstalk-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-glacier/1.11.665/aws-java-sdk-glacier-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iam/1.11.665/aws-java-sdk-iam-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-datapipeline/1.11.665/aws-java-sdk-datapipeline-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.665/aws-java-sdk-elasticloadbalancing-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.665/aws-java-sdk-elasticloadbalancingv2-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-emr/1.11.665/aws-java-sdk-emr-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elasticache/1.11.665/aws-java-sdk-elasticache-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.665/aws-java-sdk-elastictranscoder-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ec2/1.11.665/aws-java-sdk-ec2-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-dynamodb/1.11.665/aws-java-sdk-dynamodb-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-sns/1.11.665/aws-java-sdk-sns-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-budgets/1.11.665/aws-java-sdk-budgets-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudtrail/1.11.665/aws-java-sdk-cloudtrail-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatch/1.11.665/aws-java-sdk-cloudwatch-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-logs/1.11.665/aws-java-sdk-logs-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-events/1.11.665/aws-java-sdk-events-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.665/aws-java-sdk-cognitoidentity-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cognitosync/1.11.665/aws-java-sdk-cognitosync-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-directconnect/1.11.665/aws-java-sdk-directconnect-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudformation/1.11.665/aws-java-sdk-cloudformation-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudfront/1.11.665/aws-java-sdk-cloudfront-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-clouddirectory/1.11.665/aws-java-sdk-clouddirectory-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-kinesis/1.11.665/aws-java-sdk-kinesis-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-opsworks/1.11.665/aws-java-sdk-opsworks-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ses/1.11.665/aws-java-sdk-ses-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-autoscaling/1.11.665/aws-java-sdk-autoscaling-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudsearch/1.11.665/aws-java-sdk-cloudsearch-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.665/aws-java-sdk-cloudwatchmetrics-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-codedeploy/1.11.665/aws-java-sdk-codedeploy-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-codepipeline/1.11.665/aws-java-sdk-codepipeline-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.665/aws-java-sdk-kms-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-config/1.11.665/aws-java-sdk-config-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-lambda/1.11.665/aws-java-sdk-lambda-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ecs/1.11.665/aws-java-sdk-ecs-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ecr/1.11.665/aws-java-sdk-ecr-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cloudhsm/1.11.665/aws-java-sdk-cloudhsm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-ssm/1.11.665/aws-java-sdk-ssm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-workspaces/1.11.665/aws-java-sdk-workspaces-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-machinelearning/1.11.665/aws-java-sdk-machinelearning-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-directory/1.11.665/aws-java-sdk-directory-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-efs/1.11.665/aws-java-sdk-efs-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-codecommit/1.11.665/aws-java-sdk-codecommit-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-devicefarm/1.11.665/aws-java-sdk-devicefarm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-elasticsearch/1.11.665/aws-java-sdk-elasticsearch-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-waf/1.11.665/aws-java-sdk-waf-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.665/aws-java-sdk-marketplacecommerceanalytics-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-inspector/1.11.665/aws-java-sdk-inspector-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-iot/1.11.665/aws-java-sdk-iot-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-api-gateway/1.11.665/aws-java-sdk-api-gateway-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-acm/1.11.665/aws-java-sdk-acm-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-gamelift/1.11.665/aws-java-sdk-gamelift-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-dms/1.11.665/aws-java-sdk-dms-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.665/aws-java-sdk-marketplacemeteringservice-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-cognitoidp/1.11.665/aws-java-sdk-cognitoidp-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-discovery/1.11.665/aws-java-sdk-discovery-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.665/aws-java-sdk-applicationautoscaling-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-snowball/1.11.665/aws-java-sdk-snowball-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-rekognition/1.11.665/aws-java-sdk-rekognition-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-polly/1.11.665/aws-java-sdk-polly-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-lightsail/1.11.665/aws-java-sdk-lightsail-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-stepfunctions/1.11.665/aws-java-sdk-stepfunctions-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-health/1.11.665/aws-java-sdk-health-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-costandusagereport/1.11.665/aws-java-sdk-costandusagereport-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-codebuild/1.11.665/aws-java-sdk-codebuild-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-appstream/1.11.665/aws-java-sdk-appstream-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-shield/1.11.665/aws-java-sdk-shield-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-batch/1.11.665/aws-java-sdk-batch-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-lex/1.11.665/aws-java-sdk-lex-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.665/aws-java-sdk-mechanicalturkrequester-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-organizations/1.11.665/aws-java-sdk-organizations-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-workdocs/1.11.665/aws-java-sdk-workdocs-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.665/aws-java-sdk-core-1.11.665.jar:/Users/hari/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-models/1.11.665/aws-java-sdk-models-1.11.665.jar:/Users/hari/.m2/repository/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-aws/2.8.5/hadoop-aws-2.8.5.jar:/Users/hari/.m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-common/2.8.5/hadoop-common-2.8.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-annotations/2.8.5/hadoop-annotations-2.8.5.jar:/Users/hari/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/Users/hari/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/hari/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/hari/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/hari/.m2/repository/org/apache/httpcomponents/httpclient/4.5.2/httpclient-4.5.2.jar:/Users/hari/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/hari/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/hari/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/hari/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/Users/hari/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/Users/hari/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/hari/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/Users/hari/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/Users/hari/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/Users/hari/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/Users/hari/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/Users/hari/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/Users/hari/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/hari/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/hari/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.3/jackson-jaxrs-1.8.3.jar:/Users/hari/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/Users/hari/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/Users/hari/.m2/repository/asm/asm/3.1/asm-3.1.jar:/Users/hari/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/Users/hari/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/hari/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/Users/hari/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/Users/hari/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/hari/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/hari/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/hari/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/hari/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/hari/.m2/repository/org/slf4j/slf4j-api/1.7.10/slf4j-api-1.7.10.jar:/Users/hari/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar:/Users/hari/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/hari/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/hari/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/hari/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-auth/2.8.5/hadoop-auth-2.8.5.jar:/Users/hari/.m2/repository/com/nimbusds/nimbus-jose-jwt/4.41.1/nimbus-jose-jwt-4.41.1.jar:/Users/hari/.m2/repository/com/github/stephenc/jcip/jcip-annotations/1.0-1/jcip-annotations-1.0-1.jar:/Users/hari/.m2/repository/net/minidev/json-smart/2.3/json-smart-2.3.jar:/Users/hari/.m2/repository/net/minidev/accessors-smart/1.2/accessors-smart-1.2.jar:/Users/hari/.m2/repository/org/ow2/asm/asm/5.0.4/asm-5.0.4.jar:/Users/hari/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/hari/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/hari/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/hari/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/hari/.m2/repository/com/jcraft/jsch/0.1.54/jsch-0.1.54.jar:/Users/hari/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/Users/hari/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/Users/hari/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/Users/hari/.m2/repository/org/apache/htrace/htrace-core4/4.0.1-incubating/htrace-core4-4.0.1-incubating.jar:/Users/hari/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/hari/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.8.5/hadoop-hdfs-2.8.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-hdfs-client/2.8.5/hadoop-hdfs-client-2.8.5.jar:/Users/hari/.m2/repository/com/squareup/okhttp/okhttp/2.4.0/okhttp-2.4.0.jar:/Users/hari/.m2/repository/com/squareup/okio/okio/1.4.0/okio-1.4.0.jar:/Users/hari/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/Users/hari/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/hari/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/hari/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/hari/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/hari/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/hari/.m2/repository/org/apache/httpcomponents/httpasyncclient/4.1.4/httpasyncclient-4.1.4.jar:/Users/hari/.m2/repository/org/apache/httpcomponents/httpcore-nio/4.4.10/httpcore-nio-4.4.10.jar:/Users/hari/.m2/repository/org/apache/httpcomponents/httpcore/4.4.12/httpcore-4.4.12.jar:/Users/hari/.m2/repository/org/datanucleus/datanucleus-api-jdo/4.2.1/datanucleus-api-jdo-4.2.1.jar:/Users/hari/.m2/repository/org/datanucleus/datanucleus-core/4.1.6/datanucleus-core-4.1.6.jar:/Users/hari/.m2/repository/org/datanucleus/datanucleus-rdbms/4.1.7/datanucleus-rdbms-4.1.7.jar:/Users/hari/.m2/repository/com/github/pathikrit/better-files_2.11/3.7.1/better-files_2.11-3.7.1.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/playngoplatform-hoodie-0.4.7-g959a334-149/incubator-hudi-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-cli/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-cli-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/springframework/shell/spring-shell/1.2.0.RELEASE/spring-shell-1.2.0.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-context-support/4.2.4.RELEASE/spring-context-support-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-beans/4.2.4.RELEASE/spring-beans-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-context/4.2.4.RELEASE/spring-context-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-aop/4.2.4.RELEASE/spring-aop-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-expression/4.2.4.RELEASE/spring-expression-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/org/springframework/spring-core/4.2.4.RELEASE/spring-core-4.2.4.RELEASE.jar:/Users/hari/.m2/repository/com/jakewharton/fliptables/fliptables/1.0.2/fliptables-1.0.2.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-client/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-client-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-hdfs/3.2.0/hadoop-hdfs-3.2.0-tests.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-server/9.3.24.v20180605/jetty-server-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-http/9.3.24.v20180605/jetty-http-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-io/9.3.24.v20180605/jetty-io-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-util/9.3.24.v20180605/jetty-util-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.3.24.v20180605/jetty-util-ajax-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-common/3.2.0/hadoop-common-3.2.0-tests.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-servlet/9.3.24.v20180605/jetty-servlet-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-security/9.3.24.v20180605/jetty-security-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-webapp/9.3.24.v20180605/jetty-webapp-9.3.24.v20180605.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-xml/9.3.24.v20180605/jetty-xml-9.3.24.v20180605.jar:/Users/hari/.m2/repository/com/sun/jersey/jersey-servlet/1.19/jersey-servlet-1.19.jar:/Users/hari/.m2/repository/org/apache/commons/commons-configuration2/2.1.1/commons-configuration2-2.1.1.jar:/Users/hari/.m2/repository/org/apache/commons/commons-text/1.4/commons-text-1.4.jar:/Users/hari/.m2/repository/com/google/re2j/re2j/1.1/re2j-1.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-simplekdc/1.0.1/kerb-simplekdc-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-client/1.0.1/kerb-client-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerby-config/1.0.1/kerby-config-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-core/1.0.1/kerb-core-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerby-pkix/1.0.1/kerby-pkix-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerby-asn1/1.0.1/kerby-asn1-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerby-util/1.0.1/kerby-util-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-common/1.0.1/kerb-common-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-crypto/1.0.1/kerb-crypto-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-util/1.0.1/kerb-util-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/token-provider/1.0.1/token-provider-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-admin/1.0.1/kerb-admin-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-server/1.0.1/kerb-server-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerb-identity/1.0.1/kerb-identity-1.0.1.jar:/Users/hari/.m2/repository/org/apache/kerby/kerby-xdr/1.0.1/kerby-xdr-1.0.1.jar:/Users/hari/.m2/repository/org/codehaus/woodstox/stax2-api/3.1.4/stax2-api-3.1.4.jar:/Users/hari/.m2/repository/com/fasterxml/woodstox/woodstox-core/5.0.3/woodstox-core-5.0.3.jar:/Users/hari/.m2/repository/dnsjava/dnsjava/2.1.7/dnsjava-2.1.7.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/hari/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-protocol-1.2.3.jar:/Users/hari/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/hari/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/hari/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/hari/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-common/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-common-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/apache/httpcomponents/fluent-hc/4.3.2/fluent-hc-4.3.2.jar:/Users/hari/.m2/repository/org/rocksdb/rocksdbjni/5.17.2/rocksdbjni-5.17.2.jar:/Users/hari/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/Users/hari/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/Users/hari/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-hadoop-mr/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-hadoop-mr-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-hadoop-mr-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-hadoop-mr-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-avro/1.8.1/parquet-avro-1.8.1.jar:/Users/hari/.m2/repository/it/unimi/dsi/fastutil/6.5.7/fastutil-6.5.7.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-hive/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-hive-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/beust/jcommander/1.72/jcommander-1.72.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-hive-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-hive-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-presto-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-presto-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-spark/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-spark-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/databricks/spark-avro_2.11/4.0.0/spark-avro_2.11-4.0.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-spark-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-spark-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-timeline-server-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-timeline-server-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-timeline-service/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-timeline-service-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/io/javalin/javalin/2.8.0/javalin-2.8.0.jar:/Users/hari/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-jdk8/1.2.71/kotlin-stdlib-jdk8-1.2.71.jar:/Users/hari/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib/1.2.71/kotlin-stdlib-1.2.71.jar:/Users/hari/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-common/1.2.71/kotlin-stdlib-common-1.2.71.jar:/Users/hari/.m2/repository/org/jetbrains/annotations/13.0/annotations-13.0.jar:/Users/hari/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-jdk7/1.2.71/kotlin-stdlib-jdk7-1.2.71.jar:/Users/hari/.m2/repository/org/eclipse/jetty/websocket/websocket-server/9.4.15.v20190215/websocket-server-9.4.15.v20190215.jar:/Users/hari/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.15.v20190215/websocket-common-9.4.15.v20190215.jar:/Users/hari/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.15.v20190215/websocket-api-9.4.15.v20190215.jar:/Users/hari/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.15.v20190215/websocket-client-9.4.15.v20190215.jar:/Users/hari/.m2/repository/org/eclipse/jetty/jetty-client/9.4.15.v20190215/jetty-client-9.4.15.v20190215.jar:/Users/hari/.m2/repository/org/eclipse/jetty/websocket/websocket-servlet/9.4.15.v20190215/websocket-servlet-9.4.15.v20190215.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-utilities/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-utilities-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/apache/spark/spark-streaming-kafka-0-8_2.11/2.4.0/spark-streaming-kafka-0-8_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/kafka/kafka_2.11/0.8.2.1/kafka_2.11-0.8.2.1.jar:/Users/hari/.m2/repository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar:/Users/hari/.m2/repository/org/antlr/stringtemplate/4.0.2/stringtemplate-4.0.2.jar:/Users/hari/.m2/repository/com/twitter/bijection-avro_2.11/0.9.2/bijection-avro_2.11-0.9.2.jar:/Users/hari/.m2/repository/com/twitter/bijection-core_2.11/0.9.2/bijection-core_2.11-0.9.2.jar:/Users/hari/.m2/repository/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar:/Users/hari/.m2/repository/io/confluent/common-config/3.0.0/common-config-3.0.0.jar:/Users/hari/.m2/repository/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar:/Users/hari/.m2/repository/com/101tec/zkclient/0.5/zkclient-0.5.jar:/Users/hari/.m2/repository/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-utilities-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-utilities-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar:/Users/hari/.m2/repository/org/scala-tools/maven-scala-plugin/2.11/maven-scala-plugin-2.11.jar:/Users/hari/.m2/repository/org/apache/maven/maven-plugin-api/2.0.9/maven-plugin-api-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-project/2.0.9/maven-project-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-settings/2.0.9/maven-settings-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-profile/2.0.9/maven-profile-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-model/2.0.9/maven-model-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-artifact-manager/2.0.9/maven-artifact-manager-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/maven-repository-metadata/2.0.9/maven-repository-metadata-2.0.9.jar:/Users/hari/.m2/repository/org/apache/maven/wagon/wagon-provider-api/1.0-beta-2/wagon-provider-api-1.0-beta-2.jar:/Users/hari/.m2/repository/org/apache/maven/maven-plugin-registry/2.0.9/maven-plugin-registry-2.0.9.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.1/plexus-utils-1.5.1.jar:/Users/hari/.m2/repository/org/apache/maven/maven-artifact/2.0.9/maven-artifact-2.0.9.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-container-default/1.0-alpha-9-stable-1/plexus-container-default-1.0-alpha-9-stable-1.jar:/Users/hari/.m2/repository/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar:/Users/hari/.m2/repository/org/apache/maven/reporting/maven-reporting-impl/2.0.4/maven-reporting-impl-2.0.4.jar:/Users/hari/.m2/repository/commons-validator/commons-validator/1.2.0/commons-validator-1.2.0.jar:/Users/hari/.m2/repository/org/apache/maven/doxia/doxia-core/1.0-alpha-7/doxia-core-1.0-alpha-7.jar:/Users/hari/.m2/repository/org/apache/maven/reporting/maven-reporting-api/2.0.4/maven-reporting-api-2.0.4.jar:/Users/hari/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-7/doxia-sink-api-1.0-alpha-7.jar:/Users/hari/.m2/repository/org/apache/maven/doxia/doxia-site-renderer/1.0-alpha-8/doxia-site-renderer-1.0-alpha-8.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-i18n/1.0-beta-6/plexus-i18n-1.0-beta-6.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-velocity/1.1.3/plexus-velocity-1.1.3.jar:/Users/hari/.m2/repository/velocity/velocity/1.4/velocity-1.4.jar:/Users/hari/.m2/repository/velocity/velocity-dep/1.4/velocity-dep-1.4.jar:/Users/hari/.m2/repository/org/apache/maven/doxia/doxia-decoration-model/1.0-alpha-8/doxia-decoration-model-1.0-alpha-8.jar:/Users/hari/.m2/repository/jline/jline/0.9.93/jline-0.9.93.jar:/Users/hari/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar:/Users/hari/.m2/repository/org/apache/maven/shared/maven-dependency-analyzer/1.1/maven-dependency-analyzer-1.1.jar:/Users/hari/.m2/repository/org/apache/maven/shared/maven-dependency-tree/1.2/maven-dependency-tree-1.2.jar:/Users/hari/.m2/repository/org/apache/maven/shared/maven-common-artifact-filters/1.0/maven-common-artifact-filters-1.0.jar:/Users/hari/.m2/repository/org/apache/maven/shared/maven-plugin-testing-harness/1.1/maven-plugin-testing-harness-1.1.jar:/Users/hari/.m2/repository/org/apache/maven/maven-core/2.0/maven-core-2.0.jar:/Users/hari/.m2/repository/org/apache/maven/wagon/wagon-file/1.0-alpha-5/wagon-file-1.0-alpha-5.jar:/Users/hari/.m2/repository/org/apache/maven/maven-plugin-parameter-documenter/2.0/maven-plugin-parameter-documenter-2.0.jar:/Users/hari/.m2/repository/org/apache/maven/wagon/wagon-http-lightweight/1.0-alpha-5/wagon-http-lightweight-1.0-alpha-5.jar:/Users/hari/.m2/repository/org/apache/maven/maven-error-diagnostics/2.0/maven-error-diagnostics-2.0.jar:/Users/hari/.m2/repository/org/apache/maven/maven-plugin-descriptor/2.0/maven-plugin-descriptor-2.0.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-interactivity-api/1.0-alpha-4/plexus-interactivity-api-1.0-alpha-4.jar:/Users/hari/.m2/repository/org/apache/maven/maven-monitor/2.0/maven-monitor-2.0.jar:/Users/hari/.m2/repository/org/apache/maven/wagon/wagon-ssh/1.0-alpha-5/wagon-ssh-1.0-alpha-5.jar:/Users/hari/.m2/repository/org/codehaus/plexus/plexus-archiver/1.0-alpha-7/plexus-archiver-1.0-alpha-7.jar:/Users/hari/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar:/Users/hari/.m2/repository/com/typesafe/config/1.3.4/config-1.3.4.jar:/Users/hari/.m2/repository/com/typesafe/scala-logging/scala-logging_2.11/3.9.2/scala-logging_2.11-3.9.2.jar:/Users/hari/.m2/repository/org/scala-lang/scala-reflect/2.11.11/scala-reflect-2.11.11.jar:/Users/hari/.m2/repository/commons-codec/commons-codec/1.13/commons-codec-1.13.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.6.7/jackson-databind-2.6.7.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.6.7/jackson-annotations-2.6.7.jar:/Users/hari/.m2/repository/org/apache/spark/spark-core_2.11/2.4.0/spark-core_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/Users/hari/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/Users/hari/.m2/repository/com/twitter/chill_2.11/0.9.3/chill_2.11-0.9.3.jar:/Users/hari/.m2/repository/com/twitter/chill-java/0.9.3/chill-java-0.9.3.jar:/Users/hari/.m2/repository/org/apache/xbean/xbean-asm6-shaded/4.8/xbean-asm6-shaded-4.8.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-client/2.6.5/hadoop-client-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.6.5/hadoop-mapreduce-client-app-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.6.5/hadoop-mapreduce-client-common-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.6.5/hadoop-yarn-client-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.6.5/hadoop-yarn-server-common-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.6.5/hadoop-mapreduce-client-shuffle-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.6.5/hadoop-yarn-api-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.6.5/hadoop-mapreduce-client-core-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.6.5/hadoop-yarn-common-2.6.5.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.6.5/hadoop-mapreduce-client-jobclient-2.6.5.jar:/Users/hari/.m2/repository/org/apache/spark/spark-launcher_2.11/2.4.0/spark-launcher_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-kvstore_2.11/2.4.0/spark-kvstore_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-network-common_2.11/2.4.0/spark-network-common_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-network-shuffle_2.11/2.4.0/spark-network-shuffle_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-unsafe_2.11/2.4.0/spark-unsafe_2.11-2.4.0.jar:/Users/hari/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/Users/hari/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/hari/.m2/repository/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/Users/hari/.m2/repository/org/slf4j/jul-to-slf4j/1.7.16/jul-to-slf4j-1.7.16.jar:/Users/hari/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.16/jcl-over-slf4j-1.7.16.jar:/Users/hari/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/Users/hari/.m2/repository/org/xerial/snappy/snappy-java/1.1.7.1/snappy-java-1.1.7.1.jar:/Users/hari/.m2/repository/org/lz4/lz4-java/1.4.0/lz4-java-1.4.0.jar:/Users/hari/.m2/repository/com/github/luben/zstd-jni/1.3.2-2/zstd-jni-1.3.2-2.jar:/Users/hari/.m2/repository/org/roaringbitmap/RoaringBitmap/0.5.11/RoaringBitmap-0.5.11.jar:/Users/hari/.m2/repository/org/json4s/json4s-jackson_2.11/3.5.3/json4s-jackson_2.11-3.5.3.jar:/Users/hari/.m2/repository/org/json4s/json4s-core_2.11/3.5.3/json4s-core_2.11-3.5.3.jar:/Users/hari/.m2/repository/org/json4s/json4s-ast_2.11/3.5.3/json4s-ast_2.11-3.5.3.jar:/Users/hari/.m2/repository/org/json4s/json4s-scalap_2.11/3.5.3/json4s-scalap_2.11-3.5.3.jar:/Users/hari/.m2/repository/org/glassfish/jersey/core/jersey-client/2.22.2/jersey-client-2.22.2.jar:/Users/hari/.m2/repository/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar:/Users/hari/.m2/repository/org/glassfish/hk2/hk2-api/2.4.0-b34/hk2-api-2.4.0-b34.jar:/Users/hari/.m2/repository/org/glassfish/hk2/hk2-utils/2.4.0-b34/hk2-utils-2.4.0-b34.jar:/Users/hari/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b34/aopalliance-repackaged-2.4.0-b34.jar:/Users/hari/.m2/repository/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:/Users/hari/.m2/repository/org/glassfish/hk2/hk2-locator/2.4.0-b34/hk2-locator-2.4.0-b34.jar:/Users/hari/.m2/repository/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/hari/.m2/repository/org/glassfish/jersey/core/jersey-common/2.22.2/jersey-common-2.22.2.jar:/Users/hari/.m2/repository/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar:/Users/hari/.m2/repository/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22.2/jersey-guava-2.22.2.jar:/Users/hari/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar:/Users/hari/.m2/repository/org/glassfish/jersey/core/jersey-server/2.22.2/jersey-server-2.22.2.jar:/Users/hari/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.22.2/jersey-media-jaxb-2.22.2.jar:/Users/hari/.m2/repository/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar:/Users/hari/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.22.2/jersey-container-servlet-2.22.2.jar:/Users/hari/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.22.2/jersey-container-servlet-core-2.22.2.jar:/Users/hari/.m2/repository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/Users/hari/.m2/repository/io/dropwizard/metrics/metrics-core/3.1.5/metrics-core-3.1.5.jar:/Users/hari/.m2/repository/io/dropwizard/metrics/metrics-jvm/3.1.5/metrics-jvm-3.1.5.jar:/Users/hari/.m2/repository/io/dropwizard/metrics/metrics-json/3.1.5/metrics-json-3.1.5.jar:/Users/hari/.m2/repository/io/dropwizard/metrics/metrics-graphite/3.1.5/metrics-graphite-3.1.5.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.11/2.6.7.1/jackson-module-scala_2.11-2.6.7.1.jar:/Users/hari/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.7.9/jackson-module-paranamer-2.7.9.jar:/Users/hari/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/Users/hari/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/Users/hari/.m2/repository/net/razorvine/pyrolite/4.13/pyrolite-4.13.jar:/Users/hari/.m2/repository/net/sf/py4j/py4j/0.10.7/py4j-0.10.7.jar:/Users/hari/.m2/repository/org/apache/spark/spark-tags_2.11/2.4.0/spark-tags_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/commons/commons-crypto/1.0.0/commons-crypto-1.0.0.jar:/Users/hari/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-sql_2.11/2.4.0/spark-sql_2.11-2.4.0.jar:/Users/hari/.m2/repository/com/univocity/univocity-parsers/2.7.3/univocity-parsers-2.7.3.jar:/Users/hari/.m2/repository/org/apache/spark/spark-sketch_2.11/2.4.0/spark-sketch_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-catalyst_2.11/2.4.0/spark-catalyst_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.1.0/scala-parser-combinators_2.11-1.1.0.jar:/Users/hari/.m2/repository/org/codehaus/janino/janino/3.0.9/janino-3.0.9.jar:/Users/hari/.m2/repository/org/codehaus/janino/commons-compiler/3.0.9/commons-compiler-3.0.9.jar:/Users/hari/.m2/repository/org/antlr/antlr4-runtime/4.7/antlr4-runtime-4.7.jar:/Users/hari/.m2/repository/org/apache/orc/orc-core/1.5.2/orc-core-1.5.2-nohive.jar:/Users/hari/.m2/repository/org/apache/orc/orc-shims/1.5.2/orc-shims-1.5.2.jar:/Users/hari/.m2/repository/io/airlift/aircompressor/0.10/aircompressor-0.10.jar:/Users/hari/.m2/repository/org/apache/orc/orc-mapreduce/1.5.2/orc-mapreduce-1.5.2-nohive.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-column/1.10.0/parquet-column-1.10.0.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-common/1.10.0/parquet-common-1.10.0.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-encoding/1.10.0/parquet-encoding-1.10.0.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-hadoop/1.10.0/parquet-hadoop-1.10.0.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-jackson/1.10.0/parquet-jackson-1.10.0.jar:/Users/hari/.m2/repository/org/apache/arrow/arrow-vector/0.10.0/arrow-vector-0.10.0.jar:/Users/hari/.m2/repository/org/apache/arrow/arrow-format/0.10.0/arrow-format-0.10.0.jar:/Users/hari/.m2/repository/org/apache/arrow/arrow-memory/0.10.0/arrow-memory-0.10.0.jar:/Users/hari/.m2/repository/com/carrotsearch/hppc/0.7.2/hppc-0.7.2.jar:/Users/hari/.m2/repository/com/vlkan/flatbuffers/1.2.0-3f79e055/flatbuffers-1.2.0-3f79e055.jar:/Users/hari/.m2/repository/org/apache/spark/spark-streaming_2.11/2.4.0/spark-streaming_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/spark/spark-hive_2.11/2.4.0/spark-hive_2.11-2.4.0.jar:/Users/hari/.m2/repository/com/twitter/parquet-hadoop-bundle/1.6.0/parquet-hadoop-bundle-1.6.0.jar:/Users/hari/.m2/repository/org/spark-project/hive/hive-exec/1.2.1.spark2/hive-exec-1.2.1.spark2.jar:/Users/hari/.m2/repository/javolution/javolution/5.5.1/javolution-5.5.1.jar:/Users/hari/.m2/repository/log4j/apache-log4j-extras/1.2.17/apache-log4j-extras-1.2.17.jar:/Users/hari/.m2/repository/org/antlr/antlr-runtime/3.4/antlr-runtime-3.4.jar:/Users/hari/.m2/repository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/Users/hari/.m2/repository/org/antlr/ST4/4.0.4/ST4-4.0.4.jar:/Users/hari/.m2/repository/com/googlecode/javaewah/JavaEWAH/0.3.2/JavaEWAH-0.3.2.jar:/Users/hari/.m2/repository/org/iq80/snappy/snappy/0.2/snappy-0.2.jar:/Users/hari/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/Users/hari/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/Users/hari/.m2/repository/org/spark-project/hive/hive-metastore/1.2.1.spark2/hive-metastore-1.2.1.spark2.jar:/Users/hari/.m2/repository/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar:/Users/hari/.m2/repository/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar:/Users/hari/.m2/repository/commons-dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar:/Users/hari/.m2/repository/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar:/Users/hari/.m2/repository/javax/transaction/jta/1.1/jta-1.1.jar:/Users/hari/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/hari/.m2/repository/org/apache/calcite/calcite-avatica/1.2.0-incubating/calcite-avatica-1.2.0-incubating.jar:/Users/hari/.m2/repository/org/apache/calcite/calcite-core/1.2.0-incubating/calcite-core-1.2.0-incubating.jar:/Users/hari/.m2/repository/org/apache/calcite/calcite-linq4j/1.2.0-incubating/calcite-linq4j-1.2.0-incubating.jar:/Users/hari/.m2/repository/net/hydromatic/eigenbase-properties/1.1.5/eigenbase-properties-1.1.5.jar:/Users/hari/.m2/repository/org/jodd/jodd-core/3.5.2/jodd-core-3.5.2.jar:/Users/hari/.m2/repository/org/apache/thrift/libthrift/0.9.3/libthrift-0.9.3.jar:/Users/hari/.m2/repository/org/apache/thrift/libfb303/0.9.3/libfb303-0.9.3.jar:/Users/hari/.m2/repository/org/apache/derby/derby/10.12.1.1/derby-10.12.1.1.jar:/Users/hari/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar:/Users/hari/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.2.0/scala-xml_2.11-1.2.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/spark-fast-tests/v2.3.1_0.15.0/spark-fast-tests-v2.3.1_0.15.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/spark-daria/v2.4.0_0.29.0/spark-daria-v2.4.0_0.29.0.jar:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/kinesis-sql/2.4.0-90200411a9-1/kinesis-sql-2.4.0-90200411a9-1.jar:/Users/hari/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/Users/hari/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar:/Users/hari/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/Users/hari/.m2/repository/org/apache/spark/spark-avro_2.11/2.4.0/spark-avro_2.11-2.4.0.jar:/Users/hari/.m2/repository/org/apache/hive/hive-jdbc/2.3.4/hive-jdbc-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-common/2.3.4/hive-common-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-storage-api/2.4.0/hive-storage-api-2.4.0.jar:/Users/hari/.m2/repository/org/apache/orc/orc-core/1.3.3/orc-core-1.3.3.jar:/Users/hari/.m2/repository/org/eclipse/jetty/aggregate/jetty-all/7.6.0.v20120127/jetty-all-7.6.0.v20120127.jar:/Users/hari/.m2/repository/org/apache/geronimo/specs/geronimo-jta_1.1_spec/1.1.1/geronimo-jta_1.1_spec-1.1.1.jar:/Users/hari/.m2/repository/javax/mail/mail/1.4.1/mail-1.4.1.jar:/Users/hari/.m2/repository/org/apache/geronimo/specs/geronimo-jaspic_1.0_spec/1.0/geronimo-jaspic_1.0_spec-1.0.jar:/Users/hari/.m2/repository/org/apache/geronimo/specs/geronimo-annotation_1.0_spec/1.1.1/geronimo-annotation_1.0_spec-1.1.1.jar:/Users/hari/.m2/repository/asm/asm-commons/3.1/asm-commons-3.1.jar:/Users/hari/.m2/repository/asm/asm-tree/3.1/asm-tree-3.1.jar:/Users/hari/.m2/repository/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-1.2-api/2.6.2/log4j-1.2-api-2.6.2.jar:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-api/2.6.2/log4j-api-2.6.2.jar:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-core/2.6.2/log4j-core-2.6.2.jar:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-web/2.6.2/log4j-web-2.6.2.jar:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-slf4j-impl/2.6.2/log4j-slf4j-impl-2.6.2.jar:/Users/hari/.m2/repository/org/apache/ant/ant/1.9.1/ant-1.9.1.jar:/Users/hari/.m2/repository/org/apache/ant/ant-launcher/1.9.1/ant-launcher-1.9.1.jar:/Users/hari/.m2/repository/com/tdunning/json/1.8/json-1.8.jar:/Users/hari/.m2/repository/com/github/joshelser/dropwizard-metrics-hadoop-metrics2-reporter/0.1.2/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/Users/hari/.m2/repository/org/apache/hive/hive-service/2.3.4/hive-service-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-llap-server/2.3.4/hive-llap-server-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-llap-common/2.3.4/hive-llap-common-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-llap-client/2.3.4/hive-llap-client-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-llap-tez/2.3.4/hive-llap-tez-2.3.4.jar:/Users/hari/.m2/repository/org/apache/slider/slider-core/0.90.2-incubating/slider-core-0.90.2-incubating.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-registry/2.7.1/hadoop-yarn-registry-2.7.1.jar:/Users/hari/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/Users/hari/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/Users/hari/.m2/repository/org/apache/hive/hive-llap-common/2.3.4/hive-llap-common-2.3.4-tests.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-hadoop2-compat/1.1.1/hbase-hadoop2-compat-1.1.1.jar:/Users/hari/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-server/1.1.1/hbase-server-1.1.1.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-procedure/1.1.1/hbase-procedure-1.1.1.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-common/1.1.1/hbase-common-1.1.1-tests.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-prefix-tree/1.1.1/hbase-prefix-tree-1.1.1.jar:/Users/hari/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/Users/hari/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/Users/hari/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/Users/hari/.m2/repository/com/lmax/disruptor/3.3.0/disruptor-3.3.0.jar:/Users/hari/.m2/repository/org/apache/hbase/hbase-hadoop-compat/1.1.1/hbase-hadoop-compat-1.1.1.jar:/Users/hari/.m2/repository/net/sf/jpam/jpam/1.1/jpam-1.1.jar:/Users/hari/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/Users/hari/.m2/repository/javax/servlet/jsp-api/2.0/jsp-api-2.0.jar:/Users/hari/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar:/Users/hari/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/Users/hari/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/hari/.m2/repository/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/Users/hari/.m2/repository/org/apache/hive/hive-serde/2.3.4/hive-serde-2.3.4.jar:/Users/hari/.m2/repository/org/apache/parquet/parquet-hadoop-bundle/1.8.1/parquet-hadoop-bundle-1.8.1.jar:/Users/hari/.m2/repository/org/apache/hive/hive-metastore/2.3.4/hive-metastore-2.3.4.jar:/Users/hari/.m2/repository/com/zaxxer/HikariCP/2.5.1/HikariCP-2.5.1.jar:/Users/hari/.m2/repository/org/datanucleus/javax.jdo/3.2.0-m3/javax.jdo-3.2.0-m3.jar:/Users/hari/.m2/repository/javax/transaction/transaction-api/1.1/transaction-api-1.1.jar:/Users/hari/.m2/repository/co/cask/tephra/tephra-api/0.6.0/tephra-api-0.6.0.jar:/Users/hari/.m2/repository/co/cask/tephra/tephra-core/0.6.0/tephra-core-0.6.0.jar:/Users/hari/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/Users/hari/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/Users/hari/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/Users/hari/.m2/repository/com/google/inject/extensions/guice-assistedinject/3.0/guice-assistedinject-3.0.jar:/Users/hari/.m2/repository/org/apache/twill/twill-common/0.6.0-incubating/twill-common-0.6.0-incubating.jar:/Users/hari/.m2/repository/org/apache/twill/twill-core/0.6.0-incubating/twill-core-0.6.0-incubating.jar:/Users/hari/.m2/repository/org/apache/twill/twill-api/0.6.0-incubating/twill-api-0.6.0-incubating.jar:/Users/hari/.m2/repository/org/apache/twill/twill-discovery-api/0.6.0-incubating/twill-discovery-api-0.6.0-incubating.jar:/Users/hari/.m2/repository/org/apache/twill/twill-discovery-core/0.6.0-incubating/twill-discovery-core-0.6.0-incubating.jar:/Users/hari/.m2/repository/org/apache/twill/twill-zookeeper/0.6.0-incubating/twill-zookeeper-0.6.0-incubating.jar:/Users/hari/.m2/repository/co/cask/tephra/tephra-hbase-compat-1.0/0.6.0/tephra-hbase-compat-1.0-0.6.0.jar:/Users/hari/.m2/repository/org/apache/hive/hive-shims/2.3.4/hive-shims-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/shims/hive-shims-common/2.3.4/hive-shims-common-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/shims/hive-shims-0.23/2.3.4/hive-shims-0.23-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.7.2/hadoop-yarn-server-resourcemanager-2.7.2.jar:/Users/hari/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.7.2/hadoop-yarn-server-applicationhistoryservice-2.7.2.jar:/Users/hari/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.7.2/hadoop-yarn-server-web-proxy-2.7.2.jar:/Users/hari/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6-tests.jar:/Users/hari/.m2/repository/org/apache/hive/shims/hive-shims-scheduler/2.3.4/hive-shims-scheduler-2.3.4.jar:/Users/hari/.m2/repository/org/apache/hive/hive-service-rpc/2.3.4/hive-service-rpc-2.3.4.jar:/Users/hari/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar com.playngodataengg.action.PlayerData HOURLY SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/Users/hari/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/hari/.m2/repository/com/github/Play-n-GO-Platform-Services/incubator-hudi/hudi-timeline-server-bundle/playngoplatform-hoodie-0.4.7-g959a334-149/hudi-timeline-server-bundle-playngoplatform-hoodie-0.4.7-g959a334-149.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/hari/.m2/repository/org/apache/logging/log4j/log4j-slf4j-impl/2.6.2/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree: Exchange hashpartitioning(internal_player_id#993, 1) +- InMemoryTableScan [login_name#117, nick_name#118, country#119, first_name#121, middle_name#122, last_name#123, address1#124, address2#125, address3#126, region#127, zip#128, city#129, phone#130, gender#131, mobile_model#132, currency#133, language#134, email#135, mobile_no#136, mobile_country_code#137, pin#138, email_notify#139, registration_ip#140, campaign_code#141, campaign_name#142, timezone#143, refer_a_friend#144, custom_data#145, group_id#146, banner_tag#147, national_id#148, external_id#149, custom_prom_channels#150, user_agent#151, client_ip#152, hard_deleted#153, internal_player_id#993, birthday#1143, operator_short_name#161, yyyy#1244, mm#1296, dd#1349, registration_ts#356, player_enabled_ts#503, player_password_change_ts#650, player_password_change_req_ts#797, player_disabled_ts#944, handled_ts#1193, player_id#115] +- InMemoryRelation [player_id#115, login_name#117, nick_name#118, country#119, first_name#121, middle_name#122, last_name#123, address1#124, address2#125, address3#126, region#127, zip#128, city#129, phone#130, gender#131, mobile_model#132, currency#133, language#134, email#135, mobile_no#136, mobile_country_code#137, pin#138, email_notify#139, registration_ip#140, campaign_code#141, campaign_name#142, timezone#143, refer_a_friend#144, custom_data#145, group_id#146, banner_tag#147, national_id#148, external_id#149, custom_prom_channels#150, user_agent#151, client_ip#152, hard_deleted#153, internal_player_id#993, birthday#1143, operator_short_name#161, yyyy#1244, mm#1296, dd#1349, registration_ts#356, player_enabled_ts#503, player_password_change_ts#650, player_password_change_req_ts#797, player_disabled_ts#944, handled_ts#1193], StorageLevel(memory, deserialized, 1 replicas) +- Union :- (1) Project [UId#21 AS player_id#115, Lgn#23 AS login_name#117, Nck#24 AS nick_name#118, Ctr#25 AS country#119, FN#27 AS first_name#121, MN#28 AS middle_name#122, LN#29 AS last_name#123, Addr1#30 AS address1#124, Addr2#31 AS address2#125, Addr3#32 AS address3#126, Reg#33 AS region#127, Zip#34 AS zip#128, Cit#35 AS city#129, Phn#36 AS phone#130, Gdr#37 AS gender#131, MMdl#38 AS mobile_model#132, Ccy#39 AS currency#133, Lang#40 AS language#134, Em#41 AS email#135, MNo#42 AS mobile_no#136, MCc#43 AS mobile_country_code#137, Pin#44 AS pin#138, ENot#45 AS email_notify#139, RIp#46 AS registration_ip#140, CmpC#47 AS campaign_code#141, CmpN#48 AS campaign_name#142, TZ#49 AS timezone#143, RAF#50 AS refer_a_friend#144, CD#51 AS custom_data#145, GrpId#52 AS group_id#146, BTag#53 AS banner_tag#147, NatId#54 AS national_id#148, ExtId#55 AS external_id#149, CPC#56 AS custom_prom_channels#150, UAgt#57 AS user_agent#151, CIp#58 AS client_ip#152, Hrd#59 AS hard_deleted#153, concat(OpName#67, UId#21) AS internal_player_id#993, substring(Bday#26, 1, 10) AS birthday#1143, OpName#67 AS operator_short_name#161, 2020 AS yyyy#1244, 04 AS mm#1296, 23 AS dd#1349, UDF(substring(regexp_replace(regexp_replace(RegDt#22, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)) AS registration_ts#356, UDF(substring(regexp_replace(regexp_replace(PlEnTS#64, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)) AS player_enabled_ts#503, UDF(substring(regexp_replace(regexp_replace(PlPsChTS#65, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)) AS player_password_change_ts#650, UDF(substring(regexp_replace(regexp_replace(PlPsChRqTS#66, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)) AS player_password_change_req_ts#797, UDF(substring(regexp_replace(regexp_replace(cast(CASE WHEN (Hrd#59 <=> false) THEN 1587634365753000 ELSE null END as string), ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)) AS player_disabled_ts#944, 1587634365753000 AS handled_ts#1193] : +- (1) Filter AtLeastNNulls(n, Lgn#23,Nck#24,Ctr#25,FN#27,MN#28,LN#29,Addr1#30,Addr2#31,Addr3#32,Reg#33,Zip#34,Cit#35,Phn#36,Gdr#37,MMdl#38,Ccy#39,Lang#40,Em#41,MNo#42,MCc#43,Pin#44,ENot#45,RIp#46,CmpC#47,CmpN#48,TZ#49,RAF#50,CD#51,GrpId#52,BTag#53,NatId#54,ExtId#55,CPC#56,UAgt#57,CIp#58,Hrd#59,UDF(substring(regexp_replace(regexp_replace(RegDt#22, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)),UDF(substring(regexp_replace(regexp_replace(PlEnTS#64, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)),UDF(substring(regexp_replace(regexp_replace(PlPsChTS#65, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)),UDF(substring(regexp_replace(regexp_replace(PlPsChRqTS#66, ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)),UDF(substring(regexp_replace(regexp_replace(cast(CASE WHEN (Hrd#59 <=> false) THEN 1587634365753000 ELSE null END as string), ([0-9]{4}-[0-9]{2}-[0-9]{2}[T|\ ][0-9]{2}:[0-9]{2}:[0-9]{2}(.?)[0-9]{0,3})[0-9][zZ]?, $100000), ., ), 1, 22)),substring(Bday#26, 1, 10)) : +- (1) FileScan json [UId#21,RegDt#22,Lgn#23,Nck#24,Ctr#25,Bday#26,FN#27,MN#28,LN#29,Addr1#30,Addr2#31,Addr3#32,Reg#33,Zip#34,Cit#35,Phn#36,Gdr#37,MMdl#38,Ccy#39,Lang#40,Em#41,MNo#42,MCc#43,Pin#44,ENot#45,RIp#46,CmpC#47,CmpN#48,TZ#49,RAF#50,CD#51,GrpId#52,BTag#53,NatId#54,ExtId#55,CPC#56,UAgt#57,CIp#58,Hrd#59,PlEnTS#64,PlPsChTS#65,PlPsChRqTS#66,OpName#67] Batched: false, Format: JSON, Location: InMemoryFileIndex[s3a://gat-datalake-raw-dev/Players/dat/2020/04/14/07/gat-players-dat-1-2020-04-..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<UId:string,RegDt:string,Lgn:string,Nck:string,Ctr:string,Bday:string,FN:string,MN:string,L... +- (2) Project [player_id#2067, login_name#2068, nick_name#2069, country#2070, first_name#2071, middle_name#2072, last_name#2073, address1#2074, address2#2075, address3#2076, region#2077, zip#2078, city#2079, phone#2080, gender#2081, mobile_model#2082, currency#2083, language#2084, email#2085, mobile_no#2086, mobile_country_code#2087, pin#2088, email_notify#2089, registration_ip#2090, campaign_code#2091, campaign_name#2092, timezone#2093, refer_a_friend#2094, custom_data#2095, group_id#2096, banner_tag#2097, national_id#2098, external_id#2099, custom_prom_channels#2100, user_agent#2101, client_ip#2102, hard_deleted#2103, internal_player_id#2109, birthday#2110, operator_short_name#2112, yyyy#2113, mm#2114, dd#2115, cast((cast(registration_ts#2104L as double) / 1000.0) as timestamp) AS registration_ts#2319, cast((cast(player_enabled_ts#2105L as double) / 1000.0) as timestamp) AS player_enabled_ts#2469, cast((cast(player_password_change_ts#2106L as double) / 1000.0) as timestamp) AS player_password_change_ts#2619, cast((cast(player_password_change_req_ts#2107L as double) / 1000.0) as timestamp) AS player_password_change_req_ts#2769, cast((cast(player_disabled_ts#2108L as double) / 1000.0) as timestamp) AS player_disabled_ts#2919, cast((cast(handled_ts#2111L as double) / 1000.0) as timestamp) AS handled_ts#3069] +- *(2) Filter internal_player_id#2109 IN (dat1,dat55,dat56,dat52,dat53,dat54,dat51) +- Scan hive reports.player [address1#2074, address2#2075, address3#2076, banner_tag#2097, birthday#2110, campaign_code#2091, campaign_name#2092, city#2079, client_ip#2102, country#2070, currency#2083, custom_data#2095, custom_prom_channels#2100, dd#2115, email#2085, email_notify#2089, external_id#2099, first_name#2071, gender#2081, group_id#2096, handled_ts#2111L, hard_deleted#2103, internal_player_id#2109, language#2084, last_name#2073, login_name#2068, middle_name#2072, mm#2114, mobile_country_code#2087, mobile_model#2082, mobile_no#2086, national_id#2098, nick_name#2069, operator_short_name#2112, phone#2080, pin#2088, player_disabled_ts#2108L, player_enabled_ts#2105L, player_id#2067, player_password_change_req_ts#2107L, player_password_change_ts#2106L, refer_a_friend#2094, region#2077, registration_ip#2090, registration_ts#2104L, timezone#2093, user_agent#2101, yyyy#2113, zip#2078], HiveTableRelation
reports
.player
, org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe, [_hoodie_commit_time#2062, _hoodie_commit_seqno#2063, _hoodie_record_key#2064, _hoodie_partition_path#2065, _hoodie_file_name#2066, player_id#2067, login_name#2068, nick_name#2069, country#2070, first_name#2071, middle_name#2072, last_name#2073, address1#2074, address2#2075, address3#2076, region#2077, zip#2078, city#2079, phone#2080, gender#2081, mobile_model#2082, currency#2083, language#2084, email#2085, mobile_no#2086, mobile_country_code#2087, pin#2088, email_notify#2089, registration_ip#2090, campaign_code#2091, campaign_name#2092, timezone#2093, refer_a_friend#2094, custom_data#2095, group_id#2096, banner_tag#2097, national_id#2098, external_id#2099, custom_prom_channels#2100, user_agent#2101, client_ip#2102, hard_deleted#2103, registration_ts#2104L, player_enabled_ts#2105L, player_password_change_ts#2106L, player_password_change_req_ts#2107L, player_disabled_ts#2108L, internal_player_id#2109, birthday#2110, handled_ts#2111L], [operator_short_name#2112, yyyy#2113, mm#2114, dd#2115]Caused by: org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: s3a://gat-datalake-refined-dev/reports/player/dat/2020/04/23 at org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:285) at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:228) at org.apache.hudi.hadoop.HoodieParquetInputFormat.listStatus(HoodieParquetInputFormat.java:69) at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313) at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:204) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:49) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:49) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.rdd.UnionRDD$$anonfun$1.apply(UnionRDD.scala:84) at org.apache.spark.rdd.UnionRDD$$anonfun$1.apply(UnionRDD.scala:84) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.List.foreach(List.scala:392) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.immutable.List.map(List.scala:296) at org.apache.spark.rdd.UnionRDD.getPartitions(UnionRDD.scala:84) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:49) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:49) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:251) at org.apache.spark.SparkContext$$anonfun$union$1$$anonfun$31.apply(SparkContext.scala:1314) at org.apache.spark.SparkContext$$anonfun$union$1$$anonfun$31.apply(SparkContext.scala:1314) at scala.collection.TraversableLike$$anonfun$filterImpl$1.apply(TraversableLike.scala:248) at scala.collection.immutable.List.foreach(List.scala:392) at scala.collection.TraversableLike$class.filterImpl(TraversableLike.scala:247) at scala.collection.TraversableLike$class.filter(TraversableLike.scala:259) at scala.collection.AbstractTraversable.filter(Traversable.scala:104) at org.apache.spark.SparkContext$$anonfun$union$1.apply(SparkContext.scala:1314) at org.apache.spark.SparkContext$$anonfun$union$1.apply(SparkContext.scala:1313) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112) at org.apache.spark.SparkContext.withScope(SparkContext.scala:699) at org.apache.spark.SparkContext.union(SparkContext.scala:1313) at org.apache.spark.sql.execution.UnionExec.doExecute(basicPhysicalOperators.scala:571) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127) at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152) at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127) at org.apache.spark.sql.execution.columnar.CachedRDDBuilder.buildBuffers(InMemoryRelation.scala:89) at org.apache.spark.sql.execution.columnar.CachedRDDBuilder.cachedColumnBuffers(InMemoryRelation.scala:59) at org.apache.spark.sql.execution.columnar.InMemoryTableScanExec.filteredCachedBatches(InMemoryTableScanExec.scala:276) at org.apache.spark.sql.execution.columnar.InMemoryTableScanExec.inputRDD$lzycompute(InMemoryTableScanExec.scala:105) at org.apache.spark.sql.execution.columnar.InMemoryTableScanExec.inputRDD(InMemoryTableScanExec.scala:104) at org.apache.spark.sql.execution.columnar.InMemoryTableScanExec.doExecute(InMemoryTableScanExec.scala:310) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127) at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152) at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127) at org.apache.spark.sql.execution.exchange.ShuffleExchangeExec.prepareShuffleDependency(ShuffleExchangeExec.scala:92) at org.apache.spark.sql.execution.exchange.ShuffleExchangeExec$$anonfun$doExecute$1.apply(ShuffleExchangeExec.scala:128) at org.apache.spark.sql.execution.exchange.ShuffleExchangeExec$$anonfun$doExecute$1.apply(ShuffleExchangeExec.scala:119) at org.apache.spark.sql.catalyst.errors.package$.attachTree(package.scala:52) ... 815 more 2020-04-23 11:32:50 ERROR DataEngineering:12 - (writeDataToRefinedHudiS3) - There is an exception writing the data into data lake for player
Process finished with exit code 0