Data Factory problem

[PiDiBi]

CopyPipeline-FactTripDataBlobToSQL failed with

Database operation failed. Error message from database execution : The given value of type String from the data source cannot be converted to type nvarchar of the specified target column..

input: FactTripData-Blob - /tripdata/tables/factTripDataoutput/000000_0 sample

19334855-337d-4695-a8ca-ac614133c51d|Twitter:2793763672|Input string was not in a correct format.|2016-04-22 14:39:17|-125.61639962299718|470|463|false|21|49.243319886275735|16.5530183922208

second position! (should be date time) output table columnt is nvarchar(20)

output: FactTripDataTemp-SQL

factTripDataoutput: factTripData.hql tripDataWIP: FROM_UNIXTIME(minUnixTimestamp) as tripStartTime FROM tripDataWIPView tripDataWIPView: MIN(unixtimestamp) as minUnixTimestamp FROM tripDataInt

tripDataInt: tripDataInt.hql UNIX_TIMESTAMP(CONCAT(SPLIT(RecordedTimeStamp,'T')[0],' ',SUBSTR(SPLIT(RecordedTimeStamp,'T')[1],0,8)),'yyyy-MM-dd hh:mm:ss') as unixtimestamp FROM tripdata

tripdata is external table mapped to storage/rawdata/tripdata sample of recorededtimestamp: 2016-04-22T13:31:37.1735276Z

And it probably fails is it some way how to test this part of script?

[PiDiBi]

I probably found the problem testing on HDInsight cluster with access to my storage second position is not time but VIN and as input is "Input string was not in a correct format." = 41chars vin in factTripDataTemp is nvarchar(20) i will update find where to fix it

• fix hive query / or fix len of vin columns everywhere
• fix storing to VIN from myDrive app / if parsing in ParseVINMsg(string result) fails, exception is stored to VIN

[PiDiBi]

PR created with fixes