KiboSoftware / kibo-sandbox-data-cli

1 stars 1 forks source link

More specific error message details needed #3

Open salmanqureshi-olr opened 11 months ago

salmanqureshi-olr commented 11 months ago

We have been making good progress with imports by using this CLI, both to migrate between sandboxes, but primarily to generate data from other systems and load it into a sandbox. However we have spent some time diagnosing and fixing issues where the error message wasn't as helpful. For example, where a field is too long for its maximum width, we get an error of the form:

"statusMessage": "Incorrect syntax near ')'.", "stateDetails": " at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction)\n at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)\n at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)\n at System.Data.SqlClient.SqlCommand.EndExecuteNonQueryInternal(IAsyncResult asyncResult)\n at System.Data.SqlClient.SqlCommand.EndExecuteNonQuery(IAsyncResult asyncResult)\n at System.Threading.Tasks.TaskFactory1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task`1 promise, Boolean requiresSynchronization)\n--- End of stack trace from previous location where exception was thrown ---\n at Mozu.Catalog.ImportExport.Service.SqlHelper.Execute(String cmd, IJob job) in /src/Mozu.Catalog.ImportExport.Service/SqlHelper.cs:line 155\n at Mozu.Catalog.ImportExport.Service.SqlHelper.Execute(String cmd, IJob job) in /src/Mozu.Catalog.ImportExport.Service/SqlHelper.cs:line 155\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.CategoriesHandler.DeleteInvalidCategoryCodes(CatalogImportResourceJob job, String tableName) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/CategoriesHandler.cs:line 185\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.CategoriesHandler.ProcessCategories[T](CatalogImportResourceJob job) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/CategoriesHandler.cs:line 67\n at Mozu.Catalog.ImportExport.Service.ImportService.DoImport(ImportJob job, ILogger logger, CancellationToken cancellationToken) in /src/Mozu.Catalog.ImportExport.Service/ImportService.cs:line 257"

kibo-thomasphipps commented 11 months ago

This appears to be an error in the Import Api Itself Can you provide the Date Time and Tenant Id

salmanqureshi-olr commented 11 months ago

Here is an example import log.. { "name": "kibo-ucp-cli-catalog-import", "id": "ab87565c-137f-43c9-9076-7e5a73021732", "requester": "6e31175d079b4e68b9155b9e087cdb3c", "domain": "catalog", "resources": [ { "format": "legacy", "resource": "productoptions", "fields": [ "" ], "deleteOmitted": false, "status": "errored", "isComplete": true, "statusMessage": "No header record was found.", "stateDetails": " at CsvHelper.CsvReader.ParseNamedIndexes()\n at CsvHelper.CsvReader.ReadHeader()\n at CsvHelper.CsvDataReader..ctor(CsvReader csv)\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.ProductOptionsImportHandler.LoadVariationProductIdVariationKeyCsv(CatalogImportResourceJob job, String attributeValuesInProductVariationTableName, String csv) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/ProductOptionsImportHandler.cs:line 350\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.ProductOptionsImportHandler.LoadProductVariationKeys(CatalogImportResourceJob job, String attributeValuesInProductVariationTableName) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/ProductOptionsImportHandler.cs:line 316\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.ProductOptionsImportHandler.ProcessAttributeValuesInProductVariationTable(CatalogImportResourceJob job) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/ProductOptionsImportHandler.cs:line 43\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.ProductOptionsImportHandler.Process(CatalogImportResourceJob job) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/ProductOptionsImportHandler.cs:line 27\n at Mozu.Catalog.ImportExport.Service.ImportService.DoImport(ImportJob job, ILogger logger, CancellationToken cancellationToken) in /src/Mozu.Catalog.ImportExport.Service/ImportService.cs:line 257" }, { "format": "legacy", "resource": "productpropertylocale", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0537976 seconds" }, { "format": "legacy", "resource": "productoptionlocalization", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.034037 seconds" }, { "format": "legacy", "resource": "productcatalog", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0859807 seconds" }, { "format": "legacy", "resource": "products", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.4754639 seconds" }, { "format": "legacy", "resource": "attributes", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.8012809 seconds" }, { "format": "legacy", "resource": "productimages", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0452497 seconds" }, { "format": "legacy", "resource": "productbundles", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0394416 seconds" }, { "format": "legacy", "resource": "productextras", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.1704937 seconds" }, { "format": "legacy", "resource": "producttypes", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.3422299 seconds" }, { "format": "legacy", "resource": "pricelists", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.080642 seconds" }, { "format": "legacy", "resource": "pricelistentries", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0263433 seconds" }, { "format": "legacy", "resource": "pricelistentryprices", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0228631 seconds" }, { "format": "legacy", "resource": "pricelistentryextras", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0218362 seconds" }, { "format": "legacy", "resource": "categories", "fields": [ "" ], "deleteOmitted": false, "status": "errored", "isComplete": true, "statusMessage": "Incorrect syntax near ')'.", "stateDetails": " at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction)\n at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)\n at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)\n at System.Data.SqlClient.SqlCommand.EndExecuteNonQueryInternal(IAsyncResult asyncResult)\n at System.Data.SqlClient.SqlCommand.EndExecuteNonQuery(IAsyncResult asyncResult)\n at System.Threading.Tasks.TaskFactory1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task`1 promise, Boolean requiresSynchronization)\n--- End of stack trace from previous location where exception was thrown ---\n at Mozu.Catalog.ImportExport.Service.SqlHelper.Execute(String cmd, IJob job) in /src/Mozu.Catalog.ImportExport.Service/SqlHelper.cs:line 155\n at Mozu.Catalog.ImportExport.Service.SqlHelper.Execute(String cmd, IJob job) in /src/Mozu.Catalog.ImportExport.Service/SqlHelper.cs:line 155\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.CategoriesHandler.DeleteInvalidCategoryCodes(CatalogImportResourceJob job, String tableName) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/CategoriesHandler.cs:line 185\n at Mozu.Catalog.ImportExport.Service.ImportHandlers.CategoriesHandler.ProcessCategories[T](CatalogImportResourceJob job) in /src/Mozu.Catalog.ImportExport.Service/ImportHandlers/CategoriesHandler.cs:line 67\n at Mozu.Catalog.ImportExport.Service.ImportService.DoImport(ImportJob job, ILogger logger, CancellationToken cancellationToken) in /src/Mozu.Catalog.ImportExport.Service/ImportService.cs:line 257" }, { "format": "legacy", "resource": "categoryimages", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0317224 seconds" }, { "format": "legacy", "resource": "producttypeattributes", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.1026148 seconds" }, { "format": "legacy", "resource": "producttypeattributevalues", "fields": [ "" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.0450525 seconds" }, { "format": "legacy", "resource": "attributevalues", "fields": [ "*" ], "deleteOmitted": false, "status": "complete", "isComplete": true, "stateDetails": "Duration: 0.1661031 seconds" } ], "contextOverride": { "masterCatalog": 1, "locale": "en-US", "currency": "US", "catalog": 1, "site": 64097 }, "isComplete": true, "auditInfo": { "updateDate": "2023-10-12T10:59:36.093Z", "createDate": "2023-10-12T10:51:39.191Z" }, "tenant": 41827, "status": "errored", "files": [ { "id": "473969da-930f-4da3-863a-a9bbf743b188", "locationType": "internal", "fileName": "catalog-import-test.zip", "fileType": "import" }, { "id": "585ba66a-49ed-482b-a153-ceb9b138e560", "locationType": "internal", "fileName": "catalog_import_log.csv", "fileType": "log" } ] },