search

kentico-ericd / kontent-google-sheets-add-on

Using this Google Sheets add-on, you can import new content items in Kentico Kontent, or update existing items. This can be handy when migrating content from an external database or CMS, or if your editors prefer to work in spreadsheets.
MIT License
4 stars 3 forks source link

'Your input exceeds exceeds the limit of 50000 characters in a single cell.' #19

Open Vitalii-NZ opened 2 years ago

Vitalii-NZ commented 2 years ago

Describe the bug The export is returning content types but all sheets are empty (does not extract content items). I contacted the Kontent.ai support team. they were trying to test it and found out that it says: "'Your input exceeds the limit of 50000 characters in a single cell.'" but I'm positive that none of the items imported to Kontent had that many characters.

To Reproduce Steps to reproduce the behavior:

  1. Go to 'Google Sheet'
  2. Click on 'Export'
  3. Scroll down to '....'
  4. See error: it either says "Something went wrong while executing the add-on." or does not show any error

Expected behavior it should have extracted content as it used to

Screenshots If applicable, add screenshots to help explain your problem.

empty

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Add any other context about the problem here.

kentico-ericd commented 2 years ago

Hello @Vitalii-NZ !

This sounds like a limitation of Google Sheets. It's possible that we could add some logic to the add-on which truncates large data or shows a user-friendly error containing the offending language variant and element. Interestingly, I just tested this by using the export feature after editing a variant to contain 50,000+ characters and it was imported without issue.

Would you be able to locate the erroneous language variant and element which is causing the error? I would recommend getting the data directly via the Delivery API and checking for a variant with a large amount of data.

Vitalii-NZ commented 2 years ago

Hello @kentico-ericd

Thank you, I will explore the Delivery API option. Meanwhile, is there a max number of content items the Add-on/google sheet will process before fail? (prod has more than 5100 content items). The reason I'm asking is that non-prod env has fewer content items and add-on extracts it without any issues.

kentico-ericd commented 2 years ago

Currently the export feature doesn't have the same "batching" functionality as the import feature, so it is limited by Google's 45s script timeout. That's a fairly long time to retrieve content items of a single type, so I would say 5,000+ items could be processed in that time. Content types with more items could potentially time out, though.

Vitalii-NZ commented 2 years ago

It looks like in our case the error is caused by script timeout rather than the number of characters above the limit in a single cell. (It takes longer than 45 sec before the error appears. average of 45.68sec). I managed to extract the content items and validate that there are no issues or data that exceeded the number of characters in a single cell.

Is the "batching" functionality for the export feature on your roadmap which would be implemented in the future? or is it better for us to stick with Delivery API / Management API?

Thank you for your time and your help, Eric! cheers,

kentico-ericd commented 2 years ago

@Vitalii-NZ The batching functionality for the export feature isn't currently planned, though if there is enough interest it could certainly end up being added. Unfortunately for now, if the Google Sheets add-on can't manage the large amount of data for you, I would recommend using other migration tools!