[FC-0049] fix: Issues when importing a large taxonomy

[ChrisChV]

Description

• Adds time elapsed to import log.
• Fix issues with memory and time when importing a large taxonomy.

Supporting information

• Github issue: https://github.com/openedx/modular-learning/issues/213
• Related to: https://github.com/openedx/edx-platform/pull/34796
• Internal ticket: https://tasks.opencraft.com/browse/FAL-3721

It has been tested with taxonomies that take too long or could not finish due to a memory backup. These are their average times after fixing the issue:

• WGU Instructional Design: K-12 Collection: 5.95 seconds.
• FlatTaxonomy: 65.55 seconds.
• Lightcast Open Skills Taxonomy: 76.5 seconds.

Testing instructions

• Use this branch of edx-platform: https://github.com/openedx/edx-platform/pull/34796
• Run make requirements on cms-shell
• Ensure you have the testing data: https://github.com/open-craft/taxonomy-sample-data
• Export this taxonomies:
  • WGU Instructional Design
  • FlatTaxonomy
  • Lightcast Open Skills Taxonomy
• Import a new taxonomy using the previous exported files.
• After every import:
  • Ensure that the memory is linear constant and there is not a memory overflow.
  • Go to python cms bash and run the code. Check the elapsed time.

from openedx_tagging.core.tagging.models.import_export import TagImportTask
task = list(TagImportTask.objects.all())[-1]
task.log

[openedx-webhooks]

Thanks for the pull request, @ChrisChV! Please note that it may take us up to several weeks or months to complete a review and merge your PR.

Feel free to add as much of the following information to the ticket as you can:

• supporting documentation
• Open edX discussion forum threads
• timeline information ("this must be merged by XX date", and why that is)
• partner information ("this is a course on edx.org")
• any other information that can help Product understand the context for the PR

All technical communication about the code itself will be done via the GitHub pull request interface. As a reminder, our process documentation is here.

Please let us know once your PR is ready for our review and all tests are green.

[openedx-webhooks]

@ChrisChV 🎉 Your pull request was merged! Please take a moment to answer a two question survey so we can improve your experience in the future.