BCcampus / pressbooks-openstax-import

[UNMAINTAINED] Pressbooks Plugin for OpenStax Textbook Import
GNU General Public License v3.0
5 stars 0 forks source link

Some larger OpenStax books must be imported in pieces or process times out #79

Open josieg opened 5 years ago

josieg commented 5 years ago

Description

When importing Anatomy and Physiology, it gets past the first import, but in the second import (when the parts/chapters you select are actually brought in) then the import process times out with only a portion of the content successfully imported. I have to import the book piece by piece to get a complete copy. Previous issues where this has been discussed: https://github.com/BCcampus/pressbooks-openstax-import/issues/50 and #52 . But in issue 50, you only highlight one book as being too big to import, one that is around 2GB. But the A&P book is 408MB. I was able to import Intro To Sociology 2e in one go, but it's 104MB.

Steps to reproduce the problem

  1. Create a new book in Pressbooks.
  2. Import Anatomy and Physiology via the ZIP URL and the OpenStax import plugin.
  3. Select all chapters and parts for import. Click import.
  4. After a while, the page will time out saying "This page isn't working."
  5. Navigate back using the "Back" arrow. This will take you back to the page where you select parts and chapter to import.
  6. Open the Organize page in a new tab. See that only the first three and a half parts imported (out of over 25 parts). (The second time I tried this I only got one 1.2 parts)
  7. Navigate back to the tab where you can select what parts/chapters you want to import.
  8. Unselect the parts/chapters that imported successfully. Click Import.
  9. Return to step 4 and repeat until all parts and chapters have been imported.

I know the timing-out problem is not a new one and not one with a sustainable fix, but is there a way to make the process of importing a book in smaller pieces easier to manage and more straightforward? If we move forward with using the API, then spending time on this is probably not worth it. But if we don't (or if it's something far in the future) we need a better way to manage importing OpenStax books.

Here are some thoughts I have about this. Overall, if this system is what we are stuck with, and we want other people outside of high-level Pressbooks Users to be able to use it, and we're willing to invest in it, then I'd like for there to be mechanisms built in to make it easy to import large OpenStax books in smaller batches: