NaturalHistoryMuseum / scratchpads2

Scratchpads 2.0
http://scratchpads.org
GNU General Public License v2.0
199 stars 83 forks source link

Help request in advance of deadline #3069

Closed informatics-dev closed 12 years ago

informatics-dev commented 12 years ago

Description:

Dear SP team, I have 14 days left to deliver my website to USDA for broad release and am hoping to be able to include the following three features (listed by priority):

1) Antweb module (requires import of xml file larger than 50mb limit) http://dev.scratchpads.eu/node/1019

2) Glossary illustrations (fix issue with related media association) http://dev.scratchpads.eu/node/1273

Is there is any way to confirm whether these issues can be addressed within the next 7-10 days?

Attachments:

informatics-dev commented 12 years ago

Comment by Eli Sarnat

I'll try working more on my third (unlisted) issue (import of ~15k specimen/obs. nodes) before posting a support request for it. Thanks much for all the help -- SP2 is really getting good!

informatics-dev commented 12 years ago

Comment by Laurence J Livermore

Hi Eli, I have read all your recent issues and have sent you an email with more information.

informatics-dev commented 12 years ago

Comment by Alice Heaton

The first issue requires either :

  1. Upping the maximum file upload limit. The file is about 60M - base64 encoded this would be about 80M, so to be safe the limit should be at 100M.

    This is something Simon would need to do as I don't have access to this.

  2. Uploading the file via FTP, and changing the code to allow it to use locally uploaded files.

    I'm not sure if we even have such access with Simon ;

  3. Splitting the XML file in smaller chunk.

    As far as I can see:

    • the import process is not destructive ;
    • the data to import can easily be split up (we only care about each 'taxon' entry and it's sub-data, so as long as each 'taxon' entry is kept intact this should be ok).

As Simon is away for now, I will investigate option 3.

informatics-dev commented 12 years ago

Comment by Eli Sarnat

Thanks for looking into this, Alice. If option 3 turns out to be viable, that would be fantastic. Please let me know if there is anything I can do to help.

informatics-dev commented 12 years ago

Comment by Simon Rycroft

I have increased the maximum uploadable filesize to 100MB. Can you try your file again (or is it greater than 100MB?).

informatics-dev commented 12 years ago

Comment by Eli Sarnat

Thanks so much, Simon. I actually don't have the bandwidth to upload the file (have to use my phone mobile hotspot for internet). Dimitris offered to upload it for me once the limit was increased, so I could follow up with him. If anyone else gets a chance before that, tough, the file is here: http://www.antweb.org/web/eol/ Thanks again.

informatics-dev commented 12 years ago

Comment by Alice Heaton

Hi Eli,

I'm a bit unclear as to what needs doing for the second issue. Do you just need a review of the TPL file ? Or is anything else needed ?

Thanks, Alice

informatics-dev commented 12 years ago

Comment by Eli Sarnat

Hi Alice, issue#2 is a bit more complicated. Would it be possible to discuss over IM (google chat, or skype chat)? If so, here are my usernames: e.sarnat@gmail.com (google), ndemik (Skype). If not, the next biggest priority for me would be specimen mapping | http://dev.scratchpads.eu/node/860. Thanks! p.s. I'm processing eol.xml file now and will report if it is successful.

informatics-dev commented 12 years ago

Comment by Dimitrios Koureas

issue#1: Splitting file into 10MB chunks did not solve the problem with eol_api module.

informatics-dev commented 12 years ago

Comment by Simon Rycroft

Issue Redmine issue 1 needs raising with the module's developers then.

informatics-dev commented 12 years ago

Comment by Alice Heaton

issue#1:

I'm still getting problems in all of those cases, so it's most likely to do with the import module and should be raised with the developer as Simon suggests.

informatics-dev commented 12 years ago

Comment by Alice Heaton

For issue Redmine issue 2, the import has been successful, so all that is needed is to display the images. I'm waiting to hear more from Eli.

For issue Redmine issue 1 the module developer apparently was able to upload the chunk I provided, even though it failed for me. I'm waiting to hear more from them.

informatics-dev commented 12 years ago

Comment by Eli Sarnat

Hi Alice,

Maps are working! Thanks so much for getting this sorted out so quickly. As for the glossary images the remaining issues are:

  1. only one image/term is displayed.
  2. the thumbnails do not link to colorboxes.
  3. (lesser priorty) would be nice if images were displayed below term description, rather than inline.

The template addresses the second issue and maybe third, but I don't think it address the first.

informatics-dev commented 12 years ago

Comment by Alice Heaton

The glossary issues have been dealt with (import, display and colorbox)

informatics-dev commented 12 years ago

Comment by Eli Sarnat

Hi Alice, thanks for the work on the glossary. Here is the latest message from Dmitry regarding Antweb module. The updated file is attached.

"Thx for DB dump. I`ve installed it on my local machine and import works fine with no problems. I have uploaded new version with try ... catch in batch functions. Hope it will help.

Can you take a look on watchdog messages? I`m sure that you can find some php errors? Looks like the problem caused by server configuration. PHP versions, php config or some other settings cause it."

informatics-dev commented 12 years ago

Comment by Alice Heaton

I have fixed an issue that would have affected the Antweb import. Can you test this again ? Thanks :)

informatics-dev commented 12 years ago

Comment by Alice Heaton

Eli, could you try the Antweb import again ? Thanks :)

informatics-dev commented 12 years ago

Comment by Eli Sarnat

The Antweb images imported successfully and display perfectly. Thanks to all the SP team for helping me make deadline in style! I'm calling it closed.