Default Import doesn't map correctly to vocabularies

jmatsushita commented 11 years ago

After install, triggering an import through drush message-library-import gives the following output

===== Message Library Import =====

1. Importing [hazard] terms... [ok]

No vocabulary defined for Taxonomy Term processor. [warning] No vocabulary defined for Taxonomy Term processor. [warning] No vocabulary defined for Taxonomy Term processor. [warning] No vocabulary defined for Taxonomy Term processor. [warning] Failed importing 4 terms. [status]

2. Importing [issues] terms... [ok]

No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. No vocabulary defined for Taxonomy Term processor. Failed importing 29 terms. [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [warning] [status]

Going to the feed import configuration (admin/structure/feeds/message_library_term_hazard/settings/FeedsTermProcessor) the Vocabulary is unset.

This is a problem which means that after install each importer has to be set manually which we want to avoid as the Message Library should be functional after being enabled!

Jun

sn00011 commented 11 years ago

Not sure why the vocabulary is unset, i see it's set correctly in the features, e.g, this. Could you try reverting the features?

sn00011 commented 11 years ago

Could you tell me which version of the HR platform are you using when doing the install, so i could reproduce this issue.

jmatsushita commented 11 years ago

Hi Kurt, I've installed from scratch with the humanitarianresponse.make file from https://github.com/humanitarianresponse/hr_platform

I had to comment the following patches : ; projects[entity_translation][patch][] = "https://drupal.org/files/entity_translation-expose_translations_to_views-beta2-1605406-23.patch" ; projects[views_pdf][patch][] = "https://drupal.org/files/grouping-1313404-14.patch" ; projects[views_pdf][patch][] = "https://drupal.org/files/2032863-hide_fields-1.patch" ; projects[views_pdf][patch][] = "https://drupal.org/files/1886066-header_footer-2.patch" ; projects[views_pdf][patch][] = "https://drupal.org/files/views_pdf-undefined_index_function-1513490-28.patch" ; projects[views_pdf][patch][] = "https://drupal.org/files/1972158-page_break-3.patch"

Running then drush message-library-import gives the exact same messages.

sn00011 commented 11 years ago

I got some error installing the drush make file in aegir, i don't know whether you could give me a dump of your code and database .

jmatsushita commented 11 years ago

Please do as follow:

clone the hr_platform repo.
comment the lines I mentionned in the common.make file
run aegir

If there's an error then paste it here.

sn00011 commented 11 years ago

Not sure you've met this before, i got an error like this at the very end:

And this is my configuration:

jmatsushita commented 11 years ago

Hi Kurt,

Make sure you check the whole of the log in Aegir, before that error. It also happened to me and there where errors about failing to apply patches which resulted in the platform not being present.

Jun

On Jul 17, 2013, at 10:24 AM, Kurt Zhong notifications@github.com wrote:

Not sure you've met this before, i got an error like this at the very end:

And this is my configuration:

— Reply to this email directly or view it on GitHub.

sn00011 commented 11 years ago

Yes, indeed i found two more errors, i've commented out the corresponding drush make block.It's all OK now. Thanks.

;libraries[flexslider][type] = "libraries"
;libraries[flexslider][download][type] = "file"
;libraries[flexslider][download][url] = "https://nodeload.github.com/woothemes/FlexSlider/zip/version/2.1"

;libraries[colorbox][type] = "libraries"
;libraries[colorbox][download][type] = "file"
;libraries[colorbox][download][url] = "https://nodeload.github.com/jackmoore/colorbox/zip/1.4.10"

sn00011 commented 11 years ago

I should choose 'Emergency Site' install profile to reproduce this error right?

jmatsushita commented 11 years ago

I use the hr minimal profile

Sent from my phone

On 17 juil. 2013, at 10:45, Kurt Zhong notifications@github.com wrote:

I should choose 'Emergency Site' install profile to reproduce this error right?

— Reply to this email directly or view it on GitHubhttps://github.com/humanitarianresponse/message_library/issues/24#issuecomment-21102425 .

jmatsushita commented 11 years ago

Also make sure that after the build you check out the latest version of the message library as the make file gets an older version.

Sent from my phone

On 17 juil. 2013, at 10:45, Kurt Zhong notifications@github.com wrote:

I should choose 'Emergency Site' install profile to reproduce this error right?

— Reply to this email directly or view it on GitHubhttps://github.com/humanitarianresponse/message_library/issues/24#issuecomment-21102425 .

sn00011 commented 11 years ago

I made some test with this hr_minimal installation profile, and found the platform is using some newer versions of feeds, _searchapi and features. This directly breaks the message library.

Some settings on the feeds importers are lost, which is what this issue is about.
More worse is the field setting on the search_api index, the majority part of the field settings are lost. This makes message_library views not work.
The page content type to hold some static pages requried by message library couldn't be found.

I've fixes these issues mentioned above but i am not sure whether there could be more compatibility issues like these.

jmatsushita commented 11 years ago

@kurtzhong can you do another install from scratch following these instructions (and updating them when necessary)? We want to push the code to the production environment and I'd like to make sure you can install from scratch without issues. https://github.com/humanitarianresponse/message_library/blob/master/installation.txt

jmatsushita commented 11 years ago

@kurtzhong I update the installation.txt file. After the step where I activate the ML features an error comes up on page http://mltraining.infoasaid.org/admin/structure/features/cleanup/clear Error The website encountered an unexpected error. Please try again later.

The Log has the following error : LOCATION http://mltraining.infoasaid.org/admin/structure/features/cleanup/clear REFERRER http://mltraining.infoasaid.org/admin/structure/features MESSAGE DatabaseSchemaObjectExistsException: Table field_data_field_message_target_comment already exists. in DatabaseSchema->createTable() (line 657 of /home/aegir/platforms/humanitarian-response-7.x-1.13/includes/database/schema.inc).

Also the http://mltraining.infoasaid.org/message-library-terms-use is empty.

Finally triggering drush @mltraining.infoasaid.org message-library-import gives an error "No content type target"

===== Message Library Import =====

1. Importing [hazard] terms... [ok]

Created 4 terms. [status]

2. Importing [issues] terms... [ok]

Created 29 terms. [status]

3. Importing [sector] terms... [ok]

Created 6 terms. [status]

4. Importing [threat] terms... [ok]

Created 73 terms. [status]

5. Importing [information_type] terms... [ok]

Created 5 terms. [status]

6. Importing [at_risk_groups] terms... [ok]

Created 27 terms. [status]

7. Importing [target_audience] terms... [ok]

Created 17 terms. [status]

No content type target.

jmatsushita commented 11 years ago

The import path for the Messages was empty after install.

If I fill it with the correct path the messages are not properly linked to Issues : http://mltraining.infoasaid.org/message-library

sn00011 commented 11 years ago

Hi do you pull code from the branch 'hr_minimal_update', i remember this is due to the update of feeds module and it's already fixed. But if you have already pulled the latest code but using an older version of the feeds module, the configuration structure exported by the features module won't match that required by an older version of feeds. I think it's better to have separate branches for this issue. How do you think?

jmatsushita commented 11 years ago

Hi @kurtzhong

The branches were already merged. I've delete the hr_minimal_update branch as I want us to target this profile (we shouldn't be depending on other features).

The feeds module version on mltraining.infoasaid.org is 7.x-2.0-alpha8

Unfortunately the hr_platform repo with the make file doesn't target specific module versions so we're building against a moving target (I've made a suggestion to @guillaumev about this on the HR atrium).

Until then can we make sure you let me know exactly the version numbers you refer to? You said (https://github.com/humanitarianresponse/message_library/issues/24#issuecomment-21926673) a new version of feeds, search_api and and features. Here are the version numbers on my build:

feeds 7.x-2.0-alpha8
search_api 7.x-1.7
features 7.x-2.0-rc1

What does "No content type target" means?

Jun

jmatsushita commented 11 years ago

Ok, so I've tracked this error which is because the importer looked for an obsolete ['content-type'] config when the new key is ['bundle']. Committed change 354a14aa22b09633e2d41dc26a2d516a8883b65f

jmatsushita commented 11 years ago

Next error is : Drush command terminated abnormally due to an unrecoverable error. [error] Error: Call to undefined function _message_library_importer_remove_empty_terms_and_content() in /home/aegir/platforms/humanitarian-response-7.x-1.13/sites/all/modules/message_library/message_library_importer/message_library_importer.drush.inc, line 104

jmatsushita commented 11 years ago

Commented out the function (not sure where it went?!) and fixed the arguments of drush_invoke. 03365a7856c48926ad17c47947f257d0a5991041

jmatsushita commented 11 years ago

Closing this. Will start a fresh Issue after trying to reinstall from scratch again.

UN-OCHA / message_library