503 on AWS/Bitnami

[boblaw]

Trying to use the UB data migration with an install of a Magento image from Bitnami. The prior version (1.9.x) has over 200,000 products in the DB. The first few steps work fine but when I get to "Step 5: Migrate Products" I experience the following error:

Error 503 Backend fetch failed

Backend fetch failed Guru Meditation:

XID: 327923

Varnish cache server

I have adjusted timeouts within the php.ini and also searched for any setting that might have to do with varnish itself (with little success). I thought that I was onto something when reading someone with similar, but they were running a different version of Varnish (3. We are running 4).. (http://stackoverflow.com/questions/27739853/varnish-cache-server-error-503-service-unavailable). Not only did this setting fail to exist in the .vcf file, but the vcf files do not exist in the install.

With this being a Bitnami/Magento (via AWS Marketplace) I figured that someone else might have experienced the issue.

I have been unable to track down any form of solution.

Any help would be greatly appreciated.

[daschenbrener]

any luck? and what type of instance are you on? i'm having similar issues

[boblaw]

daschenbrener,

I don't recall exactly, but I eventually found that "Step 5" was using an iFrame. When I loaded the iFrame directly, the 503 went away. It all made sense, however, the number of hours for the process was incredibly lengthy (over 24 hours). I was running on t1.medium.

The iFrame can be found at: /pub/ub-tool/index.php/migrate/step1 I just realized that gives the impression that it is behind the admin login when in fact it is not. The 'pub' folder is publicly accessible and not secured. I wouldn't share your URL unless you want someone to reset things on you.

All products moved over, but the process did not complete fully. The products and data are there, but the products were not assigned to categories.

Have you tried the tool recommended in the Magento DOCS? http://devdocs.magento.com/guides/v2.0/migration/migration-tool-install.html

I would love to work through this with you as I need to make a move soon but haven't touched this in a few weeks.

[daschenbrener]

i had started to use that magento tool, but had stopped due to time.

I also have found that when it does the 503, it appears to still run the processes in the background.

i am at step 7 right now about 30,000 customers , so well see what happens when that is done as it appears to be working.

But I would like to learn that magento tool fully and just use that

[boblaw]

Now that you are through to step 7, you should be in the clear. I ran into the same experience in getting through the 503's and still processing, however there was eventually a error that it could not get through (I don't recall the specifics).

Agreed with the Magento tool.

What are you using for Bulk product import now? I am a MAGMI user and I am not sure what is available for 2.0.

[daschenbrener]

no we aren't using that right now as the site doesn't get that many new products,

but i will take a look at that and keep that in mind

and i can't justify the 400 USD for the pro version of the Ubertheme migration tool just yet.

[daschenbrener]

Im running a M4 large fyi

[boblaw]

How many products and how long did your step 5 take?

As I recall, I think that I tried to get a performance boost and did run m4.2xlarge at one point. It didn't seem to have much of an impact but that could have been due to my RDS.

On Tue, Aug 9, 2016 at 9:18 PM, daschenbrener notifications@github.com wrote:

Im running a M4 large fyi

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ubertheme/module-ubdatamigration/issues/29#issuecomment-238740250, or mute the thread https://github.com/notifications/unsubscribe-auth/AAkDx_RKcwqYH4sLQMRCMsmDcur5YJuZks5qeSbsgaJpZM4I4oDA .

[daschenbrener]

i think it ran about 2 hours, and I went with a higher performing volume as well

Products are only about 3500

[boblaw]

Ah. I was moving 280,000.

On Tue, Aug 9, 2016 at 9:36 PM, daschenbrener notifications@github.com wrote:

i think it ran about 2 hours, and I went with a higher performing volume as well

Products are only about 3500

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ubertheme/module-ubdatamigration/issues/29#issuecomment-238742738, or mute the thread https://github.com/notifications/unsubscribe-auth/AAkDx5e_tUDrEHxfzE6UpKtMjAbGqcFKks5qeSsmgaJpZM4I4oDA .

[daschenbrener]

wowsers, your site or a client?

[boblaw]

Client site. We actually have many more than the 280k to push, They are in batches for pricing pushes/etc., so it isn't a 280k import.

On Tue, Aug 9, 2016 at 9:38 PM, daschenbrener notifications@github.com wrote:

wowsers, your site or a client?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ubertheme/module-ubdatamigration/issues/29#issuecomment-238742980, or mute the thread https://github.com/notifications/unsubscribe-auth/AAkDx7E7WTCeQ5KpnOxuZQpr0-vDR5rXks5qeSuagaJpZM4I4oDA .

[daschenbrener]

Just and FYI, i dug into this and I believe i got the data migration tools from Magento to work, and Ill keep you posted with the results.

[boblaw]

That is great news. Keep me posted. I will be getting back to this on Sunday or Monday.

Bob L.

On Thu, Aug 11, 2016 at 8:05 PM, daschenbrener notifications@github.com wrote:

Just and FYI, i dug into this and I believe i got the data migration tools from Magento to work, and Ill keep you posted with the results.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/ubertheme/module-ubdatamigration/issues/29#issuecomment-239329552, or mute the thread https://github.com/notifications/unsubscribe-auth/AAkDxzIlVXb3H6UClJ3AD8dWAUDdvIv2ks5qe7jWgaJpZM4I4oDA .

[daschenbrener]

Got it working , just working through an error now getting the delta to work now.

[ErrorException] Undefined index: entity_type_table