search

magento / data-migration-tool

Magento Data Migration Tool
https://devdocs.magento.com/guides/v2.3/migration/bk-migration-guide.html
Open Software License 3.0
336 stars 200 forks source link

Delta changes not migrated in M2 #799

Open dmiguelmtz opened 4 years ago

dmiguelmtz commented 4 years ago

Hi,

M1 version is 1.9.3.0 M2 version is 2.3.4

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity Source: 16243 Destination: 16210 [2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity_int Source: 29580 Destination: 29512 [2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity_varchar Source: 114 Destination: 115 [2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_address_entity Source: 15593 Destination: 15566 [2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_address_entity_varchar Source: 370 Destination: 358 [2020-02-28 15:32:00][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity Source: 181 Destination: 180 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_datetime Source: 228 Destination: 224 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_decimal Source: 114 Destination: 112 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_int Source: 882 Destination: 873 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_text Source: 673 Destination: 660 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_varchar Source: 1226 Destination: 1214 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_product Source: 9848 Destination: 9798 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_compare_item Source: 7516 Destination: 17 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity Source: 2521 Destination: 2513 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_datetime Source: 14701 Destination: 14643 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_decimal Source: 12353 Destination: 12307 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_int Source: 10013 Destination: 9981 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery Source: 2778 Destination: 2770 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery_value Source: 2778 Destination: 2770 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_text Source: 12374 Destination: 12328 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_varchar Source: 50805 Destination: 48180 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_website Source: 2521 Destination: 2513 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: cataloginventory_stock_item Source: 2521 Destination: 2513 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: newsletter_subscriber Source: 897 Destination: 891 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: report_compared_product_index Source: 12583 Destination: 28 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: report_event Source: 2940413 Destination: 148365 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review Source: 80 Destination: 81 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_detail Source: 80 Destination: 81 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_entity_summary Source: 38 Destination: 39 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_store Source: 160 Destination: 162 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_order_tax Source: 2092 Destination: 2071 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_order_tax_item Source: 1546 Destination: 1531 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_payment_transaction Source: 785 Destination: 776 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist Source: 335 Destination: 327 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist_item Source: 260 Destination: 254 [2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist_item_option Source: 268 Destination: 262 [2020-02-28 15:32:02][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: customer_visitor Source: 20488811 Destination: 1 [2020-02-28 15:32:20][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec

100% [============================] Remaining Time: < 1 sec

0% [>---------------------------] Remaining Time: < 1 sec 100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:20][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_order_grid Source: 3408 Destination: 3375 [2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_invoice_grid Source: 1963 Destination: 1945 [2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_shipment_grid Source: 1306 Destination: 1293 [2020-02-28 15:32:20][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of order entity: Source: 4146 Destination: 4109 [2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of invoice entity: Source: 1964 Destination: 1946 [2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of shipment entity: Source: 1306 Destination: 1293 [2020-02-28 15:32:20][WARNING]: Volume Check failed

100% [============================] Remaining Time: < 1 sec [2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: inventory_source_item Source: 2513 Destination: 2511 [2020-02-28 15:32:20][WARNING]: Volume Check failed

Does not migrate data in delta. I spend a few days and execute the delta migration to load the orders but not load them and just show me the differences.

abdullah-riaz commented 4 years ago

Hi, I am also facing this issue. I have migrated from M 1.7.0.2 to M 2.3.2. I have been running delta for 3-4 days, all increment orders and customers created in M1 are migrating in M2 successfully. Now, I have run delta after 2 days, some of orders are missing in M2 and it gives following warning:

[2020-03-09 07:32:26][WARNING]: Mismatch of entities in the document: sales_order_grid Source: 288 Destination: 277

Around 11 orders are missing in order list. When I query directly from database of Magento 2, count of entities is same for M1 and M2 and orders which are missing in admin panel order list present in database. Is there reason for that?

I have also run delta after this, New Increments orders and customers are also migrated but there are 11 orders which are not showing in order list are missed.

Morgy93 commented 4 years ago

Probably same issue here:

M1: 1.9.4.5 M2: 2.4.5-p1

[WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery_value Source: 7409 Destination: 7410
[WARNING]: Mismatch of entities in the document: report_event Source: 89707 Destination: 89718
[WARNING]: Volume Check failed

Seems to come from here: https://github.com/magento/data-migration-tool/blob/2.3-develop/src/Migration/Mode/Delta.php#L144

sharjeelz commented 3 years ago

Try following Advanced -> Developer settings disable Asynchronous indexing and try to reindex again

damienwebdev commented 2 years ago

From the original issue:

[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity_varchar Source: 114 Destination: 115

This means Magento 2 has MORE data than Magento 1, which is odd.

I was able to distill this down (in my instance) into the following query:

/**
* This retrieves the entities of the offending extra records.
*/
select entity_id, value from magento2.customer_entity_varchar 
where 
    attribute_id = 
        (select attribute_id from eav_attribute where attribute_code = 'rp_customer_id') AND
    entity_id NOT IN 
        (select entity_id from magento2.customer_entity_varchar 
            where attribute_id = (select attribute_id from eav_attribute where attribute_code = 'rp_customer_id'));

@victor-v-rad do we need to be concerned if there are more rp_customer_id in Magento 2 than in Magento 1?