Skip to content

Migration process kills automatically while migrating from magento 1.9.2.4 to magento 2.1.0. #341

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
chiju opened this issue Aug 1, 2017 · 5 comments
Labels

Comments

@chiju
Copy link

chiju commented Aug 1, 2017

php bin/magento migrate:data -r vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.4/config.xml

========
[2017-08-01 07:14:55][INFO][mode: data][stage: data migration][step: Map Step]: started
32% [=========>------------------] Remaining Time: 2 mins Killed
-bash-4.1$

after some browsing, got a clue to check kernel logs

========
CT-26626-bash-4.1# dmesg | grep php
[65925374.412442] Out of memory in UB 26626: OOM killed process 12514 (php) score 0 vm:2330532kB, rss:1793452kB, swap:0kB
[65926087.231422] Out of memory in UB 26626: OOM killed process 12799 (php) score 0 vm:2323364kB, rss:1788396kB, swap:0kB
[65926338.670874] Out of memory in UB 26626: OOM killed process 12888 (php) score 0 vm:2328488kB, rss:1792244kB, swap:0kB

Already provided 2 GB limit for php.

===============

php -ini | grep memory_limit

memory_limit => 2G => 2G
1#

I watched RAM usage using watch command, the usage increased with in 2 secounds from 1 GB to 2.5 GB GB. Server has 2.5 GB total RAM.

@victor-v-rad
Copy link
Collaborator

#303 similar issue
set memory_limit = -1

@chiju
Copy link
Author

chiju commented Aug 3, 2017

Still getting error

100% [============================] Remaining Time: 1 sec
[2017-08-03 05:19:30][INFO][mode: data][stage: data migration][step: Map Step]: started
32% [=========>------------------] Remaining Time: 2 mins

[Exception]
Warning: Error while sending QUERY packet. PID=7544 in /var/www/vhosts/angola-books.com/httpdocs/magento2/vendor/magento/data-migration-tool/src/Migration/Resource
Model/Adapter/Mysql.php on line 169

=========================

Then changed the max limit for mysql, again the process got killed

===========
vim /etc/my.cnf
wait_timeout = 100
max_allowed_packet=524288000

After this same issue

========
[2017-08-03 05:24:25][INFO][mode: data][stage: data migration][step: Customer Attributes Step]: started
[2017-08-03 05:24:25][INFO][mode: data][stage: volume check][step: Customer Attributes Step]: started
[2017-08-03 05:24:25][INFO][mode: data][stage: data migration][step: Map Step]: started
19% [=====>----------------------] Remaining Time: 1 secKilled
-bash-4.1$
-bash-4.1$

Please help

@chiju
Copy link
Author

chiju commented Aug 3, 2017

increased RAM to 4.5 GB, still that process kills itself.

bash-4.1$ php bin/magento migrate:data vendor/magento/data-migration-tool/etc/ce-to-ce/1.9.2.4/config.xml
2017-08-03 06:32:13][INFO][mode: data][stage: data migration][step: Customer Attributes Step]: started
[2017-08-03 06:32:13][INFO][mode: data][stage: volume check][step: Customer Attributes Step]: started
[2017-08-03 06:32:13][INFO][mode: data][stage: data migration][step: Map Step]: started
19% [=====>----------------------] Remaining Time: 1 secKilled
-bash-4.1$

=======
CT-26626-bash-4.1# dmesg | grep php
[66088960.772387] Out of memory in UB 26626: OOM killed process 6092 (php) score 0
[66096668.230923] Out of memory in UB 26626: OOM killed process 11284 (php) score 0 vm:4042188kB, rss:3367772kB, swap:0kB
[66096693.035964] Out of memory in UB 26626: OOM killed process 11312 (php) score 0 vm:4760016kB, rss:3839460kB, swap:0kB
CT-26626-bash-4.1#

@karthik147
Copy link

karthik147 commented Aug 9, 2017

Hi

I too getting the same error and I dont find way to proceed to next step:

Please help us to resolve this

Here is the error log:

[5680233.641853] php[3367]: segfault at 7ffd4c8e0ff8 ip 00007f1d061d9c15 sp 00007ffd4c8e1000 error 6 in libpcre.so.3.13.1[7f1d061bc000+3d000]
[5766100.704098] php[17469]: segfault at 7ffe5b1a7e98 ip 00007fa01415055a sp 00007ffe5b1a7e90 error 6 in libpcre.so.3.13.1[7fa01413d000+3d000]
[7454932.121500] php invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[7454932.121504] php cpuset=/ mems_allowed=0
[7454932.121507] CPU: 0 PID: 13290 Comm: php Not tainted 3.13.0-103-generic #150-Ubuntu
[7454932.121709] [13290] 1013 13290 1352454 1257383 2603 0 0 php
[7454932.121711] Out of memory: Kill process 13290 (php) score 616 or sacrifice child
[7454932.126553] Killed process 13290 (php) total-vm:5409816kB, anon-rss:5029480kB, file-rss:52kB
[7459576.466659] [23994] 1013 23994 1350982 1255604 2600 0 0 php
[7459576.466668] Out of memory: Kill process 23994 (php) score 615 or sacrifice child
[7459576.472203] Killed process 23994 (php) total-vm:5403928kB, anon-rss:5022368kB, file-rss:48kB
[7460211.042924] php invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[7460211.042929] php cpuset=/ mems_allowed=0
[7460211.042931] CPU: 0 PID: 25872 Comm: php Not tainted 3.13.0-103-generic #150-Ubuntu
[7460211.043151] [25872] 1013 25872 1346231 1250661 2588 0 0 php
[7460211.043153] Out of memory: Kill process 25872 (php) score 613 or sacrifice child
[7460211.047300] Killed process 25872 (php) total-vm:5384924kB, anon-rss:5002592kB, file-rss:52kB
[7460287.839668] php invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[7460287.839672] php cpuset=/ mems_allowed=0
[7460287.839675] CPU: 0 PID: 26004 Comm: php Not tainted 3.13.0-103-generic #150-Ubuntu
[7460287.839898] [26004] 1013 26004 1345783 1250488 2590 0 0 php
[7460287.839899] Out of memory: Kill process 26004 (php) score 613 or sacrifice child
[7460287.843788] Killed process 26004 (php) total-vm:5383132kB, anon-rss:5001876kB, file-rss:76kB
[7461999.507517] [29984] 1013 29984 1339254 1244096 2578 0 0 php
[7461999.507518] Out of memory: Kill process 29984 (php) score 609 or sacrifice child
[7461999.512344] Killed process 29984 (php) total-vm:5357016kB, anon-rss:4976332kB, file-rss:52kB

@priyanka795
Copy link

Hi, I have the same issue.
[2019-09-16 06:05:31][DEBUG][mode: data][stage: data migration][step: Map Step][table: sales_flat_order]: migrating
100% [============================] Remaining Time: < 1 secKilled

Please help!!
Thanks
Screenshot from 2019-09-16 12-31-03

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants