Support for Drupal 7 is ending on 5 January 2025—it’s time to migrate to Drupal 10! Learn about the many benefits of Drupal 10 and find migration tools in our resource center.
Just did the beta2 upgrade in prod - the migrate form never delivers. It doesn't seem to be eating ram or CPU on the server, I suspect this is an issue with DB indexes or at least within MySQL.
Comment | File | Size | Author |
---|---|---|---|
#5 | migratenewtab.png | 125.15 KB | mig5 |
#4 | migrate.png | 109.23 KB | mig5 |
Comments
Comment #1
anarcat CreditAttribution: anarcat commentedTo give you an idea: I started reporting this bug after i opened the "migrate" link in a new tab, and it's not yet rendered (still Loading).
This may be browser related - I'm using: Chromium 8.0.552.224 (68599) Ubuntu 10.04.
Comment #2
anarcat CreditAttribution: anarcat commentedFor reference, I have 178150 rows in the hosting_package_instance table...
Comment #3
j0nathan CreditAttribution: j0nathan commentedSame thing with Iceweasel 3.5.8 on Debian.
It doesn't load the site migrate form. But it loads the platform migrate form.
Comment #4
Anonymous (not verified) CreditAttribution: Anonymous commentedThe migrate form Just Works for me on a fresh install of HEAD. screenshot attached
Chrome 7.0.517.44 under Ubuntu 10.04
Comment #5
Anonymous (not verified) CreditAttribution: Anonymous commentedAlso works for me when opening in new tab (screenshot attached)
Comment #6
anarcat CreditAttribution: anarcat commentedI think we're suffering from the dreaded case of "zombie entries in the hosting_package_instance" table... Nevertheless, I think our current approach of creating tmp tables for comparison (see hosting_package.instance.inc) doesn't scale well with huge numbers of packages, and we need indexes. We've experimented with adding indexes to those tables with good results, and will patch soon.
Comment #7
bgm CreditAttribution: bgm commentedWhile debugging with Anarcat we found that adding the following keys improves performance a lot:
After this, a query that was taking 8 seconds went to 0.01 sec. The actual migrate page in the Aegir frontend went from over 2 minutes to about 15 seconds.
The bottleneck was found using Xdebug, which lead to _hosting_package_temporary_table(), called from hosting_package_comparison().
Here is more information on why those keys are necessary:
matt / bgm
Comment #8
anarcat CreditAttribution: anarcat commentedI have a fix waiting in the prod-koumbit branch, which does the following:
... in hosting_package.install. I am now running this in production with good results.
http://git.aegirproject.org/?p=hostmaster.git;a=shortlog;h=refs/heads/pr...
Right now it's a mish-mash of three commits because I screwed up the update, but I'll squash this in a single commit in a merge, once I get a go here.
Comment #9
joestewart CreditAttribution: joestewart commentedI've had this running for quite awhile and it made a huge difference.
Definitely welcome changes. Have not tried the other two yet though. thanks.
Comment #10
Anonymous (not verified) CreditAttribution: Anonymous commentedI haven't taken a close look at this, but I saw unconed in IRC whining about the same slowness / load deadlocks, and he pastebinned this suggestion
http://pastebin.com/cZ1yuc7i
Not sure if there's anything new here or not
Comment #11
Anonymous (not verified) CreditAttribution: Anonymous commentedDoes this commit have a typo?
http://git.aegirproject.org/?p=hostmaster.git;a=commitdiff;h=7cccc62e924...
Comment #12
anarcat CreditAttribution: anarcat commentedIndeed there is... Fixed!
Comment #13
Anonymous (not verified) CreditAttribution: Anonymous commentedI am seeing an improvement here even in my small (for some reason!) package tables., with those indexes above
Please do merge it in before rc, and maybe see if any of unconed's there are worthwhile?
Comment #14
anarcat CreditAttribution: anarcat commentedmerged the commit on the master branch at last.