Download & Extend

'multithreaded' updatedb for better memory consumption

Project:Drush
Version:All-versions-5.x-dev
Component:Code
Category:bug report
Priority:normal
Assigned:Unassigned
Status:closed (fixed)

Issue Summary

Here is some in progress code to deal with memory exhaustion when running a batch. I really need for #211182: Updates run in unpredictable order to land before I can make much progress. That patch there is going to require changes in our updatedb process. Namely, we have to call update_resolve_dependencies() or call its wrapper, update_batch().

AttachmentSize
updatedb.patch6.63 KB

Comments

#1

Title:updatedb for d7» 'multithreaded' updatedb for better memory consumption
Status:active» needs work

here's an updated patch

well. rewritten.

it is for d6 and d7.

apply the drush patch and then drop the batch_X.inc files into commands/core/drupal

AttachmentSize
drush_batch_api.diff 6.7 KB
batch_7.inc_.txt 6.93 KB
batch_6.inc_.txt 5.58 KB

#2

Thanks a lot. adrian explained via IM that this patch implements our own batch processing that honors the same batch definitions as expected by core. This turned out to be the sanest way to implement updatedb, for example.

I'll give this a test as soon as core gets its upgrade path sorted. Should be this week.

We need a @file declaration at top of batch.inc files explaining the deficiencies in core batch api and how our batch processing is different.

#3

Status:needs work» fixed

i committed a cleaned up and documented version of this.

#4

Status:fixed» closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.