Reduce memory usage to improve scalability

Posted by Francewhoa on August 9, 2009 at 4:52pm

Issue Summary

This is a feature request to reduce memory usage on page load for large taxonomy. It would improve scalability.

To reproduce this issue use a 20MB taxonomy and monitor memory usage. Taxonomy is 3 levels deep.

On page load TaxiSelect 6.x.1.0 uses 426MB of memory (RAM). And this is for only one visitor. As oppose to almost 0MB (zero) or memory for 'Autocomplete Widgets for CCK' module http://drupal.org/project/autocomplete_widgets Maybe part of 'Autocomplete Widgets for CCK' module can be retrieve to improve TaxiSelect.

Most share hosting providers have 32MB limit. Most populare VPS hosting plans are between 360MB & 720MB limit.

To get above memory usage result I type in the following command in Ubuntu terminal. This will output the memory usage every 1 second for 50 iterations (50 secondes). Display in megabyte (M).
vmstat -S M 1 50

Another option to monitor module memory usage is the Devel module. Under 'Performance Logging' maximum memory usage. http://drupal.org/project/devel

To quickly and easily create a 20MB taxonomy I use the Devel module. And its 'Generate content' feature. Hope this help.

Comments

#1

Posted by Alan D. on August 10, 2009 at 6:42am

Status:

active

» closed (duplicate)

I would assume that this is due to what the core is doing. I'm working on a new branch that will prevent Drupals tax. select field from being generated before the hook_form_alter where my widget is added in branch 1. I'm adding multiple support at the same time, so it'll be a couple week or so before this is completed.

See Use taxonomy_override_selector to reduce load overheads