By Amazon on

Here is a list of projects we are looking for collaborators to develop with.

File caching patch for 4.7 with the fast path to by-pass Drupal for anonymous cached pages.
We are writing a proposal for a partial cache that might use mod insert to cache dynamic pieces into largely cached pages.
We want to write a DB_layer that abstracts selects for MySQL slaves and directs writes to the MySQL master for clustered MySQL.
We are exploring putting redirects in the static cache so that static pages can be delivered from lightweight apache threads on a seperate Apache instance instead of heavy weight PHP threads.
We want to build a stock MySQL NDB cluster and tune it and report back on the tuning of the cluster.
We have built an environment checking API that could be used to check for recommended performance configurations.

Cheers,
Kieran

Comments

chiggsy’s picture

chiggsy commented

memcached is looking better by the day , have you examined this option?

Amazon’s picture

Amazon commented

We have heard good things but not seen any reliable test done.

Kieran Lal

brashquido’s picture

brashquido commented

Some big sites seem to have already adopted an APC/memcached combo to leverage maximum performance on high traffic sites. In this article Mike Morgan explains how they used APC + memcached at addons.mozilla.org with some very impressive results.

AMO currently runs on a handful of memcached instances, feeding multiple LVS nodes configured to use APC 3.0.10. We can now easily handle release traffic and during peak hours the web app doesn’t even break a sweat. The database bottleneck is history.

Best think about memcached is that you can now get a memcached server and client (PECL) to work on *nix and Win32 based operating systems meaning a memcached solution would benefit almost the entire community. I'd be happy to contribute time & money to get memcached and Drupal working properly together, but not if it were to be platform specific (such as Apache's mod_insert). It seems that some preliminary work has already been done, but I would say this was done on the Drupal 4.6 codebase.

----------------
Dominic Ryan
www.it-hq.org

handelaar’s picture

handelaar commented

Assuming that 'collaborate' != 'please give us money', I'm game for getting involved in unbreaking the db layer.

Drupal'll never scale properly without it.

OTOH I think NDB is interesting only as an academic exercise, what with the everything-must-be-in-RAM thing.

jpwillms’s picture

jpwillms commented

Hey.

I am also interested. I've been thinking of doing this for quite some time myself.

cheers.

..jordan