Memcache 95% misses

Hi all,

my company recently moved to an EC2 setup with two web servers under a load balancer and one monster server for Mysql (68GB RAM) (there are other machines as well).

We are trying to setup memcache shared on the webservers and mysql, but we got an, I think, abnormally number of misses (up to 95%).

This is our memcache start script on the webservers:

#!/bin/sh
BIN=/usr/bin/memcached
USER=nobody
case "$1" in
start) $BIN -d -u $USER -l 127.0.0.1 -m 64  -p 11211
$BIN -d -u $USER -l 127.0.0.1 -m 320 -p 11212
$BIN -d -u $USER -l 127.0.0.1 -m 128 -p 11213
;;
stop)  killall memcached
;;
esac

This in the mysql one:

#!/bin/sh
BIN=/usr/bin/memcached
USER=nobody
case "$1" in
start) $BIN -d -u $USER -m 192  -p 11211
$BIN -d -u $USER -m 960 -p 11212
$BIN -d -u $USER -m 384 -p 11213
$BIN -d -u $USER -m 192 -p 11214
;;
stop)  killall memcached
;;
esac

And this is our settings.php file config:

$conf = array_merge($conf,array(
    'memcache_key_prefix' => 'pre_example.org', 
    'cache_inc' => './sites/all/modules/memcache/memcache.inc',
    'session_inc' => './sites/all/modules/memcache/memcache-session.inc',
    'memcache_servers' => array(
        'localhost:11211' => 'default',
        'localhost:11212' => 'page',
        'localhost:11213' => 'filter',
        'ec2-base-internal.example.org:11211' => 'default',
        'ec2-base-internal.example.org:11212' => 'page',
        'ec2-base-internal.example.org:11213' => 'filter',
        'ec2-base-internal.example.org:11214' => 'session',
    ),
    'memcache_bins' => array(
        'session'      => 'session',
        'cache'        => 'default',
        'cache_menu'   => 'menu',
        'cache_page'   => 'page',
        'cache_filter' => 'filter',
        'cache_block'  => 'default',
        'cache_content'=> 'default',
    ),
)
);

When I enable memcache admin I get a bunch of misses of these type:

t	cache	cache-variables	1
getMulti	cache	cache-.wildcard-cached41d8cd98f00b204e9800998ecf8427e	1
getMulti	cache	cache-.wildcard-cache9e3669d19b675bd57058fd4664205d2a	0
getMulti	cache	cache-.wildcard-cache43b1cc1db7be63d899dd4280f578691a	0
getMulti	cache	cache-.wildcard-cacheb2145aac704ce76dbe1ac7adac535b23	0
getMulti	cache	cache-.wildcard-cacheceb232a461e38a2ed16aae9ab58671a8	0
getMulti	cache	cache-.wildcard-cached0b21061c239a845da3bc6d655c4af78	0
getMulti	cache	cache-.wildcard-cache2662f27692286cb9a581323772f43694	0
getMulti	cache	cache-.wildcard-cachee96baa7130fa5489a40af1559ebb7ab8	0
getMulti	cache	cache-.wildcard-cachee04aa5104d082e4a51d241391941ba26	0
getMulti	cache	cache-.wildcard-cache87cd8b8808600624d8c590cfc2e6e94b	0
get	cache	cache-locale%3Aes	1
getMulti	cache	cache-.wildcard-cached41d8cd98f00b204e9800998ecf8427e	1
getMulti	cache	cache-.wildcard-cache2db95e8e1a9267b7a1188556b2013b33	0
getMulti	cache	cache-.wildcard-cache7ce8636c076f5f42316676f7ca5ccfbe	0
getMulti	cache	cache-.wildcard-cachece04bd8105c135f89b0dfd5d9c1e8c5d	0
getMulti	cache	cache-.wildcard-cache7c9cab8054b37b29093b2bacb1d19d1a	0
getMulti	cache	cache-.wildcard-cachef5ddaf0ca7929578b408c909429f68f2	0
getMulti	cache	cache-.wildcard-cachefb216d9e8791e63c8d12bdc420956839	0
getMulti	cache	cache-.wildcard-cache413e7603053bfea2d5368b0e55f8a538	0
getMulti	cache	cache-.wildcard-cache409ade598a243d17d26da1d469916bed	0
getMulti	cache	cache-.wildcard-cache798b8cd76b62d9bc7197808218f050ec	0
get	cache	cache-schema	1
getMulti	cache	cache-.wildcard-cached41d8cd98f00b204e9800998ecf8427e	1
getMulti	cache	cache-.wildcard-cache03c7c0ace395d80182db07ae2c30f034	0
getMulti	cache	cache-.wildcard-cached54185b71f614c30a396ac4bc44d3269	0
getMulti	cache	cache-.wildcard-cachec340f4803161a481703d1c8bf74156ee	0
getMulti	cache	cache-.wildcard-cache6d1e4028f26def78d92d2a8790cfd95e	0
getMulti	cache	cache-.wildcard-cachedf5d54200625ec31523e0fe60eddc22c	0
getMulti	cache	cache-.wildcard-cachec9550d5fad73447fc24ba47f95d1c6b7	0
get	cache_content	cache_content-content_type_info%3Aes	1
getMulti	cache_content	cache_content-.wildcard-cache_contentd41d8cd98f00b204e9800998ecf8427e	1
getMulti	cache_content	cache_content-.wildcard-cache_content4a8a08f09d37b73795649038408b5f33	0
getMulti	cache_content	cache_content-.wildcard-cache_contentab6c040066603ef2519d512b21dce9ab	0
getMulti	cache_content	cache_content-.wildcard-cache_content7ed201fa20d25d22b291dc85ae9e5ced	0
getMulti	cache_content	cache_content-.wildcard-cache_content568d8e07bbe5575518d5005e559743c3	0
getMulti	cache_content	cache_content-.wildcard-cache_contente44c8feaf2e9f09016919a52d9853f68	0
getMulti	cache_content	cache_content-.wildcard-cache_content057e4f308a3d48cab0e3123ddfe8395d	0
getMulti	cache_content	cache_content-.wildcard-cache_content9a0364b9e99bb480dd25e1f0284c8555	0
getMulti	cache_content	cache_content-.wildcard-cache_content3dcfdf8fd0f9352c53fd2d28b041082f	0
getMulti	cache_content	cache_content-.wildcard-cache_content91c0fe68c7cf9cc062dbf26f08599822	0
getMulti	cache_content	cache_content-.wildcard-cache_content5ebc1fb6b46b9bb50fa948501aaf727d	0
getMulti	cache_content	cache_content-.wildcard-cache_content714f9cb902dd644c7e5d1c77f00502dd	0
getMulti	cache_content	cache_content-.wildcard-cache_contenteae05b08fff80e185c849f1314a3dca4	0
getMulti	cache_content	cache_content-.wildcard-cache_contentb885ca447acde75512b65f2892be6b7c	0
getMulti	cache_content	cache_content-.wildcard-cache_content4e95852cedf6fc36e3f0426af04603e2	0
getMulti	cache_content	cache_content-.wildcard-cache_content87c642b398dd524117cc80ea9e93ad7d	0
getMulti	cache_content	cache_content-.wildcard-cache_content62a6c6d5c8b981267ae6450f1192409b	0
getMulti	cache_content	cache_content-.wildcard-cache_content7f850b976f5a7d66e6eea55253be0848	0

Any idea of what can be the problem? Kind regards, Simon.