Update for Rewrite Rules - Give Boost even bigger performance gain

Interesting stuff.
[Note, I'm not actually running Boost module myself yet, just checking out my options]

You seem to know the ins and outs of .htaccess very well
Are there improvements that can me made to the standard drupal .htaccess file to improve performance, even without Boost module?

http://cvs.drupal.org/viewvc.py/drupal/drupal/.htaccess?revision=1.93&vi...

is the latest. There was a big debate about missing favicon.ico lately that caused the latest update.

Regards
Alan

why not just check if {REQUEST_URI} -f => which should satisfy all the non-generated types such as css, jpg, etc. basically what you are trying to do with ".". Then follow the other conditionals in the order of most restrictive evaluation first .. of the three types, starting with DRUPAL_UID in cookie first (this will immediately fork out the logged in users and let them begin the uphill battle of php invocation and db connections), then Query string eval (even anonymous users can have this) and finally eval of most common request method of GET or not. With this, for most sites, the evaluation is forked at the least travelled path, I 'd think.

The rewritten rules were working great for me until I discovered that the Drupal-generated sitemap.xml file was not working. After much head scratching, I realized that the fix was to add a condition to the first rule that skipped it if the file did not exist on the file system.

        # If the REQUEST_URI ends in . then 2-4 word chars then leave request unchanged,
        # and stop processing rewrite rules. This benefits logged in and non-logged in users.
        # Note: added condition to skip the rule if the file does not exists (needed for sitemap.xml)
        RewriteCond %{REQUEST_URI} -f
        RewriteRule \.\w{2,4}$ - [L]

@ wobbler: I think in both our approaches we agree to check for dot file extensions first and serving it up without needing to do any other REGEXP evals. Since in serving up a single page ALL (.css/.jpg/.png/.gif/.js) but one of the request (the actual page) will be dot extension types there is no need to do regexp evals for these. But I am still of the opinion to check if the file exists or not before trying to serve it up. So I guess what you are saying is if the file is an extension type with a dot preceding 3 to 4 alphabets then you try to serve the file without even checking if the file is there or not ? Is there any risks to doing so ? Since boost did not come with rewrite rules for lighttpd which is what I use, I had to come up with my own .. here : http://drupal.org/node/150909#comment-997460 . I am sensitive to anything that will help improve performance but not sure if not checking for file existence will be a good idea. If you or anyone else has a comment about this pls share.

This has been tested with the latest version of boost running with this patch #141954: Gzipping of static html files (*.html.gz)

  # BOOST START
  <IfModule mod_headers.c>
    Header add Expires "Sun, 19 Nov 1978 05:00:00 GMT"
    Header add Cache-Control "store, no-cache, must-revalidate, post-check=0, pre-check=0"
  </IfModule>
  <IfModule mod_mime.c>
    AddCharset utf-8 .html
  </IfModule>
  #serve file IF it exist on server
  RewriteCond %{REQUEST_FILENAME} -f
  RewriteRule .? - [L]
  #skip boost IF not get request OR uri has wrong dir OR cookie is set
  RewriteCond %{REQUEST_METHOD} !^GET$ [OR]
  RewriteCond %{REQUEST_URI} ^/admin|^/cache|^/misc|^/modules|^/sites|^/system|^/themes|^/user/login [OR]
  RewriteCond %{HTTP_COOKIE} DRUPAL_UID
  RewriteRule .? - [S=6]
  #Skip next 3 rules IF uri contains a query string
  RewriteCond %{QUERY_STRING} !^$
  RewriteRule .? - [S=3]

  # root
  RewriteCond %{REQUEST_URI} ^/$
  RewriteCond %{DOCUMENT_ROOT}/cache/%{SERVER_NAME}/index.html -f
  RewriteRule ^(.*)$ cache/%{SERVER_NAME}/index.html [S=3]
  # subdir root
  RewriteCond %{DOCUMENT_ROOT}/cache/%{SERVER_NAME}%{REQUEST_URI} -d
  RewriteCond %{DOCUMENT_ROOT}/cache/%{SERVER_NAME}%{REQUEST_URI}/index.html -f
  RewriteRule ^(.*)$ cache/%{SERVER_NAME}/%{REQUEST_URI}/index.html [S=2]
  # non root
  RewriteCond %{DOCUMENT_ROOT}/cache/%{SERVER_NAME}%{REQUEST_URI}.html -f
  RewriteRule ^(.*)$ cache/%{SERVER_NAME}/%{REQUEST_URI}.html [S=1]
  # url variables
  RewriteCond %{DOCUMENT_ROOT}/cache/%{SERVER_NAME}%{REQUEST_URI}_%{QUERY_STRING}.html -f
  RewriteRule ^(.*)$ cache/%{SERVER_NAME}/%{REQUEST_URI}_%{QUERY_STRING}.html [S=0]

  #serve gziped content if it exists
  <FilesMatch "\.(html.gz)$">
    AddEncoding x-gzip .gz
    ForceType text/html
  </FilesMatch>
  RewriteCond %{HTTP_USER_AGENT} !".*Safari.*"
  RewriteCond %{HTTP:Accept-encoding} gzip
  RewriteCond %{REQUEST_FILENAME}.gz -f
  RewriteRule ^(.*)\.html $1.html.gz [L]
  # BOOST END

These rules need to be revised, if a url should be a POST and it contains a url variable, it doesn't work correctly as it did before.

RewriteCond %{REQUEST_METHOD} !^GET$
OR
RewriteCond %{REQUEST_METHOD} !=,GET
OR
RewriteCond %{REQUEST_METHOD} !^GET

???

Going to wait until we get a clear set of rules for each type of install (single, subdir, multi-site) before optimizing more. Right now I will be integrating this at the top of boost's rules as it seems fairly safe and effective.

  #serve file IF it exist on server
  RewriteCond %{REQUEST_FILENAME} \.\w{2,4}$
  RewriteCond %{REQUEST_FILENAME} -f
  RewriteRule .? - [L]

Moving to
#428942: AHAH update textarea for .htaccess rules on performance >> boost page.

Can someone help me here please?

I have a multi site setup with drupal in a sub directory on root. so i have:
public_html
--drupal
--newsite (subdomain symlinks to the drupal folder)
--index.html and other static files of root.

Im working this on the subdomain to change to main domain when i go live.

I am using the boosted2.txt setup as pasted below in my newsite/.htaccess, not in the drupal folder. I tried putting the .htaccess boost code in the drupal folder, status report coughs. Now, it's in the newsite/.htaccess and status report is fine. With Cache in the newsite/cache folder, i see the files created in there fine, but does not get served.

Can someone please help me? I have been on this for 2 agonizing days : (

Settings are:

  ### BOOST START ###

  # Gzip Cookie Test
  RewriteRule ^(.*)boost-gzip-cookie-test\.html cache/perm/boost-gzip-cookie-test\.html\.gz [L,T=text/html,E=no-gzip:1]

  # GZIP - Cached css & js files
  RewriteCond %{HTTP_COOKIE} !(boost-gzip)
  RewriteCond %{HTTP:Accept-encoding} !gzip
  RewriteRule .* - [S=2]
  RewriteCond %{DOCUMENT_ROOT}/cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.css\.gz -s
  RewriteRule .* cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.css\.gz [L,QSA,T=text/css,E=no-gzip:1]
  RewriteCond %{DOCUMENT_ROOT}/cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.js\.gz -s
  RewriteRule .* cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.js\.gz [L,QSA,T=text/javascript,E=no-gzip:1]

  # NORMAL - Cached css & js files
  RewriteCond %{DOCUMENT_ROOT}/cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.css -s
  RewriteRule .* cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.css [L,QSA,T=text/css]
  RewriteCond %{DOCUMENT_ROOT}/cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.js -s
  RewriteRule .* cache/perm/%{HTTP_HOST}%{REQUEST_URI}_\.js [L,QSA,T=text/javascript]

  # Caching for anonymous users
  # Skip boost IF not get request OR uri has wrong dir OR cookie is set OR https request
  RewriteCond %{REQUEST_METHOD} !^(GET|HEAD)$ [OR]
  RewriteCond %{REQUEST_URI} (^/(admin|cache|misc|modules|sites|system|openid|themes|node/add|comment/reply))|(/(edit|user|user/(login|password|register))$) [OR]
  RewriteCond %{HTTP_COOKIE} DRUPAL_UID [OR]
  RewriteCond %{HTTPS} on
  RewriteRule .* - [S=7]

  # GZIP
  RewriteCond %{HTTP_COOKIE} !(boost-gzip)
  RewriteCond %{HTTP:Accept-encoding} !gzip
  RewriteRule .* - [S=3]
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.html\.gz -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.html\.gz [L,T=text/html,E=no-gzip:1]
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.xml\.gz -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.xml\.gz [L,T=text/xml,E=no-gzip:1]
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.json\.gz -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.json\.gz [L,T=text/javascript,E=no-gzip:1]

  # NORMAL
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.html -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.html [L,T=text/html]
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.xml -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.xml [L,T=text/xml]
  RewriteCond %{DOCUMENT_ROOT}/cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.json -s
  RewriteRule .* cache/normal/%{HTTP_HOST}%{REQUEST_URI}_%{QUERY_STRING}\.json [L,T=text/javascript]

  ### BOOST END ###

@Excalibur
Please create a new issue