By tomrue on

Greetings,

Last evening I found my /var filled to 100%. After rolling a few over-sized log files I rebooted the system, which cleared /var down to around 50%.

After that I had some trouble getting MySql to connect because, it said, /tmp/mysql.sock was missing. I finally got that resolved and most of the sites on my server reappeared, with the exception of http://choicescounseling.tomrue.net which presently displays:

"Site off-line
"The site is currently not available due to technical problems. Please try again later. Thank you for your understanding.

"If you are the maintainer of this site, please check your database settings in the settings.php file and ensure that your hosting provider's database server is running. For more help, see the handbook, or contact your hosting provider."

I have tried:

  • confirming that /settings/default.php points to the correct db and the pw is correct
  • chmod 444 /setting/default/php
  • clearing the database's cache via PhpMyadmin.
  • running /update.php through the browser

Like the rest of the sites on my server it was working fine prior to yesterday's event. I have changed nothing other than the above. None of the other sites I have checked are currently having a problem.

tail /var/log/apache/stats.choicescounseling.access.log said:

cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:40 -0400] "GET /themes/garland/minnelli/minnelli.css?0 HTTP/1.1" 200 378 "http://choicescounseling.tomrue.net/?q=admin/build/themes/settings" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:40 -0400] "GET /misc/favicon.ico HTTP/1.1" 200 1045 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:41 -0400] "GET /themes/garland/images/bg-navigation.png HTTP/1.1" 200 104 "http://choicescounseling.tomrue.net/themes/garland/style.css?0" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:41 -0400] "GET /themes/garland/images/body.png HTTP/1.1" 200 712 "http://choicescounseling.tomrue.net/themes/garland/style.css?0" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:41 -0400] "GET /themes/garland/images/bg-content.png HTTP/1.1" 200 485 "http://choicescounseling.tomrue.net/themes/garland/style.css?0" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:41 -0400] "GET /themes/garland/images/bg-content-right.png HTTP/1.1" 200 3169 "http://choicescounseling.tomrue.net/themes/garland/style.css?0" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:17:41 -0400] "GET /themes/garland/images/bg-content-left.png HTTP/1.1" 200 3275 "http://choicescounseling.tomrue.net/themes/garland/style.css?0" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100628 Ubuntu/10.04 (lucid) Firefox/3.6.6"
spider98.yandex.ru - - [16/Jul/2010:22:45:12 -0400] "GET /?q=credentials HTTP/1.1" 503 2464 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:22:53:56 -0400] "GET / HTTP/1.0" 503 2452 "-" "Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.8e"
cpe-24-161-18-74.hvc.res.rr.com - - [16/Jul/2010:23:00:01 -0400] "GET /cron.php HTTP/1.0" 503 2452 "-" "Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.8e"

The above looks like it's trying to load, but I keep get the same Drupal message in the browser.

Can anyone offer me any guidance on what else will bring this site back online?

Many thanks, and best wishes,

Tom

⋅ Categories: Drupal 6.x

Comments

tomrue’s picture

tomrue commented

Any advice, please?

dman’s picture

dman commented

You may need to look at the apache error log, not the success one. And PHP logging (not Apache) could be enabled (send errors to screen in php.ini) if you want to really see what the relevant message is.

Without seeing the full message, it could be any number of things. if you've got phpmyadmin working with no trouble, have you tried repairing tables? No status errors reported?

.dan. is the New Zealand Drupal Developer working on Government Web Standards

tomrue’s picture

tomrue commented

Thank you for your reply.

All sites on the server (including this one) are working except this one. I tried repairing tables in this db and they appear fine.

Btw, if this could be a clue, this is the first site on the server (and, as I mentioned, the only one that is broken) running the very latest version, 6.17.

In /usr/local/etc/php.ini, I uncommented - log_error = On by deleting the semi-colon, leaving the hyphen in place. Is that correct? After doing this, still saw no errors on the web page. Then, leaving the log_error = On setting in place, I rebooted. Still no error messages showing up.

Doing tail /var/log/httpd-error.log, I see no reference to this particular site. There are other error messages about missing data files here and there, or theme errors on one other site. But all of those sites, outwardly, appear to be running fine - at least in the browser.

One thing I do notice by running /tail/var/log/apache/stats.choicescounseling.access.log is that it contains references suggesting that's site's theme as being Garland. I have been using Forest Floor, not Garland. I tried renaming the themes directly all together. The only result of that was I got the same error message, unthemed.

I am at a loss, despite extensive googling. Any other guidance?

Tom

tomrue’s picture

tomrue commented

The first sentence of the second sentence should begin, "All sites on the server are working except this one..."

Sorry about that.

dman’s picture

dman commented

I was thinking of display_errors = On which may show you what's happening directly on the page. turn it off again later.
HOWEVER, seeing as Drupal is catching the 'error' anyway, it may not be falling through to PHP logging anyway.
Can you inspect your watchdog logs from phpmyadmin.

I've really got to feel that this is something normal and boring, like database access for that user or a miss-spelled password or DB port.
Really double-check that you can log in via the commandline using the credentials currently in your settings.php
mysql -u username -pPASS -h hostIP databasename

.dan. is the New Zealand Drupal Developer working on Government Web Standards

tomrue’s picture

tomrue commented

I don't see anything here that looks like an error. Do you? These are several recent entries. Would a re-install of Drupal from scratch be likely to help, or is the problem definitely in the database?

Thanks for your guidance on this.

12 1 update Attempted to fetch information about all available... a:0:{} 5 view http://lmhc.tomrue.net/?q=admin http://lmhc.tomrue.net/ 24.161.18.74 1274726232
13 1 update Attempted to fetch information about all available... a:0:{} 5 view http://lmhc.tomrue.net/?q=admin/build/themes http://lmhc.tomrue.net/?q=admin 24.161.18.74 1274726806
14 1 update Attempted to fetch information about all available... a:0:{} 5 view http://lmhc.tomrue.net/?q=admin/reports/status/run... http://lmhc.tomrue.net/?q=admin/build/themes 24.161.18.74 1274726843
15 1 cron Cron run completed. a:0:{} 5 http://lmhc.tomrue.net/?q=admin/reports/status/run... http://lmhc.tomrue.net/?q=admin/build/themes 24.161.18.74 1274726843
16 1 content @type: added %title. a:2:{s:5:"@type";s:4:"page";s:6:"%title";s:20:"How... 5 view http://lmhc.tomrue.net/?q=node/add/page http://lmhc.tomrue.net/?q=node/add/page 24.161.18.74 1274728061
17 1 content @type: updated %title. a:2:{s:5:"@type";s:4:"page";s:6:"%title";s:20:"How... 5 view http://lmhc.tomrue.net/?q=node/1/edit http://lmhc.tomrue.net/?q=node/1/edit 24.161.18.74 1274729491
18 1 content @type: updated %title. a:2:{s:5:"@type";s:4:"page";s:6:"%title";s:20:"How... 5 view http://lmhc.tomrue.net/?q=node/1/edit http://lmhc.tomrue.net/?q=node/1/edit 24.161.18.74 1274729797
19 1 content @type: updated %title. a:2:{s:5:"@type";s:4:"page";s:6:"%title";s:20:"How... 5 view http://lmhc.tomrue.net/?q=node/1/edit

tomrue’s picture

tomrue commented

Actually, this site is not very old, so there is not a huge amount of content. I could start totally from scratch and rebuild it, but I would like to be able to retrieve some of the page texts, menu items, etc. rather than re-writing it all. Is there a way to do that? Browsing the database in PhpMyAdmin, the closest I can find is the node titles, but not the content itself. Where might I find that buried?

dman’s picture

dman commented

It's no fun to go digging, but the meat of the site is in node_revisions.

I can't guess what's gone missing, it probably really is as the message says, a basic problem with communicating with the database. Not necessarily corrupt at all.

.dan. is the New Zealand Drupal Developer working on Government Web Standards

anuska’s picture

anuska commented

Hello,
I had the same problem and like Dan suggested tried loging on to mysql from the command line using the same options settings.php uses. I found the problem in my password.
Thanks,
Ana

surya.sairaam’s picture

surya.sairaam commented

Hello,

Just create one more user in database and add that user in database.

in settings.php change the database user and password.

it is working ............... !

Thank you...