I was trying to browse one of my website through Lynx web browser, but found that site cannot be accessed.

Lynx gave me this errors:

Looking up vedabase.com
Making HTTP connection to vedabase.com
Sending HTTP request.
HTTP request sent; waiting for response.
Alert!: Unexpected network read error; connection aborted.
Can't Access `http://vedabase.com/'
Alert!: Unable to access document.

lynx: Can't access startfile

Websites which I have on different server (Apache) are from Lynx accessible.

Comments

omega8cc’s picture

omega8cc commented
Priority: Critical » Normal

What is its Agent string? I don't think we block Lynx by intention here: http://drupalcode.org/sandbox/omega8cc/1074910.git/blob/HEAD:/http/nginx...

anantagati’s picture

anantagati commented

User string of Lynx I tried to use:

Lynx/2.8.7pre.6 libwww-FM/2.14 SSL-MM/1.4.1

and 

Lynx/2.8.8dev.5 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.8.6

When I tried to access http://omega8.cc, I got same error. Drupal.org and others load normally.

anantagati’s picture

anantagati commented

Lynx installed on Mac through homebrew works, but from Linux boxes doesn't.

omega8cc’s picture

omega8cc commented
Status: Active » Closed (works as designed)

This is by design because libwww is used by many aggressive crawlers so we deny any robot (and browser) using it by default.

Since BOA-1.4S you can modify this behavior by removing 'libwww' from the maps in the /var/aegir/config/server_master/nginx.conf file. Note that your change will be overwritten on every upgrade.