Download & Extend
Issues

Allow crawling of /contact/ by search engines, don't disallow it in robots.txt

Posted by droplet on September 8, 2010 at 3:31pm
Project:Drupal core
Version:6.x-dev
Component:other
Category:feature request
Priority:normal
Assigned:Unassigned
Status:closed (fixed)
Issue tags:robots.txt

Issue Summary

similar topic: http://drupal.org/node/494462#new

no reason to block it. it should visitable on search engine and let users can find us.

#52 teezee

I mean, the contact module is core, but on most sites something like a contact section (contact press department, contact webmasters) with important address information will not be indexed if u would have aliases like /contact/press or /contact/webmaster.

Is it really up to Drupal core to enforce /contact/ as a disallowed path just because core contains a module that uses /contact ?

Login or register to post comments

Comments

#1

Posted by teezee on September 10, 2010 at 2:11pm

Subscribe, thanks @droplet for posting :)

#2

Posted by abaddon on September 25, 2010 at 10:53am

not to mention the people who use google as the address bar or if the contact link isnt that visible and they search for "site:example.com contact"..

#3

Posted by idflood on November 19, 2010 at 2:16pm
Status:active» needs review

Here is a quick patch. Contact page must be crawled by search engine, it's definitly one of the most important page to be referenced for most of the sites I do.

AttachmentSizeStatusTest resultOperations
905576-3-remove-contact-from-robots.patch512 bytesIdlePASSED: [[SimpleTest]]: [MySQL] 27,398 pass(es).View details

#4

Posted by droplet on December 26, 2010 at 6:25am
Status:needs review» reviewed & tested by the community

#5

Posted by webchick on December 29, 2010 at 4:05am
Version:7.x-dev» 6.x-dev
Status:reviewed & tested by the community» patch (to be ported)

Weird. I've no idea why that would be blocked.

Committed to HEAD. Marking down to 6.x.

#6

Posted by tim.plunkett on December 29, 2010 at 5:42am
Status:patch (to be ported)» needs review

Easy peasy.

AttachmentSizeStatusTest resultOperations
905576-6-remove-contact-from-robots.patch683 bytesIdleFAILED: [[SimpleTest]]: [MySQL] Unable to apply patch 905576-6-remove-contact-from-robots.patch.View details

#7

Posted by droplet on December 29, 2010 at 5:52am
Status:needs review» reviewed & tested by the community

just started up my box to patch it and you did.. haha
patch works

#8

Posted by System Message on December 29, 2010 at 6:01am
Status:reviewed & tested by the community» needs work

The last submitted patch, 905576-6-remove-contact-from-robots.patch, failed testing.

#9

Posted by idflood on December 29, 2010 at 9:40am

Maybe this one will pass.

AttachmentSizeStatusTest resultOperations
905576-9-remove-contact-from-robots.patch497 bytesIdleFAILED: [[SimpleTest]]: [MySQL] Unable to apply patch 905576-9-remove-contact-from-robots.patch.View details

#10

Posted by idflood on December 29, 2010 at 9:42am
Status:needs work» needs review

#11

Posted by System Message on December 29, 2010 at 10:02am
Status:needs review» needs work

The last submitted patch, 905576-9-remove-contact-from-robots.patch, failed testing.

#12

Posted by droplet on December 29, 2010 at 3:29pm
Status:needs work» needs review

try this

AttachmentSizeStatusTest resultOperations
contact.patch497 bytesIdleFAILED: [[SimpleTest]]: [MySQL] Unable to apply patch contact_32.patch.View details

#13

Posted by System Message on December 29, 2010 at 3:41pm
Status:needs review» needs work

The last submitted patch, contact.patch, failed testing.

#14

Posted by droplet on December 29, 2010 at 4:17pm

ok. "testbot work ONLY with D7 patches"

http://drupal.org/node/894166

#15

Posted by tim.plunkett on December 29, 2010 at 4:21pm
Status:needs work» reviewed & tested by the community

Oh, duh. Back to RTBC per #7.

AttachmentSizeStatusTest resultOperations
905576-15-remove-contact-from-robots-D6.patch683 bytesIgnored: Check issue status.NoneNone

#16

Posted by idflood on December 29, 2010 at 4:25pm
Status:reviewed & tested by the community» needs review

Ok, I forgot that the tests only work for d7 ( http://drupal.org/node/894166#comment-3693940 ). So here is the same patch as #9, only filename is changed to prevent the patch from beeing incorrectly tested.

AttachmentSizeStatusTest resultOperations
905576-14-remove-contact-from-robots-D6.patch497 bytesIgnored: Check issue status.NoneNone

#17

Posted by tim.plunkett on December 29, 2010 at 5:58pm
Status:needs review» reviewed & tested by the community

cross-post

#18

Posted by izmeez on February 22, 2011 at 6:49pm

subscribing

#19

Posted by Gábor Hojtsy on April 14, 2011 at 9:04am
Status:reviewed & tested by the community» fixed

Thanks, committed and pushed.

#20

Posted by System Message on April 28, 2011 at 9:11am
Status:fixed» closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

nobody click here