Early Bird Registration for DrupalCon Portland 2024 is open! Register by 23:59 PST on 31 March 2024, to get $100 off your ticket.
Despite download tokens working for anonymous users thanks to #2062663: Fix the token on the file/FID/download callbacks to work for anonymous users it seems as if the googlebot can't access them. Webmaster tools report hundreds of 403 errors for file/FID/download paths. Any ideas where to start looking to fix this?
Comments
Comment #1
jesss CreditAttribution: jesss commentedI think I've got a similar issue. Download tokens work for the first anonymous user -- any anons coming after get the 403 error.
Comment #2
Dave ReidCrawlers should not be able to access the file download paths, for good reason. You should add file/*/download to your site's robots.txt.
Comment #3
tancClosing this issue as I think your advice is correct. Might be worth putting something about this on the project page?