Despite download tokens working for anonymous users thanks to #2062663: Fix the token on the file/FID/download callbacks to work for anonymous users it seems as if the googlebot can't access them. Webmaster tools report hundreds of 403 errors for file/FID/download paths. Any ideas where to start looking to fix this?

Comments

jesss’s picture

I think I've got a similar issue. Download tokens work for the first anonymous user -- any anons coming after get the 403 error.

Dave Reid’s picture

Crawlers should not be able to access the file download paths, for good reason. You should add file/*/download to your site's robots.txt.

tanc’s picture

Status: Active » Closed (works as designed)

Closing this issue as I think your advice is correct. Might be worth putting something about this on the project page?