Problem/Motivation

One of the OSL's FTP mirrors seems to be having issues. #2

Workaround.

Drop the ftp from the url ftp.drupal.org when downloading the file. See #9

When using drush patch drush according to #5

Remaining tasks

From #34 you could try to run the dig command and check for the (in)correct IP addresses.

(From Greg's email: Re: [development] FTP server down?)

1. Do: traceroute ftp.drupal.org
2. post it to a pastebin like http://pastebin.com/
3. Post a comment on this issue with a link to your pastebin

Original report by giorgio79

None of the file downloads work for me etc.

Comments

femrich’s picture

Experiencing the same problem from Kazakhstan...

killes@www.drop.org’s picture

Yes, one of the OSL's FTP mirrors seems to be having issues.

ayesh’s picture

Still having it :(

femrich’s picture

If it's only one mirror, is there a page somewhere with links to other mirrors? That would be handy. Likewise a link to redirect for selection of alternate mirrors...

Pierco’s picture

If you use Drush, you can strip the ftp for the url in wget.inc (/usr/share/drush/package_handler/wget.inc):

$release['download_link'] = str_replace('ftp.', '', $release['download_link']);

more info: http://contrib.linalis.com/content/continuer-dutiliser-drush-quand-ftpdr...

steven jones’s picture

Subscribe, it's not working for us in the UK.

femrich’s picture

I don't use drush. Looked at it. Seems enormously complex. Seems setting up alternate mirror links is a reasonable thing...

ransom’s picture

GIT works

Pierco’s picture

femrich’s picture

@ ransom, how do I get to GIT? I recall I tried it when drupal.org was redirecting everyone there for downloads, though I never could get it to work...

ransom’s picture

Click version control for download instructions should be the first one on the list.

Remember to change the version to 7 if it's on 6.

http://drupal.org/documentation/git for setup information

&

How to patch:

http://vimeo.com/20459209 - Good video on how to setup your account to work with git

http://drupal.org/node/1015228 - More documentation on patching

http://jacine.net/post/8419331209/patches - Another nice guide on patching.

The Vimeo video is very informative btw.

avpaderno’s picture

I have marked #1267580: Problems with the FTP server as duplicate of this one.

steven jones’s picture

So these are nice workarounds, but @killes@www.drop.org any idea of when the FTP server might be back up?

killes@www.drop.org’s picture

I presume it will be brought up again when the OSL gets operational again, ie in 2-4 hours.

pjcdawkins’s picture

Subscribe

danielb’s picture

you can try these
ftp://ftp-chi.osuosl.org/pub/drupal and ftp://ftp-nyc.osuosl.org/pub/drupal/

but removing 'ftp.' from the url does the trick for me too

giorgio79’s picture

Status: Active » Closed (fixed)

It seems to be working now for me.

boran’s picture

d.o seems to be having a hard time these last few days. I dont envy the sysadmins!
Gone down again for me..
---
wget http://ftp.drupal.org/files/projects/drush-7.x-4.5.tar.gz
--2011-10-05 13:18:52-- http://ftp.drupal.org/files/projects/drush-7.x-4.5.tar.gz
Resolving ftp.drupal.org... 140.211.166.134
Connecting to ftp.drupal.org|140.211.166.134|:80...
---
Is there a non d.o page where one can track major problems and when services are likely to come back?

klausi’s picture

Status: Closed (fixed) » Active

So this is not fixed.

zjoriz’s picture

Status: Closed (fixed) » Active

Looks still down indeed...
EDIT: not anymore for me. I could download some modules just now.

bensnyder’s picture

It's been down for me as well....

root@lampsrv01:/var/www/[site]/sites/all/modules# wget http://ftp.drupal.org/files/projects/context_respect-7.x-1.0.tar.gz
--2011-10-05 13:20:19--  http://ftp.drupal.org/files/projects/context_respect-7.x-1.0.tar.gz
Resolving ftp.drupal.org... 140.211.166.134
Connecting to ftp.drupal.org|140.211.166.134|:80... failed: Connection timed out.
Retrying.

--2011-10-05 13:20:40--  (try: 2)  http://ftp.drupal.org/files/projects/context_respect-7.x-1.0.tar.gz
Connecting to ftp.drupal.org|140.211.166.134|:80... wget http://ftp.drupal.org/files/projects/contextphp-7.x-1.x-dev.tar.gz
^C
root@lampsrv01:/var/www/[site]/sites/all/modules# wget http://ftp.drupal.org/files/projects/context_respect-7.x-1.0.tar.gz
--2011-10-05 13:20:58--  http://ftp.drupal.org/files/projects/context_respect-7.x-1.0.tar.gz
Resolving ftp.drupal.org... 140.211.166.134
Connecting to ftp.drupal.org|140.211.166.134|:80... ^C
greggles’s picture

Here are two tracerts from folks having this problem.

http://pastebin.com/UwwWhpCi
http://pastebin.com/XUbTdLbv

Is this an issue we can get someone paged to attend to during off hours? When files are getting downloaded thousands of times every day this means a bad experience for thousands of users.

boran’s picture

Status: Active » Closed (fixed)

If this helps debugging: traceroute for me stops after level3 at nero.net..
14 ae-21-52.car1.Seattle1.Level3.net (4.69.147.163) 161.420 ms 161.402 ms 161.240 ms
15 4.53.150.46 (4.53.150.46) 166.977 ms 166.960 ms 166.301 ms
16 corv-car1-gw.nero.net (207.98.64.177) 168.832 ms 168.822 ms 168.805 ms
17 * * *

redndahead’s picture

While this is something the OSL should look at can anybody verify it's actually fixed? May have been a cross post.

boran’s picture

Status: Active » Fixed

Yes, works for me, now. Marking fixed.

xjm’s picture

Title: ftp.drupal.org is down » ftp.drupal.org is down (and project download links do not work as a result)
Status: Fixed » Active

This is recurring today, see:
#1307396: Project download links are broken

jnettik’s picture

I can confirm this.

bdragon’s picture

OSUOSL got parked today and that screwed up the ns*.auth.osuosl.org. records.

While this is now resolved, many people's dns caches may have wrong data for up to 24 hours from now.

worldwidemv’s picture

Marked #1307496: Drupal Core can NOT be downloaded as duplicate of this issue.

avpaderno’s picture

ayesh’s picture

Servers works in my end.
I'm on a 203.153.X.X IP , Sri Lanka.

torrance123’s picture

I'm getting 403 messages, eg.

curl http://ftp.drupal.org/files/projects/media_vimeo-7.x-1.0-beta3.tar.gz             
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>403 Forbidden</title>
</head><body>
<h1>Forbidden</h1>
<p>You don't have permission to access /files/projects/media_vimeo-7.x-1.0-beta3.tar.gz
on this server.</p>
<hr>
<address>Apache Server at ftp.drupal.org Port 8080</address>
</body></html>
cmstom’s picture

@Pierco
This works for me. Thank you!

DarkEden Genesis’s picture

I have error when trying to install modules.

http://drupal.org/files/projects/ckeditor-7.x-1.3.tar.gz could not be saved to temporary://update-cache-01c1a8a5/ckeditor-7.x-1.3.tar.gz.
Unable to retrieve Drupal project from http://drupal.org/files/projects/ckeditor-7.x-1.3.tar.gz.

Any clues??
Thanks

charles1988’s picture

unable to download, forbidden since yesterday...
from India

http://ftp.drupal.org/files/projects/tweet-7.x-4.4.tar.gz

Forbidden

You don't have permission to access /files/projects/tweet-7.x-4.4.tar.gz on this server.

Apache Server at ftp.drupal.org Port 8080

kore21’s picture

Carlton here found a solution:
http://drupal.org/node/1307272#comment-5111296

int_ua’s picture

Reply to #9:
It worked for installing, but now it complains that no versions are found for these modules on the update page.

int_ua’s picture

Issue summary: View changes

Updated issue summary.

elc’s picture

Status: Closed (fixed) » Needs work
Executive summary
Root of problem seems to have been the delegation of a support domain - osuosl.org - to the wrong DNS servers which return wildcard answers directing to a server that is currently not active.

This delegation issue has been fixed, however, the glue records are missing so this will not completely come good until they are added again, and the TTL for the crap delegation expires across the globe.

to fix ..
  • Add ns1.auth.osuosl.org (140.211.166.140), ns2.auth.osuosl.org (140.211.166.141), ns3.auth.osuosl.org (216.165.191.53) as glue records on osuosl.org domain.
  • wait until TTL expires from crap delegation

maybe .. can someone check my working and conclusion here?

Works from Internode in Australia, because I run my own caching DNS server and it still has everything cached.

http://pastebin.com/PU7MDmva
Includes wget and traceroute, expires in a month.

"Admin - Reports - Available Updates" works fine too.

Does NOT work from Singapore where I use the ISP DNS servers.

wget http://ftp.drupal.org/files/projects/tweet-7.x-4.4.tar.gz
--2011-10-13 23:05:38-- http://ftp.drupal.org/files/projects/tweet-7.x-4.4.tar.gz
Resolving ftp.drupal.org... 68.178.232.100
Connecting to ftp.drupal.org|68.178.232.100|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: /files/projects/tweet-7.x-4.4.tar.gz?c0259d60 [following]
--2011-10-13 23:05:38-- http://ftp.drupal.org/files/projects/tweet-7.x-4.4.tar.gz?c0259d60
Connecting to ftp.drupal.org|68.178.232.100|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: /files/projects/tweet-7.x-4.4.tar.gz [following]
--2011-10-13 23:05:39-- http://ftp.drupal.org/files/projects/tweet-7.x-4.4.tar.gz
Connecting to ftp.drupal.org|68.178.232.100|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2011-10-13 23:05:39 ERROR 404: Not Found.

Difference seems to be the IP address that ftp.d.o resovles to.

working version:
Resolving ftp.drupal.org (ftp.drupal.org)... 64.50.233.100, 64.50.236.52
non-working version:
Resolving ftp.drupal.org... 68.178.232.100
from location that doesn't work normally (wrong dns resolve), THIS WORKS
wget --header='Host: ftp.drupal.org' http://64.50.233.100/files/projects/tweet-7.x-4.4.tar.gz

New server? Out of sync server? Someone screwing with DNS?

My bet is now someone screwing with DNS :P It might even be fixed in 13527 seconds.

Crappy DNS lookup - Look at where osuosl.org is delegated (or my upstream DNS server thinks it's delegated)

$ dig ftp.drupal.org

; <<>> DiG 9.3.6-P1-RedHat-9.3.6-16.P1.el5 <<>> ftp.drupal.org
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 7648
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 2, ADDITIONAL: 4

;; QUESTION SECTION:
;ftp.drupal.org. IN A

;; ANSWER SECTION:
ftp.drupal.org. 85610 IN CNAME ftp.osuosl.org.
ftp.osuosl.org. 2810 IN CNAME osuosl.org.
osuosl.org. 2810 IN A 68.178.232.100

;; AUTHORITY SECTION:
osuosl.org. 13527 IN NS ns49.domaincontrol.com.
osuosl.org. 13527 IN NS ns50.domaincontrol.com.

;; ADDITIONAL SECTION:
ns49.domaincontrol.com. 2810 IN A 216.69.185.25
ns49.domaincontrol.com. 2810 IN AAAA 2607:f208:206::19
ns50.domaincontrol.com. 2810 IN A 208.109.255.25
ns50.domaincontrol.com. 2810 IN AAAA 2607:f208:302::19

And this is where it's MEANT to be delegated

$ dig ftp.drupal.org

; <<>> DiG 9.7.3 <<>> ftp.drupal.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 56991
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 3, ADDITIONAL: 3

;; QUESTION SECTION:
;ftp.drupal.org. IN A

;; ANSWER SECTION:
ftp.drupal.org. 45950 IN CNAME ftp.osuosl.org.
ftp.osuosl.org. 101 IN A 64.50.233.100
ftp.osuosl.org. 101 IN A 64.50.236.52

;; AUTHORITY SECTION:
osuosl.org. 3723 IN NS ns1.auth.osuosl.org.
osuosl.org. 3723 IN NS ns2.auth.osuosl.org.
osuosl.org. 3723 IN NS ns3.auth.osuosl.org.

;; ADDITIONAL SECTION:
ns1.auth.osuosl.org. 65266 IN A 140.211.166.140
ns2.auth.osuosl.org. 67782 IN A 140.211.166.141
ns3.auth.osuosl.org. 1352 IN A 216.165.191.53

Something tells me that someone accidently delegated the osuosl.org domain to GoDaddy DNS servers for a bit and it's now going to take 24 hours for it to clear out. (or actually just 13527 seconds for me)

I've checked all the .org NS and they all delegate it to the proper place, so I'm guessing it's just a matter of TTL expiry until this fixed itself.

Of course, THIS is a problem:

dig: couldn't get address for 'ns1.auth.osuosl.org': not found

Delegation has been fixed, but GLUE RECORDS ARE MISSING

elc’s picture

Status: Active » Closed (fixed)

They're turning up in dig +trace .. now it's just a matter of time until the crap NS records expire from the caching name servers everwhere. Shouldn't be more than 24 hours from when the delegation was fixed.

valius’s picture

Status: Needs work » Closed (fixed)

Hi! I noticed the same problem from a few days from Italy, downloading the modules from the site, using url like this: http://ftp.drupal.org/..... and using drush dl ....
But is strange that I have at home two computers, one PC and one MAC, both with the quickstart environment (using Drupal on Linux) and only the MAC has this kind of problem, with the Windows PC all works well...

valius’s picture

Just to say that starting from now all is working again...

nnewton’s picture

@ELC that was a lot of digging...

What happened actually was that the authority responsible for renewing osuosl.org didn't. The OSL has yelled at them sufficiently and all was restored quite quickly, but the DNS caches had to expire.

-N

nnewton’s picture

Issue summary: View changes

Updated issue summary.

Yuri’s picture

Still happening. Any news?

killes@www.drop.org’s picture

wfm, please post a traceroute

ayesh’s picture

Working at my end. (A broadband connection through Sri Lanka.)

ayesh’s picture

Issue summary: View changes

Updated issue summary.

Component: File server » Servers
henryhu’s picture

Title: ftp.drupal.org is down (and project download links do not work as a result) » Same issue
Issue summary: View changes

According to #5, I made a change on /usr/share/php/drush/commands/pm/package_handler/wget.inc. It works.

clemens.tolboom’s picture

Title: Same issue » ftp.drupal.org is down (and project download links do not work as a result)