Nothing about this in the documentation or issue queue that I could find... so I'm wondering: can users monitor upload progress of files that are uploaded to S3 using this module?

Comments

justafish’s picture

Not sure, I don't see why it wouldn't work though. Try it and let me know!

jordanmagnuson’s picture

Ugh, sorry for the late reply... some other projects have come up, and I got derailed from this. Anyway, yes, I will test this at some point and report back. In the meantime, if anyone else knows the answer...

magnusk’s picture

Status: Active » Closed (works as designed)

Works fine for me.

If you don't see the progress bar it may be that you need to apply a patch to make it work (separately from the amazons3 module), see #935208: PECL uploadprogress bar doesn't appear.

jordanmagnuson’s picture

Title: Does pecl upload progress work with this module? » Pecl upload progress not working usefully
Version: 7.x-1.x-dev » 7.x-1.0-beta7
Category: support » bug
Status: Closed (works as designed) » Active

I know it's been a long time... I've been been on and off other project, but am now back working with a large media site that wants to store files on S3.

I've got this module up and running, and everything seems to "work," but there's one major issue: the PECL upload progress bar does not seem to be working usefully when uploading to S3 destinations. The bar is there, mind you, but when uploading large files it jumps from 0% to 66% soon after starting the upload, and then stays at 66% for the duration of the upload, until abruptly jumping to 100% at the end. Needless to say this gives the impression that the upload is stuck and not working.

This seems like a significant concern, since it makes this module nearly useless for any media-driven site that needs to allow users to upload content and get useful feedback on upload progress...

So... is there any way to get upload progress for files being uploaded to S3? I'm certainly not an expert on any of this, but it seems like it should be possible given this description of streaming uploads to S3:

The nice thing about streams is that they have a callback called whenever the next chunk is read for to further PUT (in the https sense) data to S3. You can use this callback to compute and display the progress on the client UI.

Any help on this is very much appreciated! And thanks for the great module!

magnusk’s picture

This module first uploads to your server, then copies the file over to S3. It doesn't use direct upload to S3.

Have you tried uploading a file without enabling this module? is the progress bar working differently? how large is the test file?

jordanmagnuson’s picture

Title: Pecl upload progress not working usefully » Pecl upload progress bar not really working with S3 uploads
Component: Documentation » Code

This module first uploads to your server, then copies the file over to S3.

Really? I was under the impression that this module uploads directly to S3... (see http://drupal.org/node/1319798). I certainly never see the file on my server.

Anyway, the pecl progress bar works fine for uploads to my public files directory (jumps around a little, but will usually advance every couple of seconds or so).

To S3 I continue to get bad results:

  • Smallish files (~6MB): the progress sit at 0% until jumping abruptly to 100% on completion (which takes a copule of minutes on my slow connection).
  • Larger files (~30 MB): the progress jumps to some arbitrary number immediately (23% or 66%), then stays there until jumping abruptly to 100% on completion (which takes several minutes on my slow connection).

Meanwhile Chrome's status message simply reads "Waiting for [my server name]," and gives the spinning cursor. Seeing this for several minutes, with no apparent progress on the upload, obviously gives the impression that the upload has broken.

This is with a fresh install of latest D7, and no other modules installed.

magnusk’s picture

The comments at #1319798 are incorrect.

The upload widget stores the file in the server's temp directory, same as if you're uploading to your regular Drupal public directory, then copies the file to S3, and deletes it from temp.

Truly direct upload to S3 would require a new file upload widget that POSTs to Amazon S3.

jordanmagnuson’s picture

Any further word on the progress bar issue? Are others seeing the same behavior? Any way to get this to work?

justafish’s picture

Status: Active » Closed (cannot reproduce)

No one else has reported this, so I'm going to mark as closed. You could try https://drupal.org/project/amazons3_cors