Hey guys. Great module, I'm in love with fileframework and its use of this backend.

My file repository is starting to get large (about to get much larger!) and I'm hoping to migrate it to S3. I know bitcache is supposed to support S3 as a backend, but haven't been able to find any example configurations or documentation to work off of. Since my file repository will eventually grow to larger than my server, I don't want to just use bitsync to sync against S3, I want to actually be serving off it.

The only way that I can guess to do this would be to set up a repository against a S3 stream wrapper, but this doesn't seem like it would use bitcache's (the ruby module, not the drupal project) ability to use S3 as a backend.

I'm willing to pitch in development time to work on this, but I don't know where this fits into the current strategy of the module.

Thanks!

Comments

Arto’s picture

Arto commented
Assigned: Unassigned » Arto
true-pal’s picture

true-pal commented

+1 (Supporting Amazon S3 without Drupal DB load i.e. direct upload to S3 server)

Arto’s picture

Arto commented
Title: Is Amazon S3 supported as a backend? » Amazon S3 storage adapter
Version: 6.x-1.0-alpha2 » 6.x-1.x-dev
Component: Documentation » Storage adapters
Category: support » feature
Status: Active » Postponed
Issue tags: +Amazon S3, +scalability

Good news for you guys: this is coming soon, probably as of 6.x-1.0-beta3 (that is, after the imminent 6.x-1.0-beta2).

While you could already, as jackmaninov stated, use Bitcache with the PEAR Services_Amazon_S3 package that provides an s3:// stream wrapper for PHP, that has had some issues; notably the performance isn't great, as the S3 paradigm doesn't map cleanly onto the Unix file system concepts that PHP's stream wrapper API expects.

The upcoming S3 support in Bitcache will be more specific, more performant, and suitable for seriously large repositories (currently being tested with repositories containing about a million objects, and we'll keep pushing that higher).

If you look in the current CVS development version (soon to be 6.x-1.0-beta2), there is already support added for several new storage adapters (that is, repository backends), including MySQL, PDO and GDBM. The S3 backend will work in a similar vein.

asak’s picture

asak commented

Subscribing... sounds great!

rhangelxs’s picture

rhangelxs commented

Subscribing

XerraX’s picture

XerraX commented

Subscribing

JerryH’s picture

JerryH commented

Subscribing

Th30philus’s picture

Th30philus commented

It's been 7 months since Arto said this would be coming "soon".

Just wanted to check to see if there was an update on the status of the Amazon S3 adapter. Is there an ETA?

sean69’s picture

sean69 commented

subscribing

jtbayly’s picture

jtbayly commented

subscribing

psampaz’s picture

psampaz commented

subscribing

ayalon’s picture

ayalon commented

will never come true...

mokko’s picture

mokko commented

Now they say they are working on it again: http://drupal.org/node/405738

YAY!

mkalbere’s picture

mkalbere commented

Waht is the current status for amazon s3 ? Is there already some testing code ?
++
Marc