[daemon] Support for CloudFiles CDN?

Hm, weird, it appears for me. Maybe a cache issue? Or it's a d.o permission issue. Don't know. Let me know if it persists and I'll file an issue in the d.o issue queue.

And wow, are we moving fast or what? It seems somebody wrote a Django storage class for Mosso Cloud Files exactly one day ago! Amazing! So I've already posted back (http://code.welldev.org/django-storages/issue/8/mosso-cloud-files-storage) in the django-storages issue queue, reporting the existence and asking what the typical Django (or Python) policy is in these things.

If it works, it's about 15 minutes of work :)

Basically:
1) add cumulus.storage.CloudFileStorage to the daemon: dependencies.storages.MossoCloudFileStorage.MossoCloudFileStorage
2) write a thin transporter wrapper around it, like transporters.transporter_ftp.TransporterFTP, but then transporters.transporter_cloudfiles.TransporterCloudFiles

That's it. Note that this *only* requires changes in the daemon, not in the Drupal CDN integration module! But there's no issue queue for that yet, so until that exists, we'll abuse the d.o issue queue

Care to roll a patch? :) You'd be the first contributor (of hopefully many more)!

So … only 10 days further … and it's been committed to django-storages! See https://bitbucket.org/david/django-storages/issue/8/mosso-cloud-files-st.... Rock on, open source!

I'll probably have enough time to incorporate this into the daemon as well.

I haven't had the time and I have to finalize my bachelor thesis text today. I will add this after my thesis defense though! :)

Hate to just bump an issue, but I'm excited to see CloudFiles support in the daemon so I can give it a go. Please let me know if there is any support I can lend.

Will be done ASAP :)

Bump. I'd love to use this module with Mosso's cloud files. Any progress update?

Great work!

I'll be looking for this cloudfiles implementation.
Thanks!!!

I added the support to publish to Mosso Cloudfiles, I'm talking to Wim to hand him the changes so he can update the daemon.

Nestor

Hi Nestor

Is the support to publish to Mosso something that can be applied as a patch? Or is it better to wait for an official update to the daemon?

best wishes
scotjam

I'm waiting for Nestor's patch :)

Hi,

I created a patch over the changes I made.
Also the patch includes the cloudfiles library for python, I'm not sure if Win will want to add it or just keep instructions of how to download it.
Let me clarify that I'm not a python developer, so if you find something that can be improve it go for it. I based on some other files and what I was able to find out on the way.

modified transporters/transporter.py
added dependencies/storages/mosso.py
added transporters/transporter_mosso.py
added cloudfiles/*

To configure the destination use something like this in the configuration file:

  <servers>
    <server name="blog push cloudfiles" transporter="mosso" >
      <username>mymossoaccount</username>
      <api_key>mymossoapikey</api_key>
      <container>test_container</container>
    </server>
  </servers>

BTW, awsome work Win Leers, thanks a lot.

~Nestor

I've moved the File Conveyor daemon to its own project at github: http://github.com/wimleers/fileconveyor. Please create a new issue there: http://github.com/wimleers/fileconveyor/issues.

Won't fixing it here.

Nestor, THANK YOU so much! :)

I committed this already anyway, to prevent this from getting lost: http://github.com/wimleers/fileconveyor/commit/d7faa774d97f1269ba374346e....

Thanks again :)

OOPS, I was looking at the wrong issue! It's #567890: Config.xml example for S3 and Cloudfront transports that got fixed: http://drupal.org/node/567890#comment-2162166.

Looking at this patch right now though :)

Committed!

See the following commits: http://github.com/wimleers/fileconveyor/commit/1f85935389bd0e15a179fdfdb... and http://github.com/wimleers/fileconveyor/commit/fb5ba9d95a04b63c973ae4779.... First time using git and that's why there 2 commits: I made an error in the first commit.

Most of the changes you suggested, went in intact. I replaced some tabs by spaces and moved the "cloudfiles" directory into the "dependencies" directory. I also added the necessary information to README.txt about this new Transporter, as well as the corresponding license information. That's it!

Thanks again :)