Drupal.org

Distribution packaging error: Unable to download spyc...

Project:Drupal.org infrastructure
Component:Packaging
Category:support request
Priority:normal
Assigned:Unassigned
Status:active

Issue Summary

I made a new release of my distribution this morning (http://drupal.org/project/mica_distribution) but it keeps failing:

ERROR: >> Unable to download spyc from https://raw.github.com/mustangostang/spyc/master/Spyc.php.
ERROR:
Unable to download spyc from https://raw.github.com/mustangostang/spyc/master/Spyc.php.
ERROR:
Build for mica_distribution-7.x-7.0-no-core failed.

I created a RC4 with the same configuration on last friday and it went well. I did not change my make files.

I checked https://raw.github.com/mustangostang/spyc/master/Spyc.php url and it works... no 404!

Spyc library is whitelisted (http://drupal.org/node/1404404):

^https://raw\.github\.com/mustangostang/spyc/.+$
^http://code\.google\.com/p/spyc/downloads/.+$
^https://raw\.github\.com/mustangostang/spyc/master/Spyc\.php$

Any ideas of what happens?

Here is the full stack trace:

Packaging error messages

ERROR: /usr/bin/php /var/www/drupal.org/tools/drush5/drush.php --no-cache --include=/var/www/drupal.org/tools/drupalorg_drush make --drupal-org=contrib --drupal-org-build-root=/var/tmp/tag.16281/mica_distribution --drupal-org-log-errors-to-file --drupal-org-log-package-metadata=metadata-contrib.json drupal-org.make . failed with status 1
>> Project graphapi contains 4 modules: graphapi_relation, graphapi_devel, graphapi_demo, graphapi.
>> Project advanced_help contains 2 modules: help_example, advanced_help.
>> Project devel contains 3 modules: devel_generate, devel, devel_node_access.
>> Project xmlsitemap contains 9 modules: xmlsitemap_taxonomy, xmlsitemap_engines, xmlsitemap_node, xmlsitemap_modal, xmlsitemap_menu, xmlsitemap_i18n, xmlsitemap_custom, xmlsitemap_user, xmlsitemap.
>> Project views_bulk_operations contains 2 modules: views_bulk_operations, actions_permissions.
>> Project views contains 2 modules: views, views_ui.
>> Project variable contains 7 modules: variable_example, variable_store, variable_admin, variable_views, variable_realm, variable_advanced, variable.
>> Project services contains 5 modules: xmlrpc_server, xcal_format, rest_server, services_oauth, services.
>> DRUSH_BACKEND:{"type":"debug","message":"Library whitelist loaded from http:\/\/drupal.org\/packaging-whitelist\/json:\narray (\n  0 => '^http:\/\/arshaw\\\\.com\/fullcalendar\/downloads\/fullcalendar.+$',\n  1 => '^http:\/\/jqueryui\\\\.com\/download\/.+$',\n  2 => '^http:\/\/jquery-ui\\\\.googlecode\\\\.com\/files\/jquery\\\\.ui.+$',\n  3 => '^https:\/\/jquery-ui\\\\.googlecode\\\\.com\/files\/jquery\\\\.ui.+$',\n  4 => '^https:\/\/github\\\\.com\/jquery\/jquery-ui.*$',\n  5 => '^http:\/\/jquery-ui.googlecode.com\/files\/jquery-ui-.+$',\n  6 => '^http:\/\/download\\\\.cksource\\\\.com\/CKEditor\/CKEditor\/CKEditor.+$',\n  7 => '^http:\/\/simplepie\\\\.org\/downloads\/.+$',\n  8 => '^https:\/\/github\\\\.com\/simplepie\/simplepie.+$',\n  9 => '^https:\/\/github\\\\.com\/downloads\/tinymce\/tinymce\/tinymce.+$',\n  10 => '^http:\/\/cloud\\\\.github\\\\.com\/downloads\/tinymce\/tinymce\/tinymce.+$',\n  11 => '^https:\/\/github\\\\.com\/malsup\/cycle\/.+$',\n  12 => '^https:\/\/raw\\\\.github\\\\.com\/malsup\/cycle\/.+$',\n  13 => '^http:\/\/malsup\\\\.github\\\\.com\/jquery\\\\.cycle.+$',\n  14 => '^http:\/\/malsup\\\\.com\/jquery\/cycle\/release\/.+$',\n  15 => '^https:\/\/github\\\\.com\/douglascrockford\/JSON-js.+$',\n  16 => '^https:\/\/github\\\\.com\/downloads\/moxiecode\/plupload\/.+$',\n  17 => '^http:\/\/code\\\\.jquery\\\\.com\/mobile.+&',\n  18 => '^https:\/\/github\\\\.com\/jquery\/jquery-mobile\/.+&',\n  19 => '^http:\/\/jacklmoore\\\\.com\/colorbox\/.+$',\n  20 => '^https:\/\/github\\\\.com\/jackmoore\/colorbox\/.+$',\n  21 => '^https:\/\/github\\\\.com\/jackmoore\/colorbox\\\\.git',\n  22 => '^http:\/\/colorpowered\\\\.com\/colorbox\/.+$',\n  23 => '^http:\/\/www\\\\.pelagodesign\\\\.com\/emogrifier\/.+$',\n  24 => '^http:\/\/downloads\\\\.jasig\\\\.org\/cas-clients\/php\/.+$',\n  25 => '^https:\/\/github\\\\.com\/semsol\/arc2.+$',\n  26 => '^https:\/\/github\\\\.com\/downloads\/iamnoah\/writeCapture\/.+$',\n  27 => '^https:\/\/raw\\\\.github\\\\.com\/mustangostang\/spyc\/.+$',\n  28 => '^http:\/\/code\\\\.google\\\\.com\/p\/spyc\/downloads\/.+$',\n  29 => '^https:\/\/raw\\\\.github\\\\.com\/mustangostang\/spyc\/master\/Spyc\\\\.php$',\n  30 => '^http:\/\/swfobject\\\\.googlecode\\\\.com\/files\/swfobject.+$',\n  31 => '^http:\/\/wpaudioplayer\\\\.com\/wp-content\/downloads\/audio-player-standalone\\\\.zip$',\n  32 => '^http:\/\/cloud\\\\.github\\\\.com\/downloads\/gilbitron\/Nivo-Slider\/.+$',\n  33 => '^https:\/\/github\\\\.com\/downloads\/gilbitron\/Nivo-Slider\/.+$',\n  34 => '^https:\/\/github\\\\.com\/gilbitron\/Nivo-Slider.+$',\n  35 => '^https:\/\/github\\\\.com\/halstead\/glip.*$',\n  36 => '^https:\/\/github\\\\.com\/richthegeek\/phamlp.+$',\n  37 => '^https:\/\/github\\\\.com\/developerforce\/Force\\\\.com-Toolkit-for-PHP\/.+$',\n  38 => '^http:\/\/jaka\\\\.kubje\\\\.org\/projects\/dropbox-uploader\/files\/dropboxuploader.+$',\n  39 => '^https:\/\/github\\\\.com\/nrk\/predis.+$',\n  40 => '^http:\/\/fancybox\\\\.googlecode\\\\.com\/files\/.+$',\n  41 => '^http:\/\/lagoscript\\\\.org\/files\/jquery\/autopager\/.+$',\n  42 => '^http:\/\/downloads\\\\.sourceforge\\\\.net\/project\/getid3\/.+$',\n  43 => '^(git|https):\/\/github\\\\.com\/harvesthq\/chosen\/.+$',\n  44 => '^(git|https):\/\/github\\\\.com\/harvesthq\/chosen\\\\.git$',\n  45 => '^https:\/\/github\\\\.com\/nathansmith\/formalize.+$',\n  46 => '^http:\/\/timeago\\\\.yarp\\\\.com\/.+$',\n  47 => '^https:\/\/github\\\\.com\/ornicar\/php-github-api.+$',\n  48 => '^https:\/\/github\\\\.com\/twilio\/twilio-php.+$',\n  49 => '^https:\/\/github\\\\.com\/grayside\/reposcope.+%',\n  50 => 'http:\/\/openlayers\\\\.org\/download\/.+$',\n  51 => '^https:\/\/github\\\\.com\/mehrpadin\/Superfish-for-Drupal.+$',\n  52 => '^https:\/\/github\\\\.com\/woothemes\/FlexSlider.+$',\n  53 => '^https:\/\/github\\\\.com\/downloads\/woothemes\/FlexSlider\/.+$',\n  54 => '^http:\/\/labs\\\\.engageinteractive\\\\.co\\\\.uk\/itoggle\/engage\\\\.itoggle\\\\.zip$',\n  55 => '^https:\/\/github\\\\.com\/Web-Experience-Toolkit\/WET-jQuery-Drupal\/.+$',\n  56 => '^https:\
>> /\/github\\\\.com\/downloads\/Web-Experience-Toolkit\/WET-jQuery-Drupal\/.+$',\n  57 => '^https:\/\/github\\\\.com\/fabpot\/Twig\/tarball\/.+$',\n  58 => '^https:\/\/github\\\\.com\/scottjehl\/Respond\/tarball\/master',\n  59 => '^https:\/\/github\\\\.com\/scottjehl\/Respond\\\\.git',\n  60 => '^http:\/\/code\\\\.google\\\\.com\/p\/solr-php-client\/downloads\/.+$',\n  61 => '^https?:\/\/solr-php-client\\\\.googlecode\\\\.com\/files\/SolrPhpClient\\\\..+$',\n  62 => '^http:\/\/solr-php-client\\\\.googlecode\\\\.com\/files\/SolrPhpClient\\\\..+$',\n  63 => '^https:\/\/github\\\\.com\/markitup\/1\\\\.x\/tarball\/master',\n  64 => '^https:\/\/github\\\\.com\/markitup\/1\\\\.x\\\\.git',\n  65 => '^http:\/\/css3-mediaqueries-js\\\\.googlecode\\\\.com\/files\/css3-mediaqueries\\\\.js',\n  66 => '^https:\/\/github\\\\.com\/downloads\/phayes\/geoPHP\/.+$',\n  67 => '^http:\/\/gsgd\\\\.co\\\\.uk\/sandbox\/jquery\/easing\/.+$',\n  68 => '^http:\/\/selectivizr\\\\.com\/downloads\/.+$',\n  69 => '^http:\/\/htmlpurifier\\\\.org\/releases\/htmlpurifier-.+$',\n  70 => '^http:\/\/simile-widgets\\\\.googlecode\\\\.com\/files\/timeline_libraries_.+$',\n  71 => '^http:\/\/www\\\\.neele\\\\.name\/pdw_toggle_toolbars\/download\/pdw_toggle_toolbars_.+$',\n  72 => '^http:\/\/documentcloud\\\\.github\\\\.com\/backbone\/backbone.+$',\n  73 => '^https:\/\/github\\\\.com\/documentcloud\/backbone\/.+$',\n  74 => '^http:\/\/documentcloud\\\\.github\\\\.com\/underscore\/underscore.+$',\n  75 => '^https:\/\/github\\\\.com\/documentcloud\/underscore\/zipball\/master',\n  76 => '^http:\/\/www\\\\.jplayer\\\\.org\/latest\/jQuery\\\\.jPlayer.+$',\n  77 => '^http:\/\/dompdf\\\\.googlecode\\\\.com\/files\/dompdf.+$',\n  78 => '^http:\/\/dompdf\\\\.googlecode\\\\.com\/svn\/.+$',\n  79 => '^http:\/\/downloads\\\\.sourceforge\\\\.net\/project\/kcfinder\/.+$',\n  80 => '^http:\/\/phpids\\\\.org\/files\/phpids.+$',\n  81 => '^http:\/\/code\\\\.jquery\\\\.com\/jquery.+$',\n  82 => '^http:\/\/quail-lib\\\\.googlecode\\\\.com\/files\/quail-lib.+$',\n  83 => '^http:\/\/flesler-plugins\\\\.googlecode\\\\.com\/files\/jquery.scrollTo.+$',\n  84 => '^https:\/\/github\\\\.com\/xing\/wysihtml5.+$',\n  85 => '^https:\/\/github\\\\.com\/kswedberg\/jquery-expander\\\\.git',\n  86 => '^https:\/\/github\\\\.com\/kswedberg\/jquery-expander\/tarball\/master',\n  87 => '^http:\/\/www\\\\.professorcloud\\\\.com\/downloads\/cloud-zoom.+$',\n  88 => '^http:\/\/documentcloud\\\\.github\\\\.com\/visualsearch\/visualsearch.+$',\n  89 => '^https:\/\/github\\\\.com\/documentcloud\/visualsearch.+$',\n  90 => '^https:\/\/github\\\\.com\/btburnett3\/jquery\\\\.ui\\\\.spinner.+$',\n  91 => '^http:\/\/cdn\\\\.popcornjs\\\\.org\/code\/dist\/.+$',\n  92 => '^https:\/\/github\\\\.com\/wandoledzep\/bxslider\/.+$',\n  93 => '^https:\/\/github\\\\.com\/wandoledzep\/bxslider\\\\.git',\n  94 => '^https:\/\/github\\\\.com\/downloads\/geops\/ole\/.+$',\n  95 => '^https:\/\/github\\\\.com\/aFarkas\/html5shiv.+$',\n  96 => '^http:\/\/downloads\\\\.sourceforge\\\\.net\/project\/phpseclib\/.+$',\n  97 => '^https:\/\/raw\\\\.github\\\\.com\/fgnass\/spin\\\\.js\/.+$',\n  98 => '^https:\/\/github\\\\.com\/fgnass\/spin\\\\.js\\\\.git$',\n  99 => '^https:\/\/github\\\\.com\/fgnass\/spin\\\\.js\/tarball\/.+$',\n  100 => '^https:\/\/github\\\\.com\/downloads\/wycats\/handlebars\\\\.js\/.+$',\n  101 => '^https:\/\/github.com\/wycats\/handlebars\\\\.js\\\\.git$',\n  102 => '^https:\/\/raw\\\\.github\\\\.com\/wycats\/handlebars\\\\.js\/.+$',\n  103 => '^https:\/\/github\\\\.com\/PaulUithol\/Backbone-relational\\\\.git$',\n  104 => '^https:\/\/github\\\\.com\/PaulUithol\/Backbone-relational\/tarball\/.+$',\n  105 => '^https:\/\/raw\\\\.github\\\\.com\/PaulUithol\/Backbone-relational\/.+$',\n  106 => '^https:\/\/github\\\\.com\/symfony.+$',\n  107 => '^http:\/\/www\\\\.eyecon\\\\.ro\/colorpicker\/.+$',\n  108 => '^http:\/\/downloads\\\\.civicrm\\\\.org\/civicrm-.+-starterkit.tgz$',\n  109 => '^http:\/\/github\\\\.com\/downloads\/codecomputerlove\/PhotoSwipe\/.+$',\n  110 => '^https:\/\/github\\\\.com\/lukaszfiszer\/sel
>> ectnav\\\\.js.+$',\n  111 => '^https:\/\/github\\\\.com\/mattkersley\/Responsive-Menu.+$',\n  112 => '^https:\/\/ie7-js\\\\.googlecode\\\\.com\/files\/.+$',\n  113 => '^https:\/\/github\\\\.com\/downloads\/alohaeditor\/Aloha-Editor\/.+-cdn\\\\.zip$',\n  114 => '^http:\/\/archiva\\\\.gentics\\\\.com:8081\/archiva\/repository\/com\\\\.gentics\\\\.public\/org\/alohaeditor\/alohaeditor\/.+$',\n  115 => '^http:\/\/git\\\\.drupal\\\\.org\/project\/.+\\\\.git$',\n  116 => '^http:\/\/ftp\\\\.drupal\\\\.org\/files\/projects\/.+$',\n  117 => '^http:\/\/google-code-prettify\\\\.googlecode\\\\.com\/svn\/branches\/release-1-Jun-2011\/src\/.+\\\\.(js|css)$',\n  118 => '^https:\/\/github\\\\.com\/ducksboard\/gridster\/.+$',\n  119 => '^https:\/\/github\\\\.com\/ducksboard\/gridster\\\\.git$',\n  120 => '^http:\/\/jquery\\\\.bassistance\\\\.de\/tooltip\/jquery\\\\.tooltip\\\\.zip$',\n  121 => '^https:\/\/github\\\\.com\/niklasvh\/html2canvas\\\\.git$',\n  122 => '^https:\/\/github\\\\.com\/niklasvh\/html2canvas\/tarball\/.+$',\n  123 => '^http:\/\/viljamis\\\\.github\\\\.com\/TinyNav.js\/TinyNav.js.+$',\n  124 => '^https:\/\/github\\\\.com\/viljamis\/TinyNav.js\/.+$',\n  125 => '^https:\/\/github\\\\.com\/rmm5t\/jquery-timeago\\\\.git$',\n  126 => '^https:\/\/raw\\\\.github\\\\.com\/rmm5t\/jquery-timeago\/.+$',\n  127 => '^http:\/\/jsor\\\\.github\\\\.com\/jcarousel\/jcarousel.+$',\n  128 => '^https:\/\/github\\\\.com\/jsor\/jcarousel\/.+$',\n  129 => '^http:\/\/sorgalla\\\\.com\/projects\/download\\\\.php\\\\\\\\?jcarousel',\n  130 => '^http:\/\/sorgalla\\\\.com\/projects\/download-zip\\\\.php\\\\\\\\?jcarousel',\n  131 => '^https:\/\/github\\\\.com\/downloads\/geops\/geoserver-sec-drupal\/.+$',\n  132 => '^https:\/\/github\\\\.com\/geops\/geoserver-sec-drupal\/.+$',\n)","timestamp":1358803641.6856,"memory":8562488,"error":null,"packet":"log"}
>> Project search_api contains 3 modules: search_api_views, search_api_facetapi, search_api.
>> Project recaptcha contains 2 modules: recaptcha_mailhide, recaptcha.
>> Project password_policy contains 2 modules: password_policy_password_tab, password_policy.
>> Project panels contains 4 modules: panels_node, panels_ipe, panels_mini, panels.
>> Project multiselect contains 2 modules: multiselect_fapi_example, multiselect.
>> Project mica contains 22 modules: mica_community, mica_field_description, mica_networks, mica_studies, mica_node_reference_field, mica_opal_view, mica_opal, mica_datashield, mica_relation, node_reference_block, mica_bootstrap_config, mica_projects, mica_devel, mica_core, mica_data_access, mica_i18n, mica_connector, mica_dimensions_coverage, mica_query, mica_category_field, mica_datasets, mica.
>> Project logintoboggan contains 4 modules: logintoboggan_content_access_integration, logintoboggan_rules, logintoboggan_variable, logintoboggan.
>> Project job_scheduler contains 2 modules: job_scheduler_trigger, job_scheduler.
>> Project i18n contains 15 modules: i18n_taxonomy, i18n_contact, i18n_forum, i18n_redirect, i18n_node, i18n_translation, i18n_variable, i18n_sync, i18n_block, i18n_string, i18n_path, i18n_field, i18n_select, i18n_menu, i18n.
>> Project http_client contains 2 modules: http_client_oauth, http_client.
>> Project google_analytics contains a module named googleanalytics.
>> Project feeds_tamper contains 2 modules: feeds_tamper_ui, feeds_tamper.
>> Project feeds contains 4 modules: feeds_news, feeds_import, feeds_ui, feeds.
>> Project facetapi contains 2 modules: current_search, facetapi.
>> Project entity_translation contains 2 modules: entity_translation_upgrade, entity_translation.
>> Project entity contains 2 modules: entity, entity_token.
>> Project date contains 11 modules: date_tools, date_views, date_api, date_popup, date_repeat, date_context, date_migrate_example, date_migrate, date_repeat_field, date_all_day, date.
>> Project content_taxonomy contains 3 modules: content_taxonomy_autocomplete, content_taxonomy_migrate, content_taxonomy.
>> Project ctools contains 9 modules: ctools_ajax_sample, views_content, ctools_custom_content, bulk_export, page_manager, stylizer, ctools_access_ruleset, ctools_plugin_example, ctools.
>> Project content_access contains 2 modules: content_access_rules, content_access.
>> Project captcha contains 2 modules: image_captcha, captcha.
>> Project adaptivetheme contains 3 themes: adaptivetheme_admin, adaptivetheme, adaptivetheme_subtheme.
ERROR: >> Unable to download spyc from https://raw.github.com/mustangostang/spyc/master/Spyc.php.
ERROR:
Unable to download spyc from https://raw.github.com/mustangostang/spyc/master/Spyc.php.
ERROR:
Build for mica_distribution-7.x-7.0-no-core failed.

Comments

#1

Hello cthiebault,

Did you find a solution for this?. I am having a similar issue while trying to create a drush make file for another distribution (http://drupal.org/project/patterns_profile): http://drupal.org/node/1945780

Thank you very much,

David

#2

I just ran drush make locally after altering your drupal-org.make to include a version of Drupal core and drush downloaded spyc.php without issue. This may only be an issue with on Drupal.org and the SSL cert used for https://

See http://drupal.org/node/1432190

ERROR: unable to download https://...

It is possible a .make that includes a whitelisted URL that works using drush make on another server will fail to download when packaged on Drupal.org. This can be caused by issues with the SSL certificate on the server hosting the whitelisted URL. If that happens and using the non-secure URL is an option, request the whitelist be changed and/or the non-secure version of the URL be added. The error in the packaging is the same error you would see if the file had been moved and the URL returned a 404.

Have you tried adding http://raw.github.com/mustangostang/spyc/master/Spyc.php to your drupal-org.make?

Also, you might want to add this experience to #1856762: Revisit and Redefine Drupal's Policy on hosting 3rd party code and/or code that is not strictly GPL. Before #1325572: Integrate services with the libraries module to improve handling of third party libraries., that library was included with the Services module. I've been pushing to drop the official ban on third party code (that been unofficially ignored) for years, but that will never happen if more people don't share how much more difficult this makes their development. The specific version of Spyc.php included should be handled by the Services module maintainers.

#3

Hi cthiebault,

I have just been doing some changes in my drupal-org.make file and https seems to be working now:

libraries[spyc][download][type] = "get"
libraries[spyc][download][url] = "https://raw.github.com/mustangostang/spyc/master/Spyc.php"
libraries[spyc][directory_name] = "spyc"
libraries[spyc][type] = "library"

If there were any issues with the certificates, they might have already been solved. You might also find useful this discussion: https://drupal.org/node/1949904

nobody click here