It would be nice if the custom libraries added by users were then also defined in javascript_libraries_library() so they could be easily added or referenced by other modules like http://drupal.org/sandbox/davereid/1894824