Image creation fails after files uploaded, reverts to file upload widget.

Is there anything pertinent in either the web server error logs, or the Drupal logs? Have you tried uploading a single file via the FileField Sources Plupload widget as suggested by Atle? Please check the destination folder to see if the files are actually being placed there, but just not being linked to the node.

@_paul_meta: Please check your drupal and php logs for any clues, and try uploading a single file less than 5mb. If this fails, try one less than 1mb. I'm also curious if you can check your php post_max_size settings.

I did try to set up a new site to try to reproduce this. After a few tries without beeing able to break anything I did manage to get an error buy using very small values in php.ini. If I set php upload_max_filesize OR post_max_size settings to less than 1mb I got errors. They did however casue log entries in both phps error_log and drupals logs, so I am curious what you could find there.

The casue of the errors I was able to produce is that I have hardcoded a chunk size of 1mb. Since phps defaults starts at 2M for upload_max_filesize and 8M for post_max_size I dit not anticipate this to cause any issues.. but I might have to more intelligently determine a minimum here if this is what is causing your issue. Also make sure your php memory_limit is larger than post_max_size.

Atle

@_paul_meta: Another thought.. check that your temporary directory is set up corretly and is writeable at admin/config/media/file-system

Paul,

FYI: I'm using this module with mod_php (DSO) without issue. Your permissions are correct.

Do you have either of the Core logging modules installed, Database logging or Syslog? Depending on your PHP log levels, these may show information that you won't see in your Apache error log, such as notifications and warnings.

If you have the Syslog module installed and have SSH access, can you do something like this: tail -f /var/log/syslog | grep drupal Then, try to upload files and see what you get.

If you have the Database logging module installed, then you can just look there.

If your files still have the .tmp extension, it seems that either the file_stream_wrapper_uri_normalize() or file_unmanage_move() functions are not working. Please try removing "Allowed file extensions" from your field.

If you are able to help narrow this down, please alter line filefield_sources_plupload.module starting around line 140 by adding watchdog lines as follows:

    if ($uploaded_file['status'] == 'done') {
      $source = $uploaded_file['tmppath'];
      $extensions = $upload_validators['file_validate_extensions'][0];
      // Transliterate, munge and validate file name.
      $filename = filefield_sources_clean_filename($uploaded_file['name'], $extensions);
      // Move the file to a temporary destination using final base file name.
      $temp_destination = file_stream_wrapper_uri_normalize('temporary://' . $filename);
      watchdog('file', 'PluploadTest - File upload source: %source', array('%source' => $source));
      watchdog('file', 'PluploadTest File uri after normalization: %tempdest', array('%tempdest' => $temp_destination));
      $temp_filepath = file_unmanaged_move($source, $temp_destination, FILE_EXISTS_REPLACE);
      watchdog('file', 'PluploadTest- File uri after unmanaged_move %fp', array('%fp' => $temp_filepath));
      // Save the files to their final destination.
      if ($file = filefield_sources_save_file($temp_filepath, $upload_validators, $upload_location)) {
        $saved_files[] = $file;
      }
    }

This will put messages in your logging facility as follows:

# grep PluploadTest /var/log/syslog  | cut -d '|' -f 9
PluploadTest - File upload source: temporary://p16r3t0hke1g5s184r8j814a61ra6c.tmp
PluploadTest File uri after normalization: temporary://mastiff_2.jpg
PluploadTest- File uri after unmanaged_move temporary://mastiff_2.jpg

Please post those results back.

Thanks,
Jim

Paul,

The only way the message wouldn't be added to the logs is if that particular block of code was never reached. So, I would continue putting watchdog() calls throughout the filefield_sources_plupload_element_value() function until you narrow down were the script stops processing.

Something like this:

function filefield_sources_plupload_element_value($element, $input = FALSE, &$form_state = NULL) {

  watchdog('file', 'PluploadTest - Entered function filefield_sources_plupload_element_value', array());
  if (isset($input) && $input === FALSE) {
    return array();
  }
  watchdog('file', 'PluploadTest - Input isset', array());

  // We rely on Plupload Integration module to handle the actual field values.
  $pud_value = plupload_element_value($element, $input, $form_state);

  if (empty($pud_value)) {
    return array();
  }
  watchdog('file', 'PluploadTest - PUD field value exists', array());

  $field_parents = array_slice($element['#array_parents'], 0, -3);
  $field_element = drupal_array_get_nested_value($form_state['complete form'], $field_parents);
  $field_name = $field_element['#field_name'];
  $langcode = $field_element['#language'];

  $upload_delta = isset($field_element['#file_upload_delta']) ? $field_element['#file_upload_delta'] : 0;
  $upload_location = isset($field_element[$upload_delta]['#upload_location']) ? $field_element[$upload_delta]['#upload_location'] : file_default_scheme() . '://';
  $upload_validators = isset($field_element[$upload_delta]['#upload_validators']) ? $field_element[$upload_delta]['#upload_validators'] : array();

  // A URI may already have a trailing slash or look like "public://".
  if (drupal_substr($upload_location, -1) != '/') {
    $upload_location .= '/';
  }
  if (!file_prepare_directory($upload_location, FILE_CREATE_DIRECTORY)) {
    watchdog('file', 'The upload directory %directory for the file field !name could not be created or is not accessible. A newly uploaded file could not be saved in this directory as a consequence, and the upload was canceled.', array('%directory' => $upload_location, '!name' => $field_name));
    form_set_error($field_name, t('The file could not be uploaded.'));
    return FALSE;
  }

  // Validate, clean up and move the files into it's destination, then register
  // as managed files (status = 0 until entity is saved).
  $saved_files = array();
  watchdog('file', 'PluploadTest - Number of files to process !num_files', array('!num_files' => count($pud_value)));
  $file_index=0;
  foreach ($pud_value as $uploaded_file) {
    watchdog('file', 'PluploadTest - Starting move of file # !file_index', array('!file_index' => $file_index));
    if ($uploaded_file['status'] == 'done') {
      $source = $uploaded_file['tmppath'];
      $extensions = $upload_validators['file_validate_extensions'][0];
      // Transliterate, munge and validate file name.
      $filename = filefield_sources_clean_filename($uploaded_file['name'], $extensions);
      // Move the file to a temporary destination using final base file name.
      $temp_destination = file_stream_wrapper_uri_normalize('temporary://' . $filename);
      watchdog('file', 'PluploadTest - File upload source: %source', array('%source' => $source));
      watchdog('file', 'PluploadTest File uri after normalization: %tempdest', array('%tempdest' => $temp_destination));
      $temp_filepath = file_unmanaged_move($source, $temp_destination, FILE_EXISTS_REPLACE);
      watchdog('file', 'PluploadTest- File uri after unmanaged_move %fp', array('%fp' => $temp_filepath));
      // Save the files to their final destination.
      if ($file = filefield_sources_save_file($temp_filepath, $upload_validators, $upload_location)) {
        $saved_files[] = $file;
      }
    }
    else {
      watchdog('file', 'PluploadTest - Uploading failed. File status not done', array());
      form_set_error('pud', t('Upload of %name failed.', array('%name' => $uploaded_file['name'])));
    }
    $fileindex++;
  }

  // Get exisitng file values.
  // File Field items are stored in the field state starting from Drupal 7.9.
  $field_state = field_form_get_state($field_element['#field_parents'], $field_name, $langcode, $form_state);
  if (isset($field_state['items'])) {
    $field_values = $field_state['items'];
  }
  else {
    $field_values = drupal_array_get_nested_value($form_state['values'], $field_parents);
  }

  // Update field values with new files.
  foreach ($saved_files as $saved_file) {
    $field_values[$upload_delta] = (array) $saved_file;
    $field_values[$upload_delta]['_weight'] = $upload_delta;
    $upload_delta++;
  }

  // Update form_state values.
  drupal_array_set_nested_value($form_state['values'], $field_parents, $field_values);

  // Update items.
  $field_state['items'] = $field_values;
  field_form_set_state($field_element['#field_parents'], $field_name, $langcode, $form_state, $field_state);

  return $pud_value;
}

Should result in the following logs:

PluploadTest - Entered function filefield_sources_plupload_element_value
PluploadTest - Input isset
PluploadTest - PUD field value exists
PluploadTest - Number of files to process 1
PluploadTest - Starting move of file # 0
PluploadTest - File upload source: temporary://p16r8mes6k99j144s1po81l9nglm.tmp
PluploadTest File uri after normalization: temporary://img_5a76-3a03.jpg
PluploadTest- File uri after unmanaged_move temporary://img_5a76-3a03.jpg

If you don't see that, then maybe the callback isn't working? I'm *really* surprised that nothing showed up in your error logs. You aren't nearing your disk usage or disk quota are you? I'm not sure of the server setup, but it is common to put /tmp on its own small partition. Due to improper cleanup of temporary files, this partition could get full.

I have attached the module file with the changes listed above if it makes it easier for you.

Thanks,
Jim

Paul,
It looks like this may be related to the plupload module itself. Which version of the plupload module do you have installed, and which version of the plupload library do you have installed?
Jim

I'm have a hard time trying to reproduce this.. Like jbova suggest, your added logging points to plupload_element_value (from plupload instegration module) not returning any values.

I find it strange that you are not getting anything in the dblog nor in php's error logs. Can you check admin/config/development/logging and make sure it is set to "All messages"?

Paul: Could you test the Plupload Integration module by visiting yourdomain.com/plupload-test and try to upload a file? Then check for errors, and if you get none - check if the file has been downloaded to sites/all/default/files.

Hi Paul

That's weird. :)

It's interesting that you can recreate the problem without using this module. FileField Sources Plupload removes the "start upload" options, triggering this on form/ajax-submit.

Since you can upload using the submit button - running the upload and moving from tmp in one operation, but not if you first push them to temp and then copy them on form submit, I am wondering if this could be caused by different web server processes trying to access the temp files? The standard /tmp location would not allow that, but you have a separate tmp inside the files directory from what I can tell.... hum..

Since imagecache_profiles is giving warning, did you try disabling this module?

We encountered a similar problem and it appeared the problem was the limitations on post variable names set by PHP's Suhosin patch. We increased the value of some PHP settings and that fixed the problem:

suhosin.post.max_name_lengtgh: 128
suhosin.request.max_varname_length 128

I had a similar problem on my website, when I moved this module on production server. On my localhost all worked fine... I started digging around and found source of the problem.

For me that happend because of ajax_comment module.

# ajax_comment.module, line 12

function ajax_comments_init() {
   if (isset($_POST['ajax_html_ids']) && count($_POST['ajax_html_ids']) == 1) {
     $_POST['ajax_html_ids'] = explode(',', $_POST['ajax_html_ids'][0]);
   }
}

Without init function, ajax comment module works anyway... so I just get rid of that.
Maybe you've got same problem

Had the exact same problem, the plupload by itself was working but not the filefield integration: no files after upload was complete. The suggestion in #19 cleared it up, thank you dep85.

I am experiencing the same problem. I don't have ajax comments module installed.

I can find no log entries that anything has failed.

This is on a clean install of Drupal.

I have this problem too. I'm uninstall ajax comments module. And all works good.

The ajax comments module is not the issue. But since it is manipulating post variables, is can cause a length issue as described in #18. Increasing name length fixes this. Thanks Cyberwolf. :)

any developments for a fix? i'll test whatever i can ;)

Did any one found solution for this? We are having the same issue, please keep us posted if there is any solution.

Thanks in Advance..!!

I added this to my module:

function MYMODULE_hook_init() {
  if (isset($_POST['ajax_html_ids']) && isset($_POST['form_id'])) {
    $_POST['ajax_html_ids'] =  array(implode(',', $_POST['ajax_html_ids']));
  }
}

Also posted issue to ajax comments: #1866668: Fine-tuning of $_POST modification condition;

none of the above was fixing the issue for me. I used multiupload_imagefield_widget instead

Hey, i have found the issue. Why it's happening. There is nothing wrong with directories, permissions. All is due to the javascrit we're replacing in the file filefield_sources_plupload.module
we we comment the following line
$element['#attached']['js'] = array($module_path . '/js/plupload.js');
you ll see another option of start upload which works fine and uploads files successfully. But Next to this i tried to sovle this '/js/plupload.js'
but didn't get the solution. Please now what to do next kindly guide me. It's become the painful headache and getting worst.

Updating core to 7.23 seems to cause issues with the var $_POST['ajax_html_ids'] - it's now an array, with the [0] element containing the same comma-delimited list.
My plupload seemed to have the same trouble as #26 above, but I think it was for this array reason rather than something else. I added the following code to a custom module to override it's structure. I'm not sure if this is a good fix, but I'm not sure how to otherwise path. But it seems to be working fine now.

function MYMODULE_init() {
  if (isset($_POST['ajax_html_ids']) && is_array($_POST['ajax_html_ids']) && isset($_POST['form_id']) && $_POST['form_id'] == 'MYCONTENTTYPE_node_form') { // album plupload
    $_POST['ajax_html_ids'] =  array(implode(',', $_POST['ajax_html_ids'][0]));
  }
}

Solution from #29 works (thanks for debugging, jefftrnr!), though it seems to be not the best solution. Any idea how to fix FileField Sources Plupload module to take into account this new structure of $_POST['ajax_html_ids']?

I have added the recommended Suhosin settings to README.txt in Dev.

This should solve these issues:

In php.ini add:
suhosin.request.max_varname_length = 128
suhosin.post.max_name_length = 128