Error saving to filefield in cron

Hi-

Can you provide me with your configurations (use the export function) so I can check out what is going on?

Hello,

I'm having a similar issue. I have a filefield that's harvested for several configurations. Each configuration harvests the filefield, then processes the data via mm_custom_command, then stores the file via S3, then takes the URL from S3 and stores that into a textfield. Each configuration has its own textfield.

When I run each configuration manually, there are no issues: everything works as expected (all textfields are set correctly). When I use cron, however, only the last configuration's textfield is set.

My configurations take some time to complete, so I've been able to watch what happens to an affected node. When the first configuration completes, it populates the first textfield correctly. When the second configuration completes, the changes to the first textfield are removed and the second textfield gets set correctly. With each subsequent configuration, the previous textfield is unset while the current textfield is set correctly.

Is it possible that the configurations are rewriting the node based on the way the node looked at the start of the cron job? So, since configuration 1 changed the node, configuration 2 has no idea about the changes and works with the unaltered node, thus removing all the changes configuration 1 did?

I can confirm that the only portion that breaks is the storing into the CCK field at the end: harvesting works, processing works, and storing it to S3 works (the files are still on my S3 bucket), but the CCK field just gets unset.

I also have the exported configuration here. All configurations I'm using are identical, with changes to the custom command, output file name (I'm changing the extension), and the CCK field at the end (They're all file_image_asset_*, and they're all CCK textfields). Is there any other information I could supply to facilitate resolving this? Right now, it's a show stopper for me.

 $configuration = new stdClass;
$configuration->required = array('mm_cck', 'mm_custom_command', 'mm_s3', 'mm_cck');
$configuration->name = 'Create JPEG';
$configuration->cid = '5';
$configuration->description = 'My configuration description';
$configuration->start_time = '0';
$configuration->last_start_time = '0';
$configuration->status = 'stopped';
$configuration->settings->mma_file_perm = '0';
$configuration->settings->mma_file_mask = '0644';
$configuration->settings->mma_node_edit_item_show = '0';
$configuration->settings->mma_node_item_delete = '1';
$configuration->settings->mma_node_config_rss = '0';
$configuration->settings->mma_cron_notify = '0';
$configuration->settings->mma_cron_notify_email = '';
$configuration->settings->mma_cron_notify_time = '10';
$configuration->settings->mma_process_num = '0';
$configuration->settings->mma_storage_num = '0';
$configuration->settings->mma_complete_num = '0';
$configuration->harvest->module = 'mm_cck';
$configuration->harvest->action = '1';
$configuration->harvest->configuration =  array(
  'mm_config_harvest_field' =>  array(
    'field_asset_file' => 'field_asset_file'
  ),
  'file_types' => 'eps jpg jpeg png tif tiff gif',
  'cid' => '5',
  'module' => 'mm_cck',
  'action' => '1',
  'verb' => 'harvest'
);
$configuration->harvest->cid = '5';
$configuration->process->module = 'mm_custom_command';
$configuration->process->action = '1';
$configuration->process->configuration =  array(
  'output_file' => '/tmp/asset-[nid]-[date]-hi.jpg',
  'command' => '/command [harvest_file] [output_file]',
  'cid' => '5',
  'module' => 'mm_custom_command',
  'action' => '1',
  'verb' => 'process'
);
$configuration->process->cid = '5';
$configuration->storage->module = 'mm_s3';
$configuration->storage->action = '1';
$configuration->storage->configuration =  array(
  'mm_s3_bucket' => 'foobar',
  'mm_s3_perm' => 'public-read',
  'mm_s3_delete_source' => '0',
  'cid' => '5',
  'module' => 'mm_s3',
  'action' => '1',
  'verb' => 'storage'
);
$configuration->storage->cid = '5';
$configuration->complete->module = 'mm_cck';
$configuration->complete->action = '3';
$configuration->complete->configuration =  array(
  'mm_cck_field_save_3' => 'field_asset_image_jpeg',
  'field_save_list' => '0',
  'cid' => '5',
  'module' => 'mm_cck',
  'action' => '3',
  'verb' => 'complete'
);
$configuration->complete->cid = '5';
$configuration->hierarchy->parent = '0'; 

I'm having the same issue. When I try to run 2 configurations at once (convert to flv and convert to thumbnail), the flv file fails to attach to the cck field. This is the first of the two configurations. When I disable the thumbnail configuration, the flv one runs ok.

im having similar issue, reported all ready month ago at #486206: Files transcoded but not added to filefiled

I too am having the exact same problem... I was pulling my hair out trying to figure out what was going on... Once I did a came here and found this. I can't really add anything that hasn't already been said, but I've tried both the stable and development release and both produce the exact same results... Just as Mark said, each time a config is ran, it replaces the node with just ITS information... In other words, I could have 50 different configurations all doing something different... Even though each one fires off in order during a cron run (or autorun for that matter), it's like they ALL take a "snapshot" of the node at the beginning... Each time one completes it overwrites the node with the "snapshot" and it's information, overwriting the previous info...

I suppose it also bears mentioning that this seems to have to do with the CCK portion. I'm harvesting from a CCK field and storing back into a different CCK field. One config is generating thumbnail and storing into a thumbnail filefield while the other config is generating a flash preview video and storing back to a preview filefield.

I think I might have a solution.

I have modified the function content_write_record in the CCK module (content.module) as follows (line 1198):

 foreach ($fields as $id => $field) {
      if ($query && $placeholders[$id]!='NULL') {
              $query .= ', ';
      }
      if ($placeholders[$id]!='NULL') $query .= $field .' = '. $placeholders[$id];
    }

The issue is with UPDATE queries for CCK content types. When the content_write_record function is invoked and some values are not provided, the function updates the record with the default values (i.e. NULL). Since we want the update to preserve existing values, we should skip those fields in the update statement.

This has solved the problem on my test site, but I haven't tested it thoroughly.

Maybe there are some situations when the UPDATE statement should update fields to their default values instead of just keeping existing values? Let me know.

The patch is available here: http://drupal.org/node/486206#comment-1937390

Cheers,
Jakub Gawlikowski

patch from here: http://drupal.org/node/486206#comment-1937390

temporary solves the problem

I have made a better patch that doesn't modify CCK and only makes changes to the media_mover_api.module

http://drupal.org/node/486206#comment-1942328

Cheers,
Jakub

I'm closing this to direct people over to this thread here: http://drupal.org/node/368956

I hope this will keep everybody on the same page!