Zencoder notification handler? How to update Drupal nodes after successful transcode.

Hmm, this is a post back receives from the Zencoder, this is the main power of Drupal videos. Cause it will post back all the data to us once it completed.

Postback is already done and post back will send us some data to the /postback/jobs URL. We do not need to have directory or do not do any hardcore on it. It is just an URL call back. Revert the all changes u made to the .htaccess since it should not hack, again there should not be any directory.

I have the same problem. I have the video module installed and "working" using Zencoder and S3, but the problem is even after my videos are done being transcoded and uploaded to S3, Drupal does not update and publish the actual node. Zencoder gives following notification data:

Notification Sent:
{"job":{"state":"finished","id":1584892},"output":{"state":"finished","label":"VIDEO_hq_flash_20","id":2001290,"url":"http://mybucket.s3.amazonaws.com/sites/default/files/videos/converted/my..."}}

Response Received:
HTTP/1.1 400 Bad Request

400 Bad Request

Your browser sent a request that this server could not understand.

Additionally, a 404 Not Found
error was encountered while trying to use an ErrorDocument to handle the request.

What should I do? I´m grateful for any help.

As far as I can see I cannot access http://www.goodrules.net/drupal4/postback/jobs URL, where u have installed the site? inside the drupal4 sub-folder?.
When u go to post back URL you should see "its working" message on a white page.

Yes, the site is installed inside the drupal4 folder. The Video module is installed in
/public_html/drupal4/sites/all/modules/video. (But I can´t see any /postback/jobs folder under http://www.goodrules.net/drupal4. However, I understood there should not be any either)

How can I provide access to http://www.goodrules.net/drupal4/postback/jobs?

@Modern Smith, check u have any menu overridden default permission set

I too am getting nothing back in my node (all of the transcodes and file migrations are happening fine between Zencoder and AmazonS3).

When I access the "https://www.mysite/media/postback/jobs" URL I get:

working something else

Any ideas?

Thank you!

Best,

- Josh

@jhrizz, to get Zencoder pistback u should have public IP, your site should be able to access from public using IP or domain name.

Please check the Zencoder jobs on Zencoder site, and check for Notifications.

working something else

It is a Debug message and if your getting that message, you have correctly configured the post back URL.

Thanks, I got it working. I had saved content access rights for anonymous users ok, but without expected effect. However, when repeatedly saved, it started working. Don´t know what happened.

Heshan,

Yep, I have a static IP and the site is publicly available, though access to these video node / content is restricted.

My site is secured with SSL and again does not have anonymous access to the nodes, would either of these be an issue?

Note, it was working, and I recently upgraded from:

video.module,v 1.69.4.17.2.7.2.50 2010/08/29

to

video.module,v 1.69.4.17.2.7.2.71 2011/01/27

Any thoughts?

Thank you for your help!

So after doing a bit of digging, I found that Zencoder is defiantly posting to " https://www.wexlerpost.com/media/postback/jobs " URL, but is erroring out:

-----

HTTP/1.1 403 Forbidden

Access denied | Website

-----

Again, I have not changes permissions on the site, and this was working before.

Any guesses?

Thanks!

- Josh

Please apply the patch and in user permissions enable anonymous access to the zencoder postback

Just got back on this project- I will give that a shot! Thank you as always!

Applied patch, Allowed "anonymous" for "zencoder postback", uploaded video, and no go.

https://www.wexlerpost.com/media/postback/jobs

If you click the link, you can see the same thing that Zencoder sees.

Ideas?

subscribing here
have the same problem, with a project.
accessing content is only allowed for registerd users.

will try out the patch.

patch does not work.
the new permission appears and is set.

need to give guest access to all published content.
then it works. when I remove the permission, it stopped working.

I'm getting "working something else" when going to /postback/jobs as a non-authenticated user, but Zencoder is getting:

HTTP/1.1 401 Unauthorized

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>401 Authorization Required</title>
</head><body>
<h1>Authorization Required</h1>
<p>This server could not verify that you
are authorized to access the document
requested. Either you supplied the wrong
credentials (e.g., bad password), or your
browser doesn't understand how to supply
the credentials required.</p>
<hr>
<address>Apache/2.2.14 (Ubuntu) Server at lrfvideo.oddserver.se Port 80</address>
</body></html>

The site's logs entries say "Postback received from the Zencoder Transcoding servers.s:0:"";" but the node doesn't get published and the video isn't being displayed. The conversion works as intended though, and the videos have landed on S3

@AdamGerthel , make sure u have correct poastback URL set it up with video module. The patch working fine for many.

We've managed to get it working now. The only thing missing is that no thumbnails gets picked when the node is published after zencoder is done

Please check the watchdog for further debuggin

Just spotted this thread

I'm getting a 404 error but the postback url is definitely there and set up. tried accessing direct and got the working on something else message

site is www.klfit.co.uk

postback is http://www.klfit.co.uk/postback/jobs

subscribe

I can see that the data is coming back and is stored in the video_zencoder table in a field called data. I do not see any way to actually get the list of converted videos out so that I can do something useful with them. Anyone have any thoughts or insights?

You should unserialize the data field. The result is a list of converted videos.

I have removed the access check from /postback/jobs, it was quite pointless to have a permission that has to be enabled for all roles when it is possible to remove the access check altogether.

Thanks Jorrit. The more I look at these APIs, the more convinced I am that the Zencoder converted file information needs to be crammed into the video_zencoder or video_files table. Here are a few reasons.

1. We need to know the size of the converted files because they may all be different. While we can pull the data out of the video_zencoder table, we don't know the size of each specific video.
2. We need to know the video preset used to convert the file so we can determine the correct converted video to show based on the user device.
3. We need other information such as the Amazon file id. We can currently pull the path information but I can't get a private file path for Amazon S3 without the id of the converted video. This ID is not currently captured so there is no way to retrieve those easily.

I will only add the features you need after I have fixed all the bugs. I agree that the data model should be enhanced such that each converted video has its own item in the database with all metadata.

This code is not generic but will enable you to add the converted video files to a node if you are using Zencoder. The files are helplessly locked in the data field in the video_zencoder table but this will enable you to get them back out and show them as either authenticated or unauthenticated.

  function module_nodeapi(&$node, $op) {

    module_load_include("php", "video_s3", "/includes/S3");
    module_load_include("inc", "video_s3", "/includes/amazon_s3");

    if ( $op == 'load' && $node->type == 'video' ) {
      $video_mime = array(
        '3gp' => 'video/3gpp',
        'asf' => 'video/x-ms-asf',
        'asx' => 'video/x-ms-asf',
        'avi' => 'video/x-msvideo',
        'flv' => 'video/x-flv',
        'm4v' => 'video/mp4',
        'mng' => 'video/x-mng',
        'mov' => 'video/quicktime',
        'mp4' => 'video/mp4',
        'mp4v' => 'video/mp4',
        'mpeg' => 'video/mpeg',
        'mpg' => 'video/mpeg',
        'ogv' => 'video/ogg',
        'qt' => 'video/quicktime',
        'webm' => 'video/webm',
        'wmv' => 'video/x-ms-wmv'
      );

      $videos = db_query("SELECT data FROM {video_zencoder} WHERE nid = " . $node->nid);
      while ($row = db_fetch_array($videos)) {
        $filedata = unserialize($row['data']);
        //dpm('data=' . $row['data']);
        $object = (array) unserialize($row['data']);

        $items = array();

        foreach ($object as $job_id => $fields) {
          $item = array();
          $url = parse_url($fields->url);
          $item['filename'] = array_pop(preg_split('|/|', $fields->url));

          $s3 = new video_amazon_s3;
          $s3->connect();
          $s3_file_id = substr($url['path'],1);
          // do it this way if you want authenticated files otherwise uncomment the susebquent line
          $item['filepath'] = $s3->get_authenticated_url($s3_file_id);
          // $item['filepath'] = $fields->url;

          $ext_matcher = array();
          if ( preg_match('|\.([a-zA-Z0-9]+)$|', $fields->url, $ext_matcher) ) {
            $lower_ext = strtolower($ext_matcher[1]);
            if ( array_key_exists($lower_ext, $video_mime) ) {
              $item['filemime'] = $video_mime[$ext_matcher[1]];
              //$files[$lower_ext] = $item;
              $items[]= $item;
            }
          }
        }
      }
      $node->zencoder_videos = $items;
      //dpm($node);
    } // if op == load
  } // function

Hi mlconner,

Could you please give more detail and explain where we can setup this Code. I' m new in drupal and I would like to know where i need to put your code to display the video uploaded on my video node.

I configured the video module as it' s explained on the http://video.heidisoft.com/documentation/. When I upload a video it's encoded perfectly by Zendcoder and stored in S3.

When I look on my database in table video_zendcoder, i can see the postback url of ZendCoder :

O:8:"stdClass":1:{s:8:"27933340";O:8:"stdClass":3:{s:2:"id";i:27933340;s:5:"label";s:10:"VIDEO_10_2";s:3:"url";s:103:"http://videos.MYSITE.com.s3.amazonaws.com/sites/default/files/videos/con...";}}

If i understand now, the only way to show the video on the node it's copying the fragment of code you give us. I don't understand why it's no integrated on the module yet, but I really would like understand and show the video on the node :=) Actually i have the message "This video is currently being processed. Please wait."

Thanks in advance,

Antoine

The video should display in the node. You are replying to a very old issue and its contents are no longer relevant. Please open a new issue and describe your problem. Also, give the version of the module that you are using and list the errors in the Drupal error log, if there are any.