Video and Mass Import still not working [#36645]

Comment	File	Size	Author
#15	video_directory_separator.patch	635 bytes	vhmauery

Comment #1

bigbman commented 7 November 2005 at 09:24

I'm starting to see the light. Here are my latest apache error logs:

[Mon Nov 07 00:25:22 2005] [error] [client 66.249.71.29] File does not exist: C:/webapps/xampp/htdocs/robots.txt
[Mon Nov 07 00:33:08 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/
[Mon Nov 07 00:33:10 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/
[Mon Nov 07 00:37:01 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/
[Mon Nov 07 00:37:01 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/
[Mon Nov 07 00:40:11 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block
[Mon Nov 07 00:40:28 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block/configure/acidfree/2
[Mon Nov 07 00:40:36 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block
[Mon Nov 07 00:40:39 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block/configure/acidfree/0
[Mon Nov 07 00:40:59 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block
[Mon Nov 07 00:41:04 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block/configure/acidfree/2
[Mon Nov 07 00:41:11 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block
[Mon Nov 07 00:41:26 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/block
[Mon Nov 07 00:41:31 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/6&pid=1&from=0,1
[Mon Nov 07 00:41:31 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/6&pid=1&from=0,1
[Mon Nov 07 00:41:31 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/
[Mon Nov 07 00:41:34 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/6/edit
[Mon Nov 07 00:41:39 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/6/edit
[Mon Nov 07 00:41:41 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/node
[Mon Nov 07 00:41:46 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/5&pid=2&from=0,0
[Mon Nov 07 00:41:46 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/5&pid=2&from=0,0
[Mon Nov 07 00:41:46 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/
[Mon Nov 07 00:41:48 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/5/edit
[Mon Nov 07 00:41:51 2005] [error] [client 192.168.1.1] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/5/edit
'file' is not recognized as an internal or external command,
operable program or batch file.
'unzip' is not recognized as an internal or external command,
operable program or batch file.
'file' is not recognized as an internal or external command,
operable program or batch file.
'unzip' is not recognized as an internal or external command,
operable program or batch file.
'file' is not recognized as an internal or external command,
operable program or batch file.
'unzip' is not recognized as an internal or external command,
operable program or batch file.

Log in or register to post comments

Comment #2

inspiredbylife commented 8 November 2005 at 06:43

Looks like you don't have unzip utility or it's not in your PATH. If you want to check go to the command prompt and type 'unzip' and check if you get the same error message as:

"'unzip' is not recognized as an internal or external command, operable program or batch file."

PS: If you add the 'unzip' and 'tar' utilities to your PATH, make sure you restart Apache processes too!

Log in or register to post comments

Comment #3

inspiredbylife commented 8 November 2005 at 07:02

I think using external programs to unzip/untar is not that a good idea. PHP has built in routines to extract contents from compressed (zip and tar) files or some other thirdparty module like Zip Class.

Can the module be modified to make use of the same? Or it can also be a option, which the user might be able to decide based on how php is compiled.

Log in or register to post comments

Comment #4

vhmauery commented 8 November 2005 at 17:22

I am accepting patches for replacing the unzip/tar functions. But I will not do it myself. Those are pretty darn basic things that I would expect a server to have. Plus, I don't want to have to maintain all the code that does the unzipping. Things like that are VERY prone to problems (think buffer overflow) and I don't want to be a part of it.

Log in or register to post comments

Comment #5

bigbman commented 8 November 2005 at 19:32

So what do you suggest for an Apache Windows Server environment that wants to use the AcidFree module? Are we just sh*t out of luck? That seems to be the attitude I'm getting. This would really be a shame as I feel a lot of people are impressed with the functionality of this module.

Log in or register to post comments

Comment #6

bigbman commented 8 November 2005 at 19:35

Also, notice the missing 'file' command. What's this, and how can I fix this?

Log in or register to post comments

Comment #7

vhmauery commented 8 November 2005 at 19:51

You can get nearly a full UNIX environment with Cygwin (http://www.cygwin.com/) It has all the command line utilities like unzip, tar, file, etc. The 'file' command gives information about a file (Acidfree uses it for mimetype.)

I don't think you are SOL if you are using Apache under windows. You aren't the only one who is. Others have gotten it working too. I am just having a very hard time working with you since I don't have a windows environment myself (and have never done any web server administration in windows). I am a Linux man. I try to be helpful and forgiving to others, but I just cannot for the life of me figure out the problem here. I am certainly willing to keep working at this until you either get sick and give up or we get it working.

Also, if you don't want to install file, you can try getting the php fileinfo extension from PECL (http://pecl.php.net/package-info.php?package=Fileinfo). It requires that you compile it yourself, but it is a good alternative to the 'file' executable. I had thought that the code would work without either file or fileinfo, but you are showing that it doesn't (though I am not sure why it doesn't).

Log in or register to post comments

Comment #8

bigbman commented 8 November 2005 at 23:21

OK, I have installed Cygwin, all the necessary components, and added the bin dir to my path. Typing 'file' or 'unzip' in a shell window works like a charm.

I restarted Apache, but I'm still getting this error with mass import:

'file' is not recognized as an internal or external command,
operable program or batch file.
'unzip' is not recognized as an internal or external command,
operable program or batch file.

Do I need to configure another type of %PATH% variable?

Log in or register to post comments

Comment #9

bigbman commented 8 November 2005 at 23:37

Never mind, I just needed to restart my machine. Guess the PHP process had it cached.

Anyways, mass import is working!!!!

1 more problem to fix, then my praises are on their way!

Video Uploading still isn't working. Still getting the files/working// link after an upload, and the following error:

warning: getimagesize(files/working//) [function.getimagesize]: failed to open stream: Permission denied in C:\webapps\xampp\htdocs\drupal\modules\acidfree\class_video.inc on line 217.

Please help me with this last one, and I'll get out of your hair, and actually start helping others with this module!

Thanks,

B

Log in or register to post comments

Comment #10

vhmauery commented 8 November 2005 at 23:46

Glad to hear mass import is working.

Are you seeing any errors when you upload videos before you view them? What are your video thumbnailer settings? (admin/settings/acidfree 'video manipulation' section) If it is mplayer, you need to install mplayer and specify the path.

Log in or register to post comments

Comment #11

bigbman commented 9 November 2005 at 00:02

You mean mplayer, not Media Player, right? -> http://www.mplayerhq.hu/homepage/design7/dload.html

I didn't have that installed. I'll try that now.

Also, here are more of my Apache error logs:

[Tue Nov 08 15:51:18 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/18/edit
[Tue Nov 08 15:52:55 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/19&pid=1&from=0,9
[Tue Nov 08 15:52:55 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=node/19&pid=1&from=0,9
[Tue Nov 08 15:52:56 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/
[Tue Nov 08 15:58:11 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin
[Tue Nov 08 15:58:28 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/settings
[Tue Nov 08 15:58:30 2005] [error] [client 159.153.140.10] Directory index forbidden by rule: C:/webapps/xampp/htdocs/drupal/files/active/, referer: http://bhive.no-ip.org/drupal/?q=admin/settings/acidfree

Log in or register to post comments

Comment #12

bigbman commented 9 November 2005 at 00:13

Downloaded mplayer, all the base codecs, and installed it in c:\apps\mplayer. I enabled mplayer and added the path in AcidFree. No Dice. I'm getting the same errors.

Log in or register to post comments

Comment #13

vhmauery commented 9 November 2005 at 02:19

yes, mplayer is the one. I tried creating an account on your site just to see for myself what happens when uploading a video, but my user is not allowed to add acidfree media.

Log in or register to post comments

Comment #14

bigbman commented 9 November 2005 at 04:07

I just gave you admin access. Please try now, thanks!

Log in or register to post comments

Comment #15

vhmauery commented 9 November 2005 at 06:00

Status	File	Size
new	video_directory_separator.patch	635 bytes

I uploaded a test mp4 video and it is there and working. The problem is that the thumbnail never got generated, which means that the small image (which keeps track of the dimensions of the video) also never got generated.

This is the error that clued me in:

warning: rename(c:\windows\temp\acidfree\mplA.tmp/00000001.jpg,files/working/0/55_small.jpg) [function.rename]: No such file or directory in C:\webapps\xampp\htdocs\drupal\modules\acidfree\class_video.inc on line 94.

warning: getimagesize() [function.getimagesize]: Read error! in C:\webapps\xampp\htdocs\drupal\includes\image.inc on line 88.

warning: Cannot modify header information - headers already sent by (output started at C:\webapps\xampp\htdocs\drupal\includes\common.inc:384) in C:\webapps\xampp\htdocs\drupal\includes\common.inc on line 192.

Note the rename source file. I am not sure how windows deals with / and \ as path separators. Acidfree should have deleted the mplA.tmp directory already, but I am hoping that the file actually did exist at one point in time.

Try this patch to see if it fixes anything.

Log in or register to post comments

Comment #16

bigbman commented 9 November 2005 at 06:34

Didn't seem to do it.

Log in or register to post comments

Comment #17

vhmauery commented 9 November 2005 at 16:25

after you commented out the rmdir_rec line, does the directory exist with the 00000001.jpg file inside?

Can you try that mplayer command on your own? Try something like this:

mplayer -ao null -vo jpeg:maxfiles=1:quality=100 -frames 1 /path/to/some/movie.avi

This should give you a 00000001.jpg file in the current directory.

Log in or register to post comments

Comment #18

bigbman commented 9 November 2005 at 19:18

I tried the command:

mplayer -ao null -vo jpeg:maxfiles=1:quality=100 -frames 1 /path/to/some/movie.avi

and it created TWO jpeg files (001 and 002), which showed images from each video. This worked great for both your test video, and a .mov of my own.

Why did it create two jpegs?

What's next?

Log in or register to post comments

Comment #19

vhmauery commented 9 November 2005 at 19:26

did it create them as 00000001.jpg or 001.jpg? It created two because mplayer is retarded. The command tells it to create 1 obviously, but it doesn't. If you tell it to create 0 frames, it does just that, but if you tell it to create 1 frame, it makes 2.

Anyway, it looks like we are narrowing this bug down... If the file is not 8 digits, I need to rethink how to get the file from mplayer. If the file is 8 digits, The rename isn't working. Maybe some absolute/relative path problem (the first arg, the mplayer-generated thumb is an absolute path, while the second is a relative path to the filemanager filestore.)

Log in or register to post comments

Comment #20

bigbman commented 9 November 2005 at 19:56

My apologies, it does create 00000001.jpg and 00000002.jpg. I just got lazy in my typing.

I sent you an email about connecting to my FTP server. Please feel free to use this to test things out. Let me know if you need access to other directories.

B

Log in or register to post comments

Comment #21

bigbman commented 9 November 2005 at 20:03

BTW, what is the difference between the 'active' and 'working' directories? What's the workflow of this in terms of how an image is processed? What's the '0' directory for?

Log in or register to post comments

Comment #22

vhmauery commented 9 November 2005 at 20:18

Filemanager works with the idea that 'active' files are ones that are unchanging. 'working' files are copies of the active files that are being changed or haven't been promoted to active yet. So when filemanager_add_file gets called, it adds the file to the working directory. Then, you must call filemanager_promote_working to move it to active status.

The 0 in the directory is for two reasons. First, some filesystems have problems with lots of files in a single directory, so to limit the files in a directory, the files get broken up into numbered directories as the number of files grows too large (the number of files per directory is set on the admin/settings/filemanager page). The second reason for the numbered directories is to resolve filename conflicts. When the filemanager imports a file, it keeps the file named as whatever you tell it. In order to not overwrite another existing file of the same name, it will put it in a new, higher numbered directory. And all this should be transparent to the user (and it is, since you are the first person who asked me what it is all about.)

Log in or register to post comments

Comment #23

bigbman commented 11 November 2005 at 19:34

Still having problems with Video uploads on my server. Any progress?

Let me just send a quick sincere nore of appreciation towards vhmauery. He's been extremely helpful and willing to work closely with me, and I'm eternally grateful for his time and effort on this. I think this module is very well done, and has tons of potential. I really can't say enough great things about the brains behind this module - again, thanks vhmauery.

Log in or register to post comments

Comment #24

vhmauery commented 11 November 2005 at 19:39

I haven't done much in this area for the last couple of days. I am pretty lost as to what the problem is. I was able to upload the small mp4 test movie just fine. Could you email me a small test movie that is not working for you?

Log in or register to post comments

Comment #25

bigbman commented 11 November 2005 at 19:45

Here's a file that fails.

Log in or register to post comments

Comment #26

vhmauery commented 11 November 2005 at 19:47

Did you email it or post it to the bug? It didn't show up on the bug -- it might be too big. Email it to me or put it on your server so I can get it with ftp.

Log in or register to post comments

Comment #27

bigbman commented 11 November 2005 at 19:49

Guess that didn't work. I'll email you the file.

Log in or register to post comments

Comment #28

bigbman commented 12 November 2005 at 04:22

Looks like AVI files aren't working. I'm getting the following Apache error logs:

Cannot load font: c:/windows/fonts/arial.ttf
Seek failed
The selected video_out device is incompatible with this codec.
Also try adding the scale filter, e.g. -vf spp,scale instead of -vf spp.
The selected video_out device is incompatible with this codec.
Also try adding the scale filter, e.g. -vf spp,scale instead of -vf spp.
The selected video_out device is incompatible with this codec.
Also try adding the scale filter, e.g. -vf spp,scale instead of -vf spp.
The selected video_out device is incompatible with this codec.
Also try adding the scale filter, e.g. -vf spp,scale instead of -vf spp.
The selected video_out device is incompatible with this codec.
No accelerated colorspace conversion found

Log in or register to post comments

Comment #29

bigbman commented 16 November 2005 at 19:17

Status:

Active

» Fixed

Hope you don't mind. I'm going to close this issue since mass imports appear to be working. I'll open a new issue for my problems with AVI's.

Log in or register to post comments

Comment #30

vhmauery commented 16 November 2005 at 19:27