[ZendTo] Re: Large uploads not working on 64-bit Centos VM

Chris Barber chris at techquility.net
Thu Sep 8 04:46:42 BST 2011


Well I followed all steps on http://zend.to/phpfix.php and I have the same exact error when uploading a file larger than 2 GB saying the temporary folder is misconfigured. I suppose I will just have to re-download the new VM Julian posted and configure it.

-Chris

From: zendto-bounces at zend.to [mailto:zendto-bounces at zend.to] On Behalf Of Jules
Sent: Wednesday, September 07, 2011 12:07 PM
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

Ah, didn't appreciate your problem only affected files greater than 2GB.
In that case, it's a libphp5.so problem. You need to make sure your PHP is built able to cope with large files, instructions on
    http://zend.to/phpfix.php

Jules.

On 07/09/2011 14:16, Chris Barber wrote:
Richard, yes I am able to upload files smaller than 2 GB, no problem. There is plenty of free disk space yes.

-Chris

From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to] On Behalf Of ROGERS Richard
Sent: Tuesday, September 06, 2011 12:06 PM
To: 'ZendTo Users'
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

Chris - are you able to upload smaller files? - just wondering as your earlier comment was along the lines of "still can't upload large files". If you can, that seems to me to point away from permissions (is there a disk space issue??!)

Jules - I discovered an apparent mismatch this afternoon between the identities used by clamd and freshclam on the CentOS VM, which seemed to be preventing freshclam from downloading and installing updates. You may want to check this before the next VM release. (I got round it by making them use the same uid but I don't know if that is the "official" way to do it).

Regards

Richard
--
Richard Rogers
Principal IT Officer, Client Technology and Applications
Information Services, Staffordshire University
Tel. 01785-353785



From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to]<mailto:[mailto:zendto-bounces at zend.to]> On Behalf Of Jules
Sent: 06 September 2011 16:56
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

It's referring to the "incoming" directory permissions. If it is using disk space then it's probably when it tries to set the permissions at the end of the upload when it closes the file it uploaded. It's unlikely to be related to ClamAV.

But you can try disabling the virus scanning. You can usually get away with setting the virus scanner setting in preferences.php to
    'clamdscan' => '/bin/true',
and then give it another try.
Clamd and clamdscan are governed by App-Armor (or SELinux, same thing, different name). The docs on the website tell you how to configure SELinux to let clamd and clamdscan work.


Jules.

On 06/09/2011 14:35, Chris Barber wrote:
Well I added these permissions but I'm getting the same error. I even tried setting the folder to 777 just to see if that would work. The folder owner is apache however, but all the rest of the folders have that owner so I thought that was correct?

If I watch the free disk space during the transfer, I see it slowly shrinking until the error hits, then the free space goes back to what it was previously. This tells me that the webserver is able to write there. Perhaps clamav is having the problem? But I thought 777 would allow anyone to use files in that dir?

Thanks,
Chris


From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to] On Behalf Of Jules
Sent: Monday, September 05, 2011 5:27 PM
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

/var/zendto/incoming.
This needs to be writable by the web server user, and scannable by clamd.

On a RedHat 6 box this should look like this:

[sysjkf at isol-zendto zendto]$ ls -al /var/zendto
total 2356
drwxrwxr-x.   6 root   apache    4096 Feb 24  2011 .
drwxr-xr-x.  24 root   root      4096 Feb 24  2011 ..
drwxr-xr-x. 275 apache apache   12288 Sep  5 17:59 dropoffs
drwxr-xr-x.   2 apache apache    4096 Sep  5 17:59 incoming
drwxr-xr-x.   2 apache apache    4096 Jul 20 22:09 rrd
-rw-rw-r--.   1 apache apache 2361233 Sep  5 21:16 zendto.log

On a Ubuntu box or a CentOS box the user and group of the files will be different, may be "www-data" or "httpd" instead of "apache". But the permissions should look like the above.

Jules.

On 05/09/2011 16:19, Chris Barber wrote:
Thanks. I am still not able to upload files larger than 2 GB however. The error message has changed to:
Upload Error

There was an error while uploading 'filename.iso'. The server's temporary folder is misconfigured.


What temp folder is this referring to?

Thanks,

Chris Barber | President | techQuility
Office: 321.283.4333  -or- 888.648.4333 | Fax: 888.648.8488
Help Desk: help at techquility.net<mailto:help at techquility.net?subject=Service%20Request>  | www.techQuility.net<http://www.techquility.net/>

This e-mail and any attachments may contain confidential and privileged information. If you are not the intended recipient, please notify the sender immediately by return e-mail, delete this e-mail and destroy any copies. Any dissemination or use of this information by a person other than the intended recipient is unauthorized and may be illegal. Unless otherwise stated, opinions expressed in this e-mail are those of the author and are not endorsed by the author's employer.

From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to] On Behalf Of Jules
Sent: Monday, September 05, 2011 4:13 AM
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

Copy in that module file, make sure it has exactly the same ownership and permissions as the version that was there before (I would save your old one just in case), and then
    service httpd restart
and you should be up and running.

Cheers!
Jules.

P.S. Donations for quick responses are always welcome! :-)

On 05/09/2011 02:56, Chris Barber wrote:
Jules,

Wow thank you for the quick work!

Not to sound too noobish, but do I just need to copy in this module file?

Thanks,
Chris


From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to] On Behalf Of Jules
Sent: Sunday, September 04, 2011 4:59 PM
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

Check the News on the zend.to home page, as I have posted a link to a replacement
/usr/lib64/httpd/modules/libphp5.so
file there.

Alternatively, I have posted a rebuild of the whole CentOS-x64 build of ZendTo on the downloads page as well.

I hope that solves your problem for you. :-)

Cheers,
Jules.

Time for bed.

On 04/09/2011 15:56, Chris Barber wrote:
I'm not able to follow the instructions on zend.to/phpfix.php

I get errors about every other command. Some I am able to work around (I think) and others I can't figure out. For now I'll just wait I guess cause I don't have time to spend 5 hours on this.

If anyone else can try this, please do and report back.

Thanks,
Chris


On Behalf Of Chris Barber
Sent: Sunday, September 04, 2011 10:42 AM






Jules,

The following link from http://zend.to/phpfix.php is broken. I did a Google search but I'm finding a few items that look similar. Can you provide and correct link?

http://mirror.rackspace.com/ius/stable/Redhat/5.5/SRPMS/

Thanks,
Chris


On Behalf Of Jules
Sent: Sunday, September 04, 2011 5:45 AM

I've found the solution to this one. In the most recent PHP revision, they tweaked the layout of the code which caused the patching commands on http://zend.to/phpfix.php to break, so it left an int behind that it should have turned into a long.

If you're running your own server (and haven't just taken my VM distribution) then you need to rebuild the libphp5.so binary according to the instructions on zend.to/phpfix.php which I fixed some time ago when I first discovered the problem.

If my VM distribution is also wrong, I will get that rebuilt as soon as I can. Otherwise you can just follow the instructions on http://zend.to/phpfix.php yourself to rebuild the binary.

Note if you are running RedHat 6 or CentOS 6, you will need to follow the link on that page to the RedHat 6 version of the instructions. Unfortunately these are rather more long-winded due to RedHat failing to ship a load of the libraries that are required to rebuild their own binaries :-(

Can you confirm the problem *does* exist on my own VM distribution for CentOS 5?

Jules.

On 02/09/2011 15:52, Chris Barber wrote:
Okay well I am still also NOT able to upload any files larger than 2 GB, no matter what browser I try. IE9 64 bit, nope. Chrome, nope. Firefox, nope.

I checked my PHP parameters and they also look fine as you indicated below. I'm out of ideas at the moment....

My setup is using the 64 bit CentOS prebuilt VM. Running in ESXi 4.x.

Jules?

-Chris


From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to] On Behalf Of Chris Barber
Sent: Friday, September 02, 2011 10:36 AM
To: ZendTo Users
Subject: [ZendTo] Re: Large uploads not working on 64-bit Centos VM

Hey Richard

I'm going to test this on my CentOS 4.05 ZendTo install and let you know if it works. Make sure you give IE9 64bit edition a try too.

Will report back soon.

-Chris

From: zendto-bounces at zend.to<mailto:zendto-bounces at zend.to> [mailto:zendto-bounces at zend.to]<mailto:[mailto:zendto-bounces at zend.to]> On Behalf Of ROGERS Richard
Sent: Friday, September 02, 2011 6:44 AM
To: 'zendto at zend.to<mailto:zendto at zend.to>'
Subject: [ZendTo] Large uploads not working on 64-bit Centos VM

Hi -

I'm coming back to my upload problems with large (>2GB) files, having updated to 4.03 on my 64 bit CentOS virtual machine (downloaded from zend.to, so should have all the right underpinnings).

Unfortunately this issue hasn't gone away with the upgrade (there's always hope :)). Here is a bit more info...

Uploading via Chrome on Win7/64 bit, the upload appears to complete, but at the end the following error is displayed:

[cid:image001.png at 01CC6DB8.65480310]

A couple of things to note:

1.       The size does not exceed the limits imposed - I've set an upload limit in the configuration of around 8GB - when the upload starts Chrome displays "2242.39MB/8864.37MB"

2.       A simple PHP script reports its internal limits as follows:

php_int_max 9223372036854775807
php_int_size 8

...so that looks like a "proper" 64 bit PHP!

3.       Note the "From" above - it seems to have "forgotten" who I am - could this be linked? (or is it just not bothering after some other failure - possibly so as it sill displays "you are currently logged in as ROGERS Richard" at the bottom of the screen). It correctly displayed my details (from AD login) in the earlier screens.

Relevant configuration files are attached.

Any suggestions as to what the problem may be, or how to go about tracking it down, are welcome!

Thanks and regards

Richard

--
Richard Rogers
Principal IT Officer, Client Technology and Applications
Information Services, Staffordshire University
Tel. 01785-353785









_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto


Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'Teach a man to reason, and he will think for a lifetime.' - Phil Plait                                       'All programs have a desire to be useful' - Tron, 1982







_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto






Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'Teach a man to reason, and he will think for a lifetime.' - Phil Plait                                       'All programs have a desire to be useful' - Tron, 1982











_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto





Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'It's okay to live without all the answers' - Charlie Eppes, 2011

'All programs have a desire to be useful' - Tron, 1982

'That is the land of lost content,

 I see it shining plain,

 The happy highways where I went,

 And cannot come again.' - A.E. Houseman

--
This message was scanned by Spam Ninjas<www.spamninjas.com> and is believed to be clean.
Click here to report this message as spam.<https://ninja1.spamninjas.com/cgi-bin/learn-msg.cgi?id=B643327DD4.A6554>





_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto




Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'Teach a man to reason, and he will think for a lifetime.' - Phil Plait                                       'All programs have a desire to be useful' - Tron, 1982

--
This message was scanned by Spam Ninjas<www.spamninjas.com> and is believed to be clean.
Click here to report this message as spam.<https://ninja1.spamninjas.com/cgi-bin/learn-msg.cgi?id=AB56027DD2.A6A36>




_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto


Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'It's okay to live without all the answers' - Charlie Eppes, 2011

'All programs have a desire to be useful' - Tron, 1982

'That is the land of lost content,

 I see it shining plain,

 The happy highways where I went,

 And cannot come again.' - A.E. Houseman

--
This message was scanned by Spam Ninjas<www.spamninjas.com> and is believed to be clean.
Click here to report this message as spam.<https://ninja1.spamninjas.com/cgi-bin/learn-msg.cgi?id=D6585443B81.A7675>




_______________________________________________

ZendTo mailing list

ZendTo at zend.to<mailto:ZendTo at zend.to>

http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto



Jules



--

Julian Field MEng CITP CEng

www.Zend.To<http://www.Zend.To>



Follow me at twitter.com/JulesFM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654



'Teach a man to reason, and he will think for a lifetime.' - Phil Plait                                       'All programs have a desire to be useful' - Tron, 1982

--
This message was scanned by Spam Ninjas<www.spamninjas.com> and is believed to be clean.
Click here to report this message as spam.<https://ninja1.spamninjas.com/cgi-bin/learn-msg.cgi?id=4DE9427DD4.A79E1>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/zendto/attachments/20110907/e22782de/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 20064 bytes
Desc: image001.png
Url : http://mailman.ecs.soton.ac.uk/pipermail/zendto/attachments/20110907/e22782de/attachment-0001.png 


More information about the ZendTo mailing list