[ZendTo] Abandoned files in 'incoming'

[Jules]

Hi John,

On Wed 02/12/20 23:33, John Thurston via ZendTo wrote:
> a'yep, that job is there, and running the 'find' command interactively 
> returns appropriate files.
>
> I don't recall how old the files were the last time my disk-full alarm 
> went off and I shoveled it out. It is possible that job was just about 
> to trigger and I was premature. It is likely that our increased use of 
> this tool is simply over-running my small disks.
That's quite possible. Just about every ZendTo installation I have seen 
has an ever-increasing disk space requirement. On my own installation 
here at Southampton, I have recently had to up the max drop-off size to 
100GB (we have a non-clinical team who do MRI scans of tiny objects, and 
create data like it's going out of fashion). And after adding the 4th TB 
of disk space, we've had to reduce the default lifetime from 32 days to 
22 days, just to try to limit its hunger for space!

>
> I have two more questions:
>
> 1) I see a reference in the preferences:
>
>   // This is where your drop-offs are stored.
>   // It must be on the same filesystem as /var/zendto/incoming, and
>   // on preferably on the same filesystem as /var/zendto.
>   'dropboxDirectory'     => NSSDROPBOX_DATA_DIR."dropoffs",
>
> Why the "same filesystem" requirement for 'incoming' and 'dropoffs'?
Because it basically does a "mv" from the incoming directory to the 
dropoffs directory.
If they are on the same filesystem, that is an instant atomic operation.
If they aren't, that could take minutes, where the user will just be 
left waiting and wondering why his upload got to 100% and then just sat 
there!


>
> 2) The lines above define 'dropoffs'. Where is 'incoming' defined?
php.ini. It's the temporary upload location that PHP uses.

Cheers,
Jules.

>
> On 12/2/2020 1:57 AM, Jules wrote:
>> There should be a cron job that cleans these up for you.
>> It should be in /etc/cron.d/zendto.
>> The relevant line in that file is this one:
>>
>> 5 */4 * * * root find -H /var/zendto/incoming -type f -mmin +1440 
>> -delete >/dev/null 2>&1
>>
>> This will fire every 4 hours, deleting any files in 
>> /var/zendto/incoming that are more than 24 hours old.
>
> _______________________________________________
> ZendTo mailing list
> ZendTo at zend.to
> http://jul.es/mailman/listinfo/zendto

Jules

-- 
Julian Field MEng CEng CITP MBCS MIEEE MACM

'Solutions nearly always come from the direction you least expect, which
  means there's no point trying to look in that direction because it won't
  be coming from there.' - Douglas Adams

www.Zend.To
Twitter: @JulesFM

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://jul.es/pipermail/zendto/attachments/20201203/926f6860/attachment.html>