[ZendTo] my server became full

Dippery, Kyle D. kyle.dippery at uky.edu
Wed Apr 3 13:51:49 BST 2024


What version of ubuntu are you running?  All of my ubuntu instances have /var/log/syslog.

Do you have rsyslog running?  What does /etc/rsyslog.d look like, especially /etc/rsyslog.d/50-default.conf?

It might be worth finding out why syslog isn't running, or what is running in its place.  Troubleshooting anything is hard without log files.

Cheers,
Kyle



Kyle Dippery, PhD
219 Robotics Building
Stanley and Karen Pigman College of Engineering
859-257-1346

________________________________________
From: ZendTo <zendto-bounces at zend.to> on behalf of Elston, Ian via ZendTo <zendto at zend.to>
Sent: Wednesday, April 3, 2024 7:00 AM
To: Sangster, Mark; ZendTo Users
Cc: Elston, Ian
Subject: Re: [ZendTo] my server became full

CAUTION: External Sender

I am ubuntu, defaults from the server installation, with zendto set up from the installer script.   I have neither /var/log/syslog nor /var/log/messages, I did go there to look.

If I search for 'syslog' with mlocate I don't see any log.

Contents of /var/log

-rw-r--r--   1 root   root             174 Apr  3 06:52 alternatives.log
-rw-r--r--   1 root   root             186 Feb 28 06:46 alternatives.log.1
-rw-r--r--   1 root   root            1.9K Jan  4 15:28 alternatives.log.2.gz
drwxr-x---   2 root   adm             4.0K Apr  3 00:00 apache2
drwxr-xr-x   2 root   root            4.0K Apr  3 06:53 apt
-rw-r--r--   1 root   root             64K Apr 21  2022 bootstrap.log
-rw-rw----   1 root   utmp               0 Apr  1 00:00 btmp
-rw-rw----   1 root   utmp               0 Mar  1 00:00 btmp.1
drwxr-xr-x   2 clamav clamav          4.0K Mar 31 00:00 clamav
-rw-r-----   1 root   adm              25K Apr  2 10:21 cloud-init-output.log
-rw-r-----   1 root   adm             510K Apr  2 10:21 cloud-init.log
drwxr-xr-x   2 root   root            4.0K Apr 18  2022 dist-upgrade
-rw-r--r--   1 root   root             12K Apr  3 06:53 dpkg.log
-rw-r--r--   1 root   root             22K Mar 21 06:28 dpkg.log.1
-rw-r--r--   1 root   root            2.5K Feb 28 06:46 dpkg.log.2.gz
-rw-r--r--   1 root   root             49K Jan 31 06:59 dpkg.log.3.gz
-rw-r--r--   1 root   root             32K Jan  5 09:53 faillog
-rw-r--r--   1 root   root             484 Jan  4 14:46 fontconfig.log
drwxr-x---   3 root   adm             4.0K Nov  3  2022 installer
drwxr-sr-x+  3 root   systemd-journal 4.0K Nov  3  2022 journal
-rw-rw-r--   1 root   utmp            286K Apr  2 10:21 lastlog
drwx------   2 root   root            4.0K Apr 21  2022 private
drwxr-x---   2 root   adm             4.0K Apr  1 00:00 unattended-upgrades
-rw-r--r--   1 root   root             187 Jan  5 10:58 vmware-network.1.log
-rw-r--r--   1 root   root             187 Jan  4 14:13 vmware-network.2.log
-rw-r--r--   1 root   root             187 Jan  5 13:44 vmware-network.log
-rw-------   1 root   root            5.1K Apr  2 10:20 vmware-vmsvc-root.1.log
-rw-------   1 root   root            5.1K Jan  5 13:43 vmware-vmsvc-root.2.log
-rw-------   1 root   root            4.8K Jan  5 10:56 vmware-vmsvc-root.3.log
-rw-------   1 root   root            3.8K Apr  2 10:21 vmware-vmsvc-root.log
-rw-------   1 root   root            4.1K Apr  2 10:21 vmware-vmtoolsd-root.log
-rw-rw-r--   1 root   utmp             24K Apr  2 10:21 wtmp
drwxrwxr-x   2 root   www-data        4.0K Apr  1 00:00 zendto


-----------------------------------------------
Ian Elston
Senior Networks officer
Information Systems & Technology
The University of Bolton
http://www.bolton.ac.uk/<http://www.bolton.ac.uk/>

-----Original Message-----
From: Sangster, Mark <m.v.sangster at abdn.ac.uk>
Sent: 02 April 2024 16:25
To: Elston, Ian <I.Elston at bolton.ac.uk>; ZendTo Users <zendto at zend.to>
Subject: RE: my server became full

[You don't often get email from m.v.sangster at abdn.ac.uk<mailto:m.v.sangster at abdn.ac.uk>. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]

WARNING: This message originated from outside the University. Use caution when following links or opening attachments.

It does depend on your specific distribution; some of them log to /var/log/syslog or /var/log/messages.

Indeed, any log could be generated depending on your syslog setup.

Either hunt the logs in /var/log or review your syslog setup.

It is very unlikely that a default OS setup will not record cron activity.

Cheers
Mark

-----Original Message-----
From: Elston, Ian <I.Elston at bolton.ac.uk<mailto:I.Elston at bolton.ac.uk>>
Sent: Tuesday, April 2, 2024 4:18 PM
To: Sangster, Mark <m.v.sangster at abdn.ac.uk<mailto:m.v.sangster at abdn.ac.uk>>; ZendTo Users <zendto at zend.to<mailto:zendto at zend.to>>
Subject: RE: my server became full

CAUTION: External email. Ensure this message is from a trusted source and exercise caution before clicking links/opening attachments.


I don't appear to have such a log file, or any cron log file.





-----------------------------------------------
Ian Elston
Senior Networks officer
Information Systems & Technology
The University of Bolton
http://www.bolton.ac.uk/<http://www.bolton.ac.uk/>

-----Original Message-----
From: Sangster, Mark <m.v.sangster at abdn.ac.uk<mailto:m.v.sangster at abdn.ac.uk>>
Sent: 02 April 2024 14:19
To: ZendTo Users <zendto at zend.to<mailto:zendto at zend.to>>
Cc: Elston, Ian <I.Elston at bolton.ac.uk<mailto:I.Elston at bolton.ac.uk>>
Subject: RE: my server became full

[You don't often get email from m.v.sangster at abdn.ac.uk<mailto:m.v.sangster at abdn.ac.uk>. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]

WARNING: This message originated from outside the University. Use caution when following links or opening attachments.

The cron log (/var/log/cron.log), would at least acknowledge that it ran and when.

e.g. Apr  2 12:05:01 (server) CROND[92540]: (root) CMD (find -H /var/zendto/incoming -type f -mmin +1440 -delete >/dev/null 2>&1)

Cheers
Mark

-----Original Message-----
From: ZendTo <zendto-bounces at zend.to<mailto:zendto-bounces at zend.to>> On Behalf Of Elston, Ian via ZendTo
Sent: Tuesday, April 2, 2024 2:12 PM
To: ZendTo Users <zendto at zend.to<mailto:zendto at zend.to>>
Cc: Elston, Ian <I.Elston at bolton.ac.uk<mailto:I.Elston at bolton.ac.uk>>
Subject: Re: [ZendTo] my server became full

CAUTION: External email. Ensure this message is from a trusted source and exercise caution before clicking links/opening attachments.


> First, I'd check the log files to see if cron actually ran the job

This was my first thought, but I don't *think* it logs anywhere... Looking at the entries in the cron they output to /dev/null and not to a log file.

> I haven't looked at the preferences file in ages; maybe there's an option in there that needs to be set to enable the cleanup?

Not that I can see



-----------------------------------------------
Ian Elston
Senior Networks officer
Information Systems & Technology
The University of Bolton
http://www.bolton.ac.uk/<http://www.bolton.ac.uk/>

-----Original Message-----
From: ZendTo <zendto-bounces at zend.to<mailto:zendto-bounces at zend.to>> On Behalf Of Dippery, Kyle D. via ZendTo
Sent: 02 April 2024 13:53
To: ZendTo Users <zendto at zend.to<mailto:zendto at zend.to>>
Cc: Dippery, Kyle D. <kyle.dippery at uky.edu<mailto:kyle.dippery at uky.edu>>
Subject: Re: [ZendTo] my server became full

WARNING: This message originated from outside the University. Use caution when following links or opening attachments.

First, I'd check the log files to see if cron actually ran the job; if not maybe there's some info about why not.

I haven't looked at the preferences file in ages; maybe there's an option in there that needs to be set to enable the cleanup?



Kyle Dippery, PhD
219 Robotics Building
Stanley and Karen Pigman College of Engineering
859-257-1346

________________________________________
From: ZendTo <zendto-bounces at zend.to<mailto:zendto-bounces at zend.to>> on behalf of Elston, Ian via ZendTo <zendto at zend.to<mailto:zendto at zend.to>>
Sent: Tuesday, April 2, 2024 6:01 AM
To: 'ZendTo Users'
Cc: Elston, Ian
Subject: [ZendTo] my server became full

CAUTION: External Sender

Hello all,

Two posts in two [working] days, sorry about this....

My zendto was down this morning, due to being full.  Turns out the /var/zendto/incoming was very large and had files in from January

root at zeus:/home/nads# du -h /var/zendto/incoming
28G     /var/zendto/incoming


I found an older mail list thread from June 2021 about a cron job which should exist to tidy up that directory.  I've checked and my crontab does appear to have the required entry

# Cron jobs for ZendTo to remove expired drop-offs and update usage graphs
5 0 * * * root /usr/bin/php /opt/zendto/sbin/cleanup.php /opt/zendto/config/preferences.php >/dev/null 2>&1
25 * * * * root /usr/bin/php /opt/zendto/sbin/cleanup.php /opt/zendto/config/preferences.php --no-warnings >/dev/null 2>&1
15 0 * * * root /usr/bin/php /opt/zendto/sbin/emailSummary.php /opt/zendto/config/preferences.php >/dev/null 2>&1
5 */4 * * * root find -H /var/zendto/incoming -type f -mmin +1440 -delete >/dev/null 2>&1
1 1 * * * root /usr/bin/php /opt/zendto/sbin/rrdInit.php /opt/zendto/config/preferences.php 2>&1 | /bin/grep -iv 'illegal attempt to update using time'
3 3 * * * root /usr/bin/php /opt/zendto/sbin/rrdUpdate.php /opt/zendto/config/preferences.php 2>&1 | sed '$ d' | /bin/grep -v '^[0-9]*x[0-9]*$'



Looks like the entry to tidy up /incoming is not running, but I also have blank graphs, which suggests the rrd ones might not be working either... which also make me worry about the other entries...

Is there any way I can troubleshoot these cron jobs?

Installed version is the latest I think, server was only built (in January) using the installer

Listing... Done
zendto/lynx,trusty,xenial,bionic,now 6.13-3 all [installed]


To get my space back I have run (ran?) the command from the crontab find -H /var/zendto/incoming -type f -mmin +1440 -delete >/dev/null 2>&1

root at zeus:/home/nads# du -h /var/zendto/incoming
12K     /var/zendto/incoming

And now I have plenty of space back.


-----------------------------------------------
Ian Elston
Senior Networks officer
Information Systems & Technology
The University of Bolton
http://www.bolton.ac.uk/<http://www.bolton.ac.uk/<http://www.bolton.ac.uk/%3Chttp://www.bolton.ac.uk/>>

[https://www.bolton.ac.uk/assets/109433-UoB-Email-footer.png<https://www.bolton.ac.uk/assets/109433-UoB-Email-footer.png>]<https://www.bolton.ac.uk/<https://www.bolton.ac.uk/>>
This email (and any attachments) is confidential and may contain personal views which are not the views of the University of Bolton unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose information in any way nor act in reliance on it and notify the sender immediately. Please note the University of Bolton monitors emails sent or received. Further communication will signify your consent to this.

_______________________________________________
ZendTo mailing list
ZendTo at zend.to<mailto:ZendTo at zend.to>
http://jul.es/mailman/listinfo/zendto<http://jul.es/mailman/listinfo/zendto>
[University of Bolton]<https://www.bolton.ac.uk/<https://www.bolton.ac.uk/>>

This email (and any attachments) is confidential and may contain personal views which are not the views of the University of Bolton unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose information in any way nor act in reliance on it and notify the sender immediately. Please note the University of Bolton monitors emails sent or received. Further communication will signify your consent to this.

_______________________________________________
ZendTo mailing list
ZendTo at zend.to<mailto:ZendTo at zend.to>
http://jul.es/mailman/listinfo/zendto<http://jul.es/mailman/listinfo/zendto>


The University of Aberdeen is a charity registered in Scotland, No SC013683.
Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
[University of Bolton]<https://www.bolton.ac.uk/<https://www.bolton.ac.uk/>>

This email (and any attachments) is confidential and may contain personal views which are not the views of the University of Bolton unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose information in any way nor act in reliance on it and notify the sender immediately. Please note the University of Bolton monitors emails sent or received. Further communication will signify your consent to this.


The University of Aberdeen is a charity registered in Scotland, No SC013683.
Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.

[https://www.bolton.ac.uk/assets/109433-UoB-Email-footer.png]<https://www.bolton.ac.uk/>
This email (and any attachments) is confidential and may contain personal views which are not the views of the University of Bolton unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose information in any way nor act in reliance on it and notify the sender immediately. Please note the University of Bolton monitors emails sent or received. Further communication will signify your consent to this.



More information about the ZendTo mailing list