Hello,
we have the following setup:
OS Name : Linux x86_64
Version : 5.15.0-209.161.7.2.el9uek.x86_64
RAM installed : 7485 MB
Free RAM : 5085 MB
CPU : Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
Distribution : Oracle Linux Server 9.4
PHP Version : 8.0.30
Web Server : Apache/2.4.57 (Oracle Linux Server) OpenSSL/3.0.7 mod_perl/2.0.12 Perl/v5.32.1
Database Server : MariaDB Server version 10.5.22-MariaDB
Version OCSReports: 2.12.2
OCS-NG_WINDOWS_AGENT_v2.1.0.3
OCS-NG_WINDOWS_AGENT_v2.1.1.3
OCS-NG_WINDOWS_AGENT_v2.10.1.0
NG_unified_unix_agent_v2.10.2
Apache crash:
Process Apache Web Server httpd crashed with status "Segmentation fault"
Generally apache crash almost always (few times at a diffrent time) at the same time (hh:01) when linux VM's (on board with OCS agents) starts to contact ocs server to send packets, but not always (every hours), just four, five times per day. After those crash the process restart automatically with no need for our intervention, but sometime httpd service not start and we need to start it manually
and we are receiving the following error messages:
/var/log/httpd/error_log
[Wed Sep 18 23:01:02.292994 2024] [core:notice] [pid 1469221:tid 140662014445760] AH00051: child pid 1758802 exit signal Segmentation fault (11), possible coredump in /etc/httpd
can't find ANONSUB's 'anon1' entry.
can't find ANONSUB's 'anon234' entry.
can't find ANONSUB's 'anon231' entry.
can't find ANONSUB's 'anon230' entry.
can't find ANONSUB's 'anon214' entry.
can't find ANONSUB's 'anon224' entry.
can't find ANONSUB's 'anon1547' entry.
can't find ANONSUB's 'anon191' entry.
can't find ANONSUB's 'anon157' entry.
can't find ANONSUB's 'anon123' entry.
can't find ANONSUB's 'anon59' entry.
can't find ANONSUB's 'anon237' entry.
can't find ANONSUB's 'anon219' entry.
can't find ANONSUB's 'anon101' entry.
can't find ANONSUB's 'anon102' entry.
[Thu Sep 19 05:01:02.555852 2024] [core:notice] [pid 1469221:tid 140662014445760] AH00051: child pid 1784405 exit signal Segmentation fault (11), possible coredump in /etc/httpd
can't find ANONSUB's 'anon182' entry.
can't find ANONSUB's 'anon3' entry.
can't find ANONSUB's 'anon205' entry.
can't find ANONSUB's 'anon93' entry.
can't find ANONSUB's 'anon64' entry.
can't find ANONSUB's 'anon268' entry.
can't find ANONSUB's 'anon169' entry.
can't find ANONSUB's 'anon612' entry.
can't find ANONSUB's 'anon611' entry.
can't find ANONSUB's 'anon1078' entry.
[Thu Sep 19 08:01:01.994888 2024] [core:notice] [pid 1469221:tid 140662014445760] AH00051: child pid 1763034 exit signal Segmentation fault (11), possible coredump in /etc/httpd
can't find ANONSUB's 'anon4' entry.
can't find ANONSUB's 'anon4' entry.
can't find ANONSUB's 'anon732' entry.
can't find ANONSUB's 'anon1311' entry.
can't find ANONSUB's 'anon761' entry.
can't find ANONSUB's 'anon1013' entry.
can't find ANONSUB's 'anon721' entry.
can't find ANONSUB's 'anon1774' entry.
can't find ANONSUB's 'anon452' entry.
can't find ANONSUB's 'anon453' entry.
[Thu Sep 19 11:01:05.041054 2024] [core:notice] [pid 1469221:tid 140662014445760] AH00051: child pid 1812860 exit signal Segmentation fault (11), possible coredump in /etc/httpd
/var/log/mariadb/mariadb.log
2024-09-19 11:27:07 12944 [Warning] Access denied for user 'ocs'@'localhost' (using password: YES)
2024-09-19 4:01:13 12448 [Warning] Aborted connection 12448 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 4:01:13 12453 [Warning] Aborted connection 12453 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:02 12459 [Warning] Aborted connection 12459 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:02 12460 [Warning] Aborted connection 12460 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:02 12457 [Warning] Aborted connection 12457 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:09 12466 [Warning] Aborted connection 12466 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:09 12465 [Warning] Aborted connection 12465 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 5:01:09 12461 [Warning] Aborted connection 12461 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication pa
2024-09-19 12:01:11 13049 [Warning] Aborted connection 13049 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:11 13050 [Warning] Aborted connection 13050 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:11 13002 [Warning] Aborted connection 13002 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:11 13048 [Warning] Aborted connection 13048 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:11 13001 [Warning] Aborted connection 13001 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:12 13047 [Warning] Aborted connection 13047 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:12 12999 [Warning] Aborted connection 12999 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
2024-09-19 12:01:12 13046 [Warning] Aborted connection 13046 to db: 'ocsweb' user: 'ocs' host: 'localhost' (Got an error reading communication packets)
/var/log/messages | grep -i core
Sep 18 23:01:01 ocssrv01 systemd[1]: *Emails are not allowed*ice: Deactivated successfully.
Sep 19 05:01:02 ocssrv01 systemd[1]: Started Process Core Dump (PID 1788648/UID 0).
Sep 19 05:01:02 ocssrv01 systemd-coredump[1788649]: Resource limits disable core dumping for process 1784405 (/usr/sbin/httpd).
Sep 19 05:01:02 ocssrv01 systemd-coredump[1788649]: Process 1784405 (/usr/sbin/httpd) of user 48 dumped core.
Sep 19 05:01:02 ocssrv01 systemd[1]: *Emails are not allowed*ice: Deactivated successfully.
Sep 19 08:01:01 ocssrv01 systemd[1]: Started Process Core Dump (PID 1801522/UID 0).
Sep 19 08:01:01 ocssrv01 systemd-coredump[1801523]: Resource limits disable core dumping for process 1763034 (/usr/sbin/httpd).
Sep 19 08:01:01 ocssrv01 systemd-coredump[1801523]: Process 1763034 (/usr/sbin/httpd) of user 48 dumped core.
Sep 19 08:01:01 ocssrv01 systemd[1]: *Emails are not allowed*ice: Deactivated successfully.
Sep 19 11:01:03 ocssrv01 systemd[1]: Started Process Core Dump (PID 1814878/UID 0).
Sep 19 11:01:03 ocssrv01 systemd-coredump[1814879]: Resource limits disable core dumping for process 1812860 (/usr/sbin/httpd).
Sep 19 11:01:03 ocssrv01 systemd-coredump[1814879]: Process 1812860 (/usr/sbin/httpd) of user 48 dumped core.
cat /var/log/ocsinventory-server/activity.log | grep unix
Thu Sep 19 13:05:45 2024;1818461;315;*********-2024-05-10-13-07-17;********;OCS-NG_unified_unix_agent_v2.10.2;session;already handled
Thu Sep 19 13:05:45 2024;1818461;311;*********-2024-05-10-13-07-17;********;OCS-NG_unified_unix_agent_v2.10.2;session;started
Thu Sep 19 13:05:47 2024;1818461;1001;********-2024-05-13-07-42-11;********;OCS-NG_unified_unix_agent_v2.10.2;ipdiscover;checking if is enabled
Thu Sep 19 13:05:47 2024;1818461;100;*********-2024-05-13-07-42-11;********;OCS-NG_unified_unix_agent_v2.10.2;prolog;accepted
Thu Sep 19 13:05:47 2024;1818461;315;*********-2024-05-13-07-42-11;********;OCS-NG_unified_unix_agent_v2.10.2;session;already handled
Thu Sep 19 13:05:47 2024;1818461;311;*********-2024-05-13-07-42-11;*********;OCS-NG_unified_unix_agent_v2.10.2;session;started
we didn't find root causes at the moment.
On internet we just find this:
https://issueantenna.com/repo/ocsinventory-ng/ocsinventory-ocsreports/issues/1617#comments
Thank you
sergio
