Page 1 of 1

Segfault Errors

Posted: Thu 18. Jul 2019, 11:54
by christian.john
Hallo,

ich habe das Problem, dass mir ab und zu das Control-Panel mit einem "Service Unavailable" und einem Segfault-Error in den Logs wegfliegt.

Server: Debian 9.9
Keyhelp 9.1 (ich habe das Update noch nicht manuell angestoßen)
CPU-Kerne: 4x
RAM: 16 GB
free -m -h

Code: Select all

              total        used        free      shared  buff/cache   available
Mem:            15G        2.1G        465M        364M         13G         13G
Swap:           15G        3.1M         15G

Datei: /var/log/messages

Code: Select all

Jul 18 10:43:23 mail kernel: [523984.361299] keyhelp-php70-f[5553]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5ca0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 10:55:01 mail kernel: [524682.670524] keyhelp-php70-f[6319]: segfault at 10 ip 000055693e72d84e sp 00007ffe7f2d5cd0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 11:23:01 mail kernel: [526362.063807] keyhelp-php70-f[8445]: segfault at 1000000020 ip 000055693e7c9627 sp 00007ffe7f2d5f38 error 6 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 11:39:17 mail kernel: [527338.280338] php-fpm7.0[9813]: segfault at 18 ip 000055ffce4bf5f0 sp 00007ffd5987fe80 error 4 in php-fpm7.0[55ffce296000+3a8000]
Datei: /var/log/php7.0-fpm.log

Code: Select all

[17-Jul-2019 1[code]
7:15:06] NOTICE: systemd monitor interval set to 10000ms
[18-Jul-2019 11:39:17] WARNING: [pool keyhelp] child 9813 exited on signal 11 (SIGSEGV) after 8.059987 seconds from start
[18-Jul-2019 11:39:17] NOTICE: [pool keyhelp] child 9816 started
[/code]

Datei: /var/log/apache2/error.log

Code: Select all

[Thu Jul 18 06:25:03.985630 2019] [ssl:warn] [pid 24409:tid 140323513438272] AH01909: webmail:443:0 server certificate does NOT include an ID which matches the server name
[Thu Jul 18 06:25:04.511485 2019] [mpm_worker:notice] [pid 24409:tid 140323513438272] AH00292: Apache/2.4.25 (Debian) mod_fcgid/2.3.9 OpenSSL/1.0.2s configured -- resuming normal operations
[Thu Jul 18 06:25:04.511513 2019] [core:notice] [pid 24409:tid 140323513438272] AH00094: Command line: '/usr/sbin/apache2'
[Thu Jul 18 06:25:04.511533 2019] [mpm_worker:warn] [pid 24409:tid 140323513438272] AH00291: long lost child came home! (pid 30274)
[Thu Jul 18 06:25:04.511547 2019] [mpm_worker:warn] [pid 24409:tid 140323513438272] AH00291: long lost child came home! (pid 30275)
Datei: /var/log/apache2/keyhelp/error.log

Code: Select all

[Tue Jul 16 18:49:44.365997 2019] [proxy_fcgi:error] [pid 8944:tid 140322805831424] [client 199.249.230.121:24532] AH01071: Got error 'Primary script unknown\n'
[Wed Jul 17 04:30:54.313634 2019] [proxy_fcgi:error] [pid 8944:tid 140322814224128] [client 77.247.110.186:56194] AH01071: Got error 'Primary script unknown\n'
[Thu Jul 18 11:39:17.268032 2019] [proxy_fcgi:error] [pid 18221:tid 140322805831424] [client 94.130.113.90:43448] AH01067: Failed to read FastCGI header
[Thu Jul 18 11:39:17.276658 2019] [proxy_fcgi:error] [pid 18221:tid 140322805831424] (104)Connection reset by peer: [client 94.130.113.90:43448] AH01075: Error dispatching request to :
Alle Dienste starten mit einem OK neu:

Code: Select all

root@mail:/etc/init.d# /etc/init.d/php7.0-fpm restart
[ ok ] Restarting php7.0-fpm (via systemctl): php7.0-fpm.service.
root@mail:/etc/init.d# /etc/init.d/keyhelp-php70-fpm restart
[ ok ] Restarting keyhelp-php70-fpm (via systemctl): keyhelp-php70-fpm.service.
root@mail:/etc/init.d# /etc/init.d/keyhelp-php71-fpm restart
[ ok ] Restarting keyhelp-php71-fpm (via systemctl): keyhelp-php71-fpm.service.
root@mail:/etc/init.d# /etc/init.d/keyhelp-php72-fpm restart
[ ok ] Restarting keyhelp-php72-fpm (via systemctl): keyhelp-php72-fpm.service.
root@mail:/etc/init.d# /etc/init.d/keyhelp-php73-fpm restart
[ ok ] Restarting keyhelp-php73-fpm (via systemctl): keyhelp-php73-fpm.service.
Ändern tut sich nichts. Ein Reboot hilft.

Hat jemand eine Idee, wie ich hier weiter vorgehen kann?

Danke uns beste Grüße, Christian

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 12:04
by Jolinar
Stehen im kern.log zum fraglichen Zeitpunkt eventuell noch relevante Infos?

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 12:21
by christian.john
Ja, ansonsten

Code: Select all

/var/log/kern.log
Jul 17 16:25:54 mail kernel: [458135.786047] traps: mc[20046] trap int3 ip:7f68c0a49261 sp:7fff8c13b360 error:0
Jul 17 16:25:54 mail kernel: [458135.786059]  in libglib-2.0.so.0.5000.3[7f68c09f9000+112000]

Jul 18 02:08:50 mail kernel: [493111.113250] keyhelp-php70-f[2380]: segfault at 10000020f ip 000055693e7c9627 sp 00007ffe7f2d7c28 error 6 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 02:12:15 mail kernel: [493316.385759] keyhelp-php70-f[2652]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5d60 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 02:24:07 mail kernel: [494028.402340] keyhelp-php70-f[3231]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d6240 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 03:28:21 mail kernel: [497882.202684] php[7060]: segfault at 18 ip 000055a37efd1e60 sp 00007ffe0a95f970 error 4 in php7.0[55a37ed9d000+3aa000]
Jul 18 03:32:41 mail kernel: [498142.982617] keyhelp-php70-f[7635]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5d60 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 03:42:46 mail kernel: [498747.444140] keyhelp-php71-f[8296]: segfault at 8 ip 000055d2c0f3d930 sp 00007fff96f88b18 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 04:01:43 mail kernel: [499884.778609] keyhelp-php71-f[9346]: segfault at 18 ip 000055d2c0f025d0 sp 00007fff96f889d0 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 04:53:25 mail kernel: [502986.200710] traps: keyhelp-php70-f[12669] general protection ip:55693e77caa8 sp:7ffe7f2d5aa0 error:0
Jul 18 04:53:25 mail kernel: [502986.200724]  in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 04:53:26 mail kernel: [502987.861484] keyhelp-php70-f[12670]: segfault at 8 ip 000055693e77beb3 sp 00007ffe7f2d7ec0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 05:24:39 mail kernel: [504860.392407] keyhelp-php70-f[14421]: segfault at 69 ip 000055693e77caa8 sp 00007ffe7f2d58c0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 05:54:47 mail kernel: [506668.093250] keyhelp-php71-f[16344]: segfault at 18 ip 000055d2c0f025d0 sp 00007fff96f889d0 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 06:21:37 mail kernel: [508278.869258] keyhelp-php70-f[17937]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5cd0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 06:23:27 mail kernel: [508388.693442] keyhelp-php71-f[18011]: segfault at 8 ip 000055d2c0f3d930 sp 00007fff96f88b18 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 07:10:53 mail kernel: [511234.822282] keyhelp-php70-f[21523]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5e10 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 07:11:19 mail kernel: [511260.381924] keyhelp-php70-f[21559]: segfault at 7f940000001a ip 000055693e6a65c7 sp 00007ffe7f2d5ea0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 07:11:19 mail kernel: [511260.473626] keyhelp-php70-f[21560]: segfault at 7f940000001a ip 000055693e6a65c7 sp 00007ffe7f2d5ea0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 07:24:10 mail kernel: [512031.255631] php[22434]: segfault at 18 ip 00005566aa261e60 sp 00007ffd51126920 error 4 in php7.0[5566aa02d000+3aa000]
Jul 18 07:29:37 mail kernel: [512358.227719] keyhelp-php71-f[23014]: segfault at 18 ip 000055d2c0f025d0 sp 00007fff96f889d0 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 08:08:29 mail kernel: [514690.699317] keyhelp-php70-f[25492]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5f50 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 08:12:52 mail kernel: [514953.088299] keyhelp-php71-f[25822]: segfault at 8 ip 000055d2c0f3d930 sp 00007fff96f88b18 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 08:32:18 mail kernel: [516120.008970] keyhelp-php70-f[27484]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5e70 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 08:41:03 mail kernel: [516644.174313] keyhelp-php71-f[25823]: segfault at 8 ip 000055d2c0f3d930 sp 00007fff96f88b18 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 08:46:15 mail kernel: [516956.804035] keyhelp-php72-f[28382]: segfault at 1c ip 00005628cc423c20 sp 00007ffe7c82fcc0 error 4 in keyhelp-php72-fpm[5628cbec4000+e12000]
Jul 18 08:58:02 mail kernel: [517663.276151] keyhelp-php71-f[29180]: segfault at 18 ip 000055d2c0f025d0 sp 00007fff96f889d0 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 08:58:02 mail kernel: [517663.360911] keyhelp-php71-f[29181]: segfault at 8 ip 000055d2c0f3d930 sp 00007fff96f88b18 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 09:06:43 mail kernel: [518184.324613] keyhelp-php70-f[29866]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5aa0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:08:09 mail kernel: [518270.362078] keyhelp-php70-f[29960]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5d60 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:08:09 mail kernel: [518270.731979] keyhelp-php70-f[29961]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5d60 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:08:10 mail kernel: [518271.108957] keyhelp-php70-f[29964]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5d60 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:17:13 mail kernel: [518814.988720] keyhelp-php70-f[30585]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5f10 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:28:58 mail kernel: [519519.546805] keyhelp-php70-f[31381]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5cd0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 09:45:21 mail kernel: [520502.562579] keyhelp-php72-f[376]: segfault at 48 ip 00007fdd71f61e9f sp 00007ffe7c82ea60 error 4 in opcache.so[7fdd71f34000+62000]
Jul 18 09:56:42 mail kernel: [521183.839511] keyhelp-php71-f[1451]: segfault at 18 ip 000055d2c0f025d0 sp 00007fff96f889d0 error 4 in keyhelp-php71-fpm[55d2c0a11000+bc3000]
Jul 18 10:06:20 mail kernel: [521761.134692] keyhelp-php70-f[2139]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5e20 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 10:36:25 mail kernel: [523566.846943] keyhelp-php70-f[4977]: segfault at 69 ip 000055693e77caa8 sp 00007ffe7f2d5b80 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 10:41:04 mail kernel: [523845.530386] traps: keyhelp-php70-f[5326] general protection ip:55693e733976 sp:7ffe7f2d5da0 error:0
Jul 18 10:41:04 mail kernel: [523845.530399]  in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 10:43:23 mail kernel: [523984.361299] keyhelp-php70-f[5553]: segfault at 18 ip 000055693e77caa8 sp 00007ffe7f2d5ca0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 10:55:01 mail kernel: [524682.670524] keyhelp-php70-f[6319]: segfault at 10 ip 000055693e72d84e sp 00007ffe7f2d5cd0 error 4 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 11:23:01 mail kernel: [526362.063807] keyhelp-php70-f[8445]: segfault at 1000000020 ip 000055693e7c9627 sp 00007ffe7f2d5f38 error 6 in keyhelp-php70-fpm[55693e295000+ba0000]
Jul 18 11:39:17 mail kernel: [527338.280338] php-fpm7.0[9813]: segfault at 18 ip 000055ffce4bf5f0 sp 00007ffd5987fe80 error 4 in php-fpm7.0[55ffce296000+3a8000]
Jul 18 11:52:19 mail kernel: [528120.983134] php-fpm7.0[10830]: segfault at 18 ip 000055ffce4bf5f0 sp 00007ffd5987fd40 error 4 in php-fpm7.0[55ffce296000+3a8000]
Jul 18 11:52:23 mail kernel: [528124.022112] php-fpm7.0[10864]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2efe00 error 4 in php-fpm7.0[556d40de8000+3a8000]
Jul 18 11:52:24 mail kernel: [528125.064055] php-fpm7.0[10865]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2efe00 error 4 in php-fpm7.0[556d40de8000+3a8000]
Jul 18 11:52:28 mail kernel: [528129.762550] php-fpm7.0[10866]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2eff40 error 4 in php-fpm7.0[556d40de8000+3a8000]
Jul 18 11:52:29 mail kernel: [528130.875613] php-fpm7.0[10917]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2efe00 error 4 in php-fpm7.0[556d40de8000+3a8000]
Jul 18 11:52:50 mail kernel: [528151.110162] php-fpm7.0[11002]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2efe00 error 4 in php-fpm7.0[556d40de8000+3a8000]
Jul 18 11:52:51 mail kernel: [528152.073154] php-fpm7.0[11066]: segfault at 18 ip 0000556d410115f0 sp 00007ffc2d2efe00 error 4 in php-fpm7.0[556d40de8000+3a8000]

=> REBOOT

Jul 18 11:53:45 mail kernel: [    0.000000] Linux version 4.9.0-7-amd64 (debian-kernel@lists.debian.org) (gcc version 6.3.0 20170516 (Debian 6.3.0-18+deb9u1) ) #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13)

Als Hinweis noch:
das ganze läuft in einer XEN-virtualiserten VM mit LVM und ext4 Dateisystem.
XEN / LVM habe bisher mit Confixx / Plesk insgesamt über 10 Jahre ohne Probleme betrieben...

Ich bin hier allerdings gerade etwas ratlos.

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 12:39
by Jolinar
Hmm...Sagt auch nicht mehr aus.
Hast du schon mal das Loglevel für PHP hochgesetzt (error_reporting = E_ALL)?

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 13:00
by christian.john
Hallo,

nein noch nicht.
Es ist auch nur PHP 7.0 und ein zwei Benutzer mit den PHP7.0-Versionen betroffen.
Benutzer mit 7.2 oder 5.6 laufen weiterhin....

Ich werde da die Log-Level nochmal hochsetzen und weiter die Augen und Ohren offen halten und googlen.
Falls jemand Tips hat, ich wäre sehr dankbar!

Christian

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 13:10
by Jolinar
christian.john wrote: Thu 18. Jul 2019, 13:00 Es ist auch nur PHP 7.0 und ein zwei Benutzer mit den PHP7.0-Versionen betroffen.
Benutzer mit 7.2 oder 5.6 laufen weiterhin....
Ich hatte so ein ähnliches Verhalten vor längerer Zeit auch einmal. In dem Fall war der PHP-Interpreter Amok gelaufen, weil ein Script massig deprecated-Warnungen generiert und so den Interpreter in die Knie gezwungen hatte (nur so als möglichen Hinweis bei deiner Fehlersuche).

Re: Segfault Errors

Posted: Thu 18. Jul 2019, 16:14
by christian.john
Oh super. Danke für den Hinweis!