Raspberry Pi / Raspbian reboot issue with SSD

I am getting occasional reboot issues with my RPi.

Running latest Raspbian, Pi4-4Gb, PNY SSD - booting from SD but /root on the SSD. Main running software is Home Assistant Supervised.

It looks like something causes the Pi to reboot, but the soft reboot does not succeed so the SSD is not available. Only fix is a hard reboot.

Any ideas what might be causing the original reboot?

On my investigations there are suggestions it could be due to /etc/fstab settings or the swapfile/swap partition.

debug log output

Apr 11 07:17:06 raspberrypi thd[359]: Found socket passed from systemd
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] On node 0 totalpages: 1012736
Apr 11 07:17:06 raspberrypi kernel: [    0.000000]   DMA zone: 1728 pages used for memmap
Apr 11 07:17:06 raspberrypi kernel: [    0.000000]   DMA zone: 0 pages reserved
Apr 11 07:17:06 raspberrypi kernel: [    0.000000]   DMA zone: 196608 pages, LIFO batch:63
Apr 11 07:17:06 raspberrypi kernel: [    0.000000]   HighMem zone: 816128 pages, LIFO batch:63
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] pcpu-alloc: s36928 r8192 d24512 u69632 alloc=17*4096
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
Apr 11 07:17:06 raspberrypi kernel: [    0.198541] PCI: CLS 0 bytes, default 64
Apr 11 07:17:06 raspberrypi kernel: [    0.298632] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
Apr 11 07:17:06 raspberrypi kernel: [    0.298771] pci 0000:00:00.0: PME# supported from D0 D3hot
Apr 11 07:17:06 raspberrypi kernel: [    0.301732] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
Apr 11 07:17:06 raspberrypi kernel: [    0.301857] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
Apr 11 07:17:06 raspberrypi kernel: [    0.302173] pci 0000:01:00.0: PME# supported from D0 D3cold
Apr 11 07:17:06 raspberrypi kernel: [    0.304936] pci_bus 0000:01: busn_res: [bus 01] end is updated to 01
Apr 11 07:17:06 raspberrypi kernel: [    0.397490] dwc_otg: FIQ enabled
Apr 11 07:17:06 raspberrypi kernel: [    0.397499] dwc_otg: NAK holdoff enabled
Apr 11 07:17:06 raspberrypi kernel: [    0.397508] dwc_otg: FIQ split-transaction FSM enabled
Apr 11 07:17:06 raspberrypi kernel: [    0.397520] Module dwc_common_port init
Apr 11 07:17:06 raspberrypi kernel: [    2.169455] sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
Apr 11 07:17:06 raspberrypi kernel: [   12.680139] brcmfmac: F1 signature read @0x18000000=0x15264345

syslog extract from that time. It looks to me that a soft reboot is initiated, but systemd seems to restart a number of services. Many of these log entries do not appear in the logs following a hard reboot.

The only thing in cron.hourly is the fake-hwclock.

Apr 11 07:17:02 raspberrypi CRON[31307]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Apr 11 07:17:06 raspberrypi fake-hwclock[97]: Sat 11 Apr 06:17:02 UTC 2020
Apr 11 07:17:06 raspberrypi systemd-fsck[125]: e2fsck 1.44.5 (15-Dec-2018)
Apr 11 07:17:06 raspberrypi systemd[1]: Started Set the console keyboard layout.
Apr 11 07:17:06 raspberrypi systemd[1]: Started udev Coldplug all Devices.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Helper to synchronize boot up for ifupdown...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Helper to synchronize boot up for ifupdown.
Apr 11 07:17:06 raspberrypi systemd-fsck[125]: /dev/sda1: clean, 395335/14655488 files, 4168032/58599574 blocks
Apr 11 07:17:06 raspberrypi systemd[1]: Started File System Check on Root Device.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Remount Root and Kernel File Systems...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Remount Root and Kernel File Systems.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Flush Journal to Persistent Storage...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Load/Save Random Seed...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Create System Users...
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Load/Save Random Seed.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Create System Users.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Flush Journal to Persistent Storage.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Create Static Device Nodes in /dev...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Create Static Device Nodes in /dev.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Local File Systems (Pre).
Apr 11 07:17:06 raspberrypi systemd[1]: Starting udev Kernel Device Manager...
Apr 11 07:17:06 raspberrypi systemd[1]: Started udev Kernel Device Manager.
Apr 11 07:17:06 raspberrypi systemd-udevd[160]: Using default interface naming scheme 'v240'.
Apr 11 07:17:06 raspberrypi systemd[1]: Found device /dev/serial1.
Apr 11 07:17:06 raspberrypi mtp-probe: checking bus 2, device 2: "/sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb2/2-1"
Apr 11 07:17:06 raspberrypi mtp-probe: bus: 2, device: 2 was not an MTP device
Apr 11 07:17:06 raspberrypi mtp-probe: checking bus 1, device 4: "/sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3"
Apr 11 07:17:06 raspberrypi mtp-probe: bus: 1, device: 4 was not an MTP device
Apr 11 07:17:06 raspberrypi mtp-probe: checking bus 1, device 6: "/sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.4"
Apr 11 07:17:06 raspberrypi mtp-probe: bus: 1, device: 6 was not an MTP device
Apr 11 07:17:06 raspberrypi systemd-udevd[154]: Using default interface naming scheme 'v240'.
Apr 11 07:17:06 raspberrypi systemd[1]: Found device /dev/disk/by-partuuid/56cd6262-01.
Apr 11 07:17:06 raspberrypi systemd[1]: Created slice system-bthelper.slice.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Huge Pages File System being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in FUSE Control File System being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting File System Check on /dev/disk/by-partuuid/56cd6262-01...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Load/Save RF Kill Switch Status...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Load/Save RF Kill Switch Status.
Apr 11 07:17:06 raspberrypi systemd-fsck[272]: fsck.fat 4.1 (2017-01-24)
Apr 11 07:17:06 raspberrypi systemd-fsck[272]: 0x41: Dirty bit is set. Fs was not properly unmounted and some data may be corrupt.
Apr 11 07:17:06 raspberrypi systemd-fsck[272]:  Automatically removing dirty bit.
Apr 11 07:17:06 raspberrypi systemd-fsck[272]: Performing changes.
Apr 11 07:17:06 raspberrypi systemd-fsck[272]: /dev/mmcblk0p1: 232 files, 106929/516190 clusters
Apr 11 07:17:06 raspberrypi systemd[1]: Started File System Check on /dev/disk/by-partuuid/56cd6262-01.
Apr 11 07:17:06 raspberrypi systemd[1]: Mounting /boot...
Apr 11 07:17:06 raspberrypi systemd[1]: Mounted /boot.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Local File Systems.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Preprocess NFS configuration...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Set console font and keymap...
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Commit a transient machine-id on disk being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Create Volatile Files and Directories...
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Load AppArmor profiles being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Raise network interfaces...
Apr 11 07:17:06 raspberrypi systemd[1]: nfs-config.service: Succeeded.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Preprocess NFS configuration.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in RPC security service for NFS client and server being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in RPC security service for NFS server being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target NFS client services.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Remote File Systems (Pre).
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Remote File Systems.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Set console font and keymap.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Create Volatile Files and Directories.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Network Time Synchronization...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Update UTMP about System Boot/Shutdown.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Raise network interfaces.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Network Time Synchronization.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target System Initialization.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Daily Cleanup of Temporary Directories.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Docker Socket for the API.
Apr 11 07:17:06 raspberrypi systemd[1]: Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
Apr 11 07:17:06 raspberrypi systemd[1]: Listening on D-Bus System Message Bus Socket.
Apr 11 07:17:06 raspberrypi systemd[1]: Listening on triggerhappy.socket.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target System Time Synchronized.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Daily man-db regeneration.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Daily rotation of log files.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Run certbot twice daily.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Daily apt download activities.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Daily apt upgrade and clean activities.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Timers.
Apr 11 07:17:06 raspberrypi systemd[1]: Listening on Docker Socket for the API.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Sockets.
Apr 11 07:17:06 raspberrypi systemd[1]: Reached target Basic System.
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Copy user wpa_supplicant.conf being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Bluetooth service...
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in Turn on SSH if /boot/ssh is present being skipped.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Check for Raspberry Pi EEPROM updates...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting rng-tools.service...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Modem Manager...
Apr 11 07:17:06 raspberrypi systemd[1]: Started Regular background program processing daemon.
Apr 11 07:17:06 raspberrypi systemd[1]: Started Manage Sound Card State (restore and store).
Apr 11 07:17:06 raspberrypi alsactl[345]: alsactl 1.1.8 daemon started
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Save/Restore Sound Card State...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting pywws weather station live logging...
Apr 11 07:17:06 raspberrypi cron[344]: (CRON) INFO (pidfile fd = 3)
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Hass.io AppArmor...
Apr 11 07:17:06 raspberrypi rpi-eeprom-update[338]: BCM2711 detected
Apr 11 07:17:06 raspberrypi systemd[1]: Starting System Logging Service...
Apr 11 07:17:06 raspberrypi rngd[351]: rngd 2-unofficial-mt.14 starting up...
Apr 11 07:17:06 raspberrypi rng-tools[339]: Starting Hardware RNG entropy gatherer daemon: rngd.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Configure Bluetooth Modems connected by UART...
Apr 11 07:17:06 raspberrypi cron[344]: (CRON) INFO (Running @reboot jobs)
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Certbot...
Apr 11 07:17:06 raspberrypi systemd[1]: Starting triggerhappy global hotkey daemon...
Apr 11 07:17:06 raspberrypi thd[359]: Found socket passed from systemd
Apr 11 07:17:06 raspberrypi systemd[1]: Condition check resulted in getty on tty2-tty6 if dbus and logind are not available being skipped.
Apr 11 07:17:06 raspberrypi avahi-daemon[363]: Found user 'avahi' (UID 108) and group 'avahi' (GID 113).
Apr 11 07:17:06 raspberrypi systemd[1]: Starting Restore /etc/resolv.conf if the system crashed before the ppp link was shut down...
Apr 11 07:17:06 raspberrypi avahi-daemon[363]: Successfully dropped root privileges.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting LSB: Switch to ondemand cpu governor (unless shift key is pressed)...
Apr 11 07:17:06 raspberrypi avahi-daemon[363]: avahi-daemon 0.7 starting up.
Apr 11 07:17:06 raspberrypi systemd[1]: Starting dphys-swapfile - set up, mount/unmount, and delete a swap file...
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] Booting Linux on physical CPU 0x0
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] Linux version 4.19.97-v7l+ (dom@buildbot) (gcc version 4.9.3 (crosstool-NG crosstool-ng-1.22.0-88-g8460611)) #1294 SMP Thu Jan 30 13:21:14 GMT 2020
Apr 11 07:17:06 raspberrypi kernel: [    0.000000] CPU: ARMv7 Processor [410fd083] revision 3 (ARMv7), cr=30c5383d

[edit - 19 Apr]

I may have tracked down the root cause - I think a call to fake-hwclock may have been causing the issue, with that cron job causing a soft reboot as the time returned was out.

For now I have commented out the contents of the script in corn (rather than remove it) and I will see if the system is more stable.

fake-hwclock is now superfluous in Raspbian as the systemd-timesyncd service keeps time for you and restores it on boot.

[edit - 4 May 2020]

I have completely removed the fake-hwclock package as it seemed to still be called from somewhere. So far things looking good.