Spontaneous(?) silent unmount

[evanfields]

Mountpoint for Amazon S3 version

mount-s3 1.10.0

AWS Region

us-east-1

Describe the running environment

• EC2 instance with type c7a.[k]xlarge in us-east-1f
• Running Amazon Linux:

  NAME="Amazon Linux"
  VERSION="2023"
  ID="amzn"
  ID_LIKE="fedora"
  VERSION_ID="2023"
  PLATFORM_ID="platform:al2023"
  PRETTY_NAME="Amazon Linux 2023.5.20240722"
  ANSI_COLOR="0;33"
  CPE_NAME="cpe:2.3:o:amazon:amazon_linux:2023"
  HOME_URL="https://aws.amazon.com/linux/amazon-linux-2023/"
  DOCUMENTATION_URL="https://docs.aws.amazon.com/linux/"
  SUPPORT_URL="https://aws.amazon.com/premiumsupport/"
  BUG_REPORT_URL="https://github.com/amazonlinux/amazon-linux-2023"
  VENDOR_NAME="AWS"
  VENDOR_URL="https://aws.amazon.com/"
  SUPPORT_END="2028-03-15"
  

• Mountpoint gets AWS creds from environment variables
• the mount-s3 command is in my .bash_profile

Mountpoint options

mount-s3 --allow-delete --region us-east-1 <my-bucket> ~/<bucket-name>

What happened?

I do most of my development work SSH'd into an EC2 instance. I have a mount-s3 command in my ~/.bash_profile to mount my bucket on login. About twice per working day I find that my bucket is no longer mounted.

• Sometimes this happens in the middle of S3 intensive (mostly read intensive -- streaming zstd compressed files) workflows, but sometimes it happens when I'm not obviously using the bucket at all.
• Remounting the bucket with the same mount-s3 command works just fine for another few hours, until another spontaneous unmount.
• I don't see any obvious output or warnings when the bucket unmounts, just my next attempt to access it fails.
• I haven't been able to reproduce this on demand, though it happens daily.
• The last line in the attached log looks like systemd shutting down the mount. I haven't intentionally configured systemd to deactivate any mounts, and Claude-guided exploration (confess this is not my expertise) doesn't show any relevant configurations to this effect.

Relevant log output

$ journalctl --since "2024-11-19 00:00:00" | grep -i "mount"
Nov 19 15:14:16 localhost kernel: Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
Nov 19 15:14:16 localhost kernel: Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
Nov 19 15:14:17 localhost systemd[1]: dracut-pre-mount.service - dracut pre-mount hook was skipped because no trigger condition checks were met.
Nov 19 15:14:17 localhost systemd[1]: Mounting sysroot.mount - /sysroot...
Nov 19 15:14:17 localhost kernel: XFS (nvme0n1p1): Mounting V5 Filesystem
Nov 19 15:14:17 localhost systemd[1]: Mounted sysroot.mount - /sysroot.
Nov 19 15:14:17 localhost systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root...
Nov 19 15:14:17 localhost kernel: XFS (nvme0n1p1): Ending clean mount
Nov 19 15:14:17 localhost systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root.
Nov 19 15:14:17 localhost systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting tmp.mount - Temporary Directory /tmp...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted tmp.mount - Temporary Directory /tmp.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems...
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: Set up automount boot-efi.automount.
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id).
Nov 19 15:14:18 ip-<EC2-IP>.ec2.internal systemd[1]: boot-efi.automount: Got automount request for /boot/efi, triggered by 2457 (bootctl)
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id).
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id).
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting boot-efi.mount - /boot/efi...
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: Mounting var-lib-nfs-rpc_pipefs.mount - RPC Pipe File System...
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted boot-efi.mount - /boot/efi.
Nov 19 15:14:19 ip-<EC2-IP>.ec2.internal systemd[1]: Mounted var-lib-nfs-rpc_pipefs.mount - RPC Pipe File System.
Nov 19 15:24:40 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] getxattr{req=352394 ino=1 name="system.posix_acl_access"}: mountpoint_s3::fuse: getxattr failed: operation not supported by Mountpoint
Nov 19 15:29:59 ip-<EC2-IP>.ec2.internal systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully.
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721530 ino=89 fh=91 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721552 ino=90 fh=92 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721566 ino=91 fh=93 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721586 ino=92 fh=96 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721658 ino=93 fh=97 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721728 ino=94 fh=98 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721756 ino=95 fh=99 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=721764 ino=96 fh=100 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=830734 ino=97 fh=102 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=835006 ino=98 fh=103 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=837266 ino=99 fh=105 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=841454 ino=100 fh=108 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=842494 ino=101 fh=109 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=843054 ino=102 fh=111 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=843124 ino=103 fh=114 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:37 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=847102 ino=104 fh=116 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:46 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=945184 ino=105 fh=117 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:46 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=945458 ino=106 fh=118 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:46 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=946454 ino=107 fh=121 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=947858 ino=108 fh=123 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:49 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=963196 ino=109 fh=125 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:49 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=967020 ino=110 fh=127 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=969604 ino=111 fh=129 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:54 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1009536 ino=112 fh=131 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:58 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1057762 ino=113 fh=134 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:58 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1060748 ino=114 fh=136 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:58 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1061200 ino=115 fh=137 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:32:59 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1062394 ino=116 fh=140 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:00 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1073584 ino=117 fh=142 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:05 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1122622 ino=118 fh=143 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:06 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1132320 ino=119 fh=144 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:07 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1139122 ino=120 fh=148 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:09 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1156524 ino=121 fh=150 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:11 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1177716 ino=122 fh=151 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:11 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1179880 ino=123 fh=153 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:11 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1180806 ino=124 fh=155 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:12 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1188670 ino=125 fh=157 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:17 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1242330 ino=126 fh=160 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:18 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1246808 ino=127 fh=162 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:18 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1247212 ino=128 fh=164 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:20 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1265762 ino=129 fh=166 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1295726 ino=130 fh=168 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:24 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1304502 ino=131 fh=169 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:25 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1310714 ino=132 fh=172 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:25 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1312428 ino=133 fh=173 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:30 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1360840 ino=134 fh=175 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:30 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1367474 ino=135 fh=178 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:31 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1371612 ino=136 fh=180 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:32 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1383552 ino=137 fh=181 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1418774 ino=138 fh=183 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:37 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1430486 ino=139 fh=186 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:37 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1431980 ino=140 fh=187 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:38 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1434532 ino=141 fh=189 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:42 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1478378 ino=142 fh=191 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:43 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1487712 ino=143 fh=193 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:43 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1490760 ino=144 fh=196 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:45 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1501188 ino=145 fh=198 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1555788 ino=146 fh=201 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1556120 ino=147 fh=202 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1556516 ino=148 fh=204 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1557018 ino=149 fh=206 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:55 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1606114 ino=150 fh=208 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:56 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1608124 ino=151 fh=210 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:56 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1612662 ino=152 fh=211 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:33:57 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1621008 ino=153 fh=214 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1660422 ino=154 fh=215 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1674660 ino=155 fh=218 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1674926 ino=156 fh=219 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1677494 ino=157 fh=221 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:08 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1727330 ino=158 fh=224 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:08 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1728046 ino=159 fh=226 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1742424 ino=160 fh=229 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1743264 ino=161 fh=230 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1801092 ino=162 fh=231 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1804194 ino=163 fh=234 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1805022 ino=164 fh=236 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1805292 ino=165 fh=237 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1859118 ino=166 fh=242 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1860238 ino=167 fh=243 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1860630 ino=168 fh=244 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1862034 ino=169 fh=245 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:34:26 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=1903068 ino=170 fh=247 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698690 ino=371 fh=416 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698702 ino=372 fh=418 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698718 ino=373 fh=420 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698732 ino=374 fh=421 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698748 ino=375 fh=422 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698780 ino=376 fh=423 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698870 ino=377 fh=424 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2698896 ino=378 fh=425 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2818304 ino=379 fh=427 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2818460 ino=380 fh=428 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2820472 ino=381 fh=430 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2822176 ino=382 fh=433 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2822560 ino=383 fh=435 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2823524 ino=384 fh=436 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:49 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2827994 ino=385 fh=439 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:49 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2829228 ino=386 fh=440 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:59 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2935112 ino=387 fh=443 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:59 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2937216 ino=388 fh=444 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:59 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2940794 ino=389 fh=446 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:57:59 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2943066 ino=390 fh=448 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:00 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2947388 ino=391 fh=451 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2951990 ino=392 fh=452 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2963762 ino=393 fh=454 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=2964296 ino=394 fh=457 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3052802 ino=395 fh=459 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3054910 ino=396 fh=461 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:12 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3065592 ino=397 fh=463 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:12 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3073234 ino=398 fh=464 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:13 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3073664 ino=399 fh=466 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:13 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3074554 ino=400 fh=468 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:14 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3085466 ino=401 fh=471 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3100052 ino=402 fh=472 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3175308 ino=403 fh=474 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3182374 ino=404 fh=476 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3183478 ino=405 fh=479 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:24 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3188618 ino=406 fh=481 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:24 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3193828 ino=407 fh=482 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:25 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3197098 ino=408 fh=484 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:28 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3225482 ino=409 fh=487 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:30 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3244446 ino=410 fh=488 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3298724 ino=411 fh=490 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3312076 ino=412 fh=494 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3312242 ino=413 fh=495 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3314166 ino=414 fh=497 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:37 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3323796 ino=415 fh=498 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:38 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3328520 ino=416 fh=500 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:40 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3348286 ino=417 fh=503 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:41 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3356194 ino=418 fh=505 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:46 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3419238 ino=419 fh=506 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3440380 ino=420 fh=509 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3440608 ino=421 fh=511 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3440938 ino=422 fh=512 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3451582 ino=423 fh=515 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3455330 ino=424 fh=516 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:52 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3474158 ino=425 fh=518 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:53 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3479254 ino=426 fh=521 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:58:58 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3541234 ino=427 fh=523 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3568148 ino=428 fh=525 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3568526 ino=429 fh=526 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3568818 ino=430 fh=528 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:02 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3576500 ino=431 fh=530 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3584642 ino=432 fh=532 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:04 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3600404 ino=433 fh=534 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:05 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3601870 ino=434 fh=536 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:11 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3670680 ino=435 fh=539 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:12 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3688994 ino=436 fh=542 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:13 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3689642 ino=437 fh=543 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:13 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3690510 ino=438 fh=544 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:14 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3699292 ino=439 fh=547 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:18 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3742638 ino=440 fh=548 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:19 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3751352 ino=441 fh=549 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:19 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3754108 ino=442 fh=553 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3789408 ino=443 fh=554 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3791558 ino=444 fh=557 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3793876 ino=445 fh=558 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:23 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3796236 ino=446 fh=561 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:27 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3831438 ino=447 fh=562 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:31 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3873818 ino=448 fh=565 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:31 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3874046 ino=449 fh=566 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:31 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3881090 ino=450 fh=568 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3914904 ino=451 fh=571 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 15:59:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=3917286 ino=452 fh=572 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709134 ino=454 fh=661 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709166 ino=455 fh=666 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709172 ino=456 fh=668 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709208 ino=457 fh=669 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709316 ino=458 fh=670 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709364 ino=459 fh=671 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709376 ino=460 fh=672 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4709384 ino=461 fh=673 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:52 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4805294 ino=462 fh=675 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:52 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4805950 ino=463 fh=676 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:53 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4810244 ino=464 fh=678 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:53 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4814172 ino=465 fh=681 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:54 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4818312 ino=466 fh=682 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:55 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4819358 ino=467 fh=685 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:55 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4819832 ino=468 fh=687 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:55:56 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4821240 ino=469 fh=689 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:05 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4904696 ino=470 fh=690 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:06 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4907778 ino=471 fh=693 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:06 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4911326 ino=472 fh=694 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:07 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4913834 ino=473 fh=697 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:08 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4924028 ino=474 fh=699 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4930358 ino=475 fh=700 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4931682 ino=476 fh=702 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:12 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=4944166 ino=477 fh=705 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:19 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5012808 ino=478 fh=706 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:20 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5018156 ino=479 fh=709 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:20 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5020572 ino=480 fh=710 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:21 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5023014 ino=481 fh=712 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:22 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5028976 ino=482 fh=715 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:24 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5040686 ino=483 fh=717 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:25 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5043154 ino=484 fh=718 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:28 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5069256 ino=485 fh=721 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5126338 ino=486 fh=722 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5129966 ino=487 fh=724 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5131890 ino=488 fh=727 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:34 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5132874 ino=489 fh=728 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:36 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5143062 ino=490 fh=731 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:38 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5154086 ino=491 fh=733 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:40 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5165516 ino=492 fh=734 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:41 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5171368 ino=493 fh=737 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5226242 ino=494 fh=739 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:48 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5235830 ino=495 fh=741 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:49 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5245942 ino=496 fh=742 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5250742 ino=497 fh=745 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5253980 ino=498 fh=747 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:53 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5265810 ino=499 fh=749 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:53 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5266856 ino=500 fh=750 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:56:55 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5278574 ino=501 fh=752 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5335980 ino=502 fh=755 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:01 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5337850 ino=503 fh=756 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:03 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5355228 ino=504 fh=759 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:04 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5361142 ino=505 fh=760 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:05 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5364418 ino=506 fh=763 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:07 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5374990 ino=507 fh=764 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:07 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5376632 ino=508 fh=766 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:10 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5392904 ino=509 fh=769 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:15 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5439822 ino=510 fh=771 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:16 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5453168 ino=511 fh=773 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:18 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5470552 ino=512 fh=775 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:19 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5471154 ino=513 fh=776 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:19 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5474942 ino=514 fh=779 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:21 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5486732 ino=515 fh=782 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:21 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5486958 ino=516 fh=783 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:24 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5498880 ino=517 fh=785 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:29 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5550208 ino=518 fh=786 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:30 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5562242 ino=519 fh=789 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:33 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5582298 ino=520 fh=791 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:33 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5585302 ino=521 fh=794 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:33 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5585454 ino=522 fh=795 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5597322 ino=523 fh=797 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:35 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5597966 ino=524 fh=799 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:39 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5617940 ino=525 fh=800 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:43 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5657118 ino=526 fh=803 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:44 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5668748 ino=527 fh=805 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5691712 ino=528 fh=807 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5693132 ino=529 fh=808 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:47 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5695750 ino=530 fh=811 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5710184 ino=531 fh=813 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:50 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5710734 ino=532 fh=814 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:54 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5735932 ino=533 fh=817 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:57 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5766736 ino=534 fh=819 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 16:57:58 ip-<EC2-IP>.ec2.internal mount-s3[4475]: [WARN] ioctl{req=5769988 ino=535 fh=820 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint
Nov 19 18:55:42 ip-<EC2-IP>.ec2.internal systemd[1]: home-ec2\x2duser-<MY-BUCKET-NAME>.mount: Deactivated successfully.

[dannycjones]

@evanfields thanks for opening the issue, I have a few suggestions.

• Can you configure debug logging to a file (since it can be noisy) such that we can see additional information from Mountpoint prior to the apparent unmount. This should look something like --debug --log-directory <somewhere-on-instance>. Please share it here (redacting some information if needed). You can read more about logging here: https://github.com/awslabs/mountpoint-s3/blob/main/doc/LOGGING.md
• Can you check dmesg to see if there's any messages related to Mountpoint there? (It's unclear to me if this log content will overlap with syslog, but syslog doesn't seem to share much useful right now.)
• Can you share how you actually invoke the mount? Is it just invoking the CLI in your Bash profile or activating a systemd unit? Can you share the unit definition if its the latter?

Thanks!

[evanfields]

Hey @dannycjones thanks for the swift response!

Can you share how you actually invoke the mount?

My bash profile has:

eval "$(aws configure export-credentials --format env)"
...
mount-s3 --allow-delete --region us-east-1 <bucket-name> ~/<bucket-name>

dmesg

I stop the instance overnight so nothing right now (fresh start), will report back if there's something there that doesn't look like the above logs.

I've configured debug logging to a file and will share it once I see another unmount. Thanks!

[evanfields]

@dannycjones first unmount didn't take long today 🤷‍♂️
Around that time I was doing git operations in a directory outside the mounted bucket, but with symlinks into the mounted bucket.

dmesg:

$ sudo dmesg -T | grep -iE 'mountpoint|s3|mount-s3|mount'
[Wed Nov 20 15:15:59 2024] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[Wed Nov 20 15:15:59 2024] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[Wed Nov 20 15:16:00 2024] XFS (nvme0n1p1): Mounting V5 Filesystem
[Wed Nov 20 15:16:00 2024] XFS (nvme0n1p1): Ending clean mount
[Wed Nov 20 15:16:01 2024] systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting tmp.mount - Temporary Directory /tmp...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted tmp.mount - Temporary Directory /tmp.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System...
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System.
[Wed Nov 20 15:16:01 2024] systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System.

Slightly redacted log file: attached
mountpoint-s3-2024-11-20T15-16-25Z.rJ5a9D_redacted.log

[dannycjones]

Sorry for the delayed response - are you still impacted by this issue?

Reviewing the Mountpoint logs, it appears to be unmounting cleanly due to it being requested to unmount.

I see in the original logs that it appeared to be unmounted by systemd.

Nov 19 18:55:42 ip-<EC2-IP>.ec2.internal systemd[1]: home-ec2\x2duser-<MY-BUCKET-NAME>.mount: Deactivated successfully.

I think to further debug, we'd need to dig into why systemd was deactivating that unit. From our side, Mountpoint appears to be working fine.

[evanfields]

No worries @dannycjones and thanks for the response. Yep, I'm still affected by the issue. Let me know any suggestions on what to look for or where to look for it!

[dannycjones]

There's a few areas here.

• Why is there a systemd mount unit (home-ec2\x2duser-<MY-BUCKET-NAME>.mount)? If I understood correctly, these are created by hand or by fstab, have you used either of these for Mountpoint?
• Why is Mountpoint being unmounted? (journalctl, systemctl status home-ec2\x2duser-<MY-BUCKET-NAME>.mount, dmesg). It may be useful to look not only for Mountpoint but also anything like "killed process", or just exploring the logs around the time of unmount.
• What does the mount unit look like? (systemctl show home-ec2\x2duser-<MY-BUCKET-NAME>.mount, systemctl cat home-ec2\x2duser-<MY-BUCKET-NAME>.mount)
• Anything else interesting from systemd. (systemctl list-automounts)