The logs ... ahh, duh. I am a idiot
Anyway, I reboot it, I am able to write some files, then it errors out again. Here are the logs from this error....
E - Please umount the filesystem, and rectify the problem(s) kernel 09/12 02:02:26
E - Filesystem "dm-0": Corruption of in-memory data detected. Shutting down filesystem: dm-0 kernel 09/12 02:02:26
E - Filesystem "dm-0": XFS internal error xfs_trans_cancel at line 1031 of file fs/xfs/xfs_trans.c. Caller 0x782265e7 kernel 09/12 02:02:25
E - Filesystem "dm-0": XFS internal error xfs_alloc_read_agf at line 2173 of file fs/xfs/xfs_alloc.c. Caller 0x781cc1fb kernel 09/12 02:02:25
E - 0x0: 58 41 47 46 00 00 00 01 00 00 00 0c 00 6f 5f f0 kernel 09/12 02:02:25
So, it seems something is wrong with the XFS file system install? (this has been running flawless for a long time now (minus a drive going back which is easy to replace/rebuild)) If you can shed any advice on how to recover I would be very very grateful. Thanks in advance!!