Full ERROR Message Example
Failed to delete hint file 7019c9eb-ba76-4f8e-ad28-3e6cde38e992-1550699897353-1.hints
What does this ERROR message mean?
The error indicates a hints file could not be deleted from disk.
Why does this ERROR occur?
A disk problem or permissions issue will need to occur on the hints directory or file after the hint is sent to its destination node, but before the hints file deletion occurs. This is especially true for directory permissions where missing write permissions will prevent file deletion. However, prior to a hint being sent to its destination node, a crc32 file will be written to the hints directory. This file can't be written if write permissions are missing from the hints directory. Therefore, the directory permissions would need to change after this the crc32 file is written in order for this to be a cause of the file deletion error.
How do you fix this ERROR?
1 - Verify the hints directory and hints file has the proper permissions. For example:
drwxr-xr-x 2 cassandra cassandra 4096 Aug 31 14:38 hints/
2 - Check OS logs for signs of disk issues that may cause issues deleting the hints file.
3 - Stop Cassandra/DSE, manually delete the hints file, then start the Cassandra/DSE process.