Log files were reporting in UTC-7, but OS seemed to report correct time in date. We tried several ways to resolve, setting $TZ environment variable, setting -Duser.timezone in /bin/datastax-agent, but none of these seemed to solve the underlying problem.
I noticed the problem first in java_system_properties.json, noticing the line:
"user.timezone" : "America/Los_Angeles",
This information is pulled directly with the following command:
# sudo -u cassandra jcmd
31302 datastax-agent-6.5.3-standalone.jar /var/lib/datastax-agent/conf/address.yaml
# sudo -u cassandra jcmd 31302 VM.system_properties
#Tue Apr 09 09:09:51 PDT 2019
java.runtime.name=OpenJDK Runtime Environment
The, JVM pulls the time information from:
Local time: Tue 2019-04-09 18:44:01 UTC
Universal time: Tue 2019-04-09 18:44:01 UTC
RTC time: Tue 2019-04-09 18:44:01
Time zone: America/Los_Angeles (UTC, +0000)
NTP enabled: no
NTP synchronized: yes
RTC in local TZ: yes
DST active: n/a
So, we set the timezone:
# timedatectl set-timezone "UTC"
# sudo service dse restart
And everything started reporting in UTC again.
Note: You may need to restart datastax-agent separately, if it didn't work with the above.