DataStax Help Center

Hive clients are unable to connect

Summary

After DSE is started, hive clients are unable to connect as if there were a misconfigured rpc_address on cassandra.yaml.
This usually comes up after DSE has been upgraded 

Symptoms

The following would be seen when trying to connect a hive client:

FAILED: Error in metadata: org.apache.hadoop.hive.ql.metadata.HiveException: com.datastax.bdp.hadoop.hive.metastore.CassandraHiveMetaStoreException: There was a problem with the Cassandra Hive MetaStore: Could not connect to Cassandra. Reason: Error connecting to node localhost:9160 with strategy STICKY.
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask


The following would be seen if dse hive is executed:

$ dse hive
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.exec.Utilities.getBuiltinUtilsClass()Ljava/lang/Class;
        at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:132)
        at org.apache.hadoop.hive.cli.CliSessionState.<init>(CliSessionState.java:78)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)


Also error like this shows upon DSE startup: 

ERROR [TASK-TRACKER-INIT] 2014-08-28 09:57:42,378 TaskTracker.java (line 1655) Shutting down. Incompatible buildVersion.
JobTracker's: 1.0.4.9 from 918f18e581d1e8ec2f7590a07bfc1051fdc5afd8 by jenkins source checksum ea1f86cc9e42bf3f44e98a5c7f244ceb
TaskTracker's: 1.0.4.10 from de08f8fcea1af29cbf2a21c9ad41a2c9fc4b931c by jenkins source checksum 2ea6da0799498821b363f35c08de8dff


So it's not that we do not have a process listening on port 9160 but rather an issue with incompatible package versions 

Cause

During upgrade, the recommendation is to uninstall DSE completely and then re-install the new version of DSE
This is the result of upgrading to a newer DSE version without uninstalling the old version.  
There are older packages lingering which do not play well with the newer versions

Solution

Backup your DSE configuration files 

  • /etc/dse/dse.yaml
  • /etc/dse/cassandra/cassandra.yaml
  • /etc/dse/cassandra/cassandra-topology.properties
  • /etc/dse/hadoop/core-site.xml

Stop the DSE service
Remove all of the DSE packages (See http://www.datastax.com/docs for specific DSE version/Install type)
Reinstall dse-full package (See http://www.datastax.com/docs for specific DSE version/Install type)
Re-instate previously backed configuration files
Start DSE service and verify there are no errors on system log
Set HADOOP_ENABLED=1/SPARK_ENABLED=1 as needed on /etc/defaults/dse
Restart DSE service and verify there are no errors on system log
Start dse hive and verify there are no errors

 

Was this article helpful?
1 out of 1 found this helpful
Have more questions? Submit a request

Comments

  • Avatar
    José Martínez Poblete

    From T11978

Powered by Zendesk