apache pig - Cannot Load Hive Table into Pig via HCatalog -
i configuring cloudera hdp dev image using this tutorial on centos 6.5, installing base , adding different components need them. currently, installing / testing hcatalog using this section of tutorial linked above.
i have installed package , testing hcatalog integration pig following script:
a = load 'groups' using org.apache.hcatalog.pig.hcatloader(); describe a;
i have created , populated 'groups' table in hive before running command. when run script command pig -usehcatalog test.pig
exception rather expected output. below initial part of stacktrace:
pig stack trace --------------- error 2245: cannot schema loadfunc org.apache.hcatalog.pig.hcatloader org.apache.pig.impl.logicallayer.frontendexception: error 1000: error during parsing. cannot schema loadfunc org.apache.hcatalog.pig.hcatloader @ org.apache.pig.pigserver$graph.parsequery(pigserver.java:1608) @ org.apache.pig.pigserver$graph.registerquery(pigserver.java:1547) @ org.apache.pig.pigserver.registerquery(pigserver.java:518) @ org.apache.pig.tools.grunt.gruntparser.processpig(gruntparser.java:991) @ org.apache.pig.tools.pigscript.parser.pigscriptparser.parse(pigscriptparser.java:412) ...
has encountered error before? appreciated. happy provide more information if need it.
the error caused hbase's thrift server not being proper configured. installed/configured thrift , added following hive-xml.site proper server information added:
<property> <name>hive.metastore.uris</name> <value>thrift://<!--url of server-->:9083</value> <description>ip address (or fully-qualified domain name) , port of metastore host</description> </property>
i thought snippet above not required since running cloudera hdp in pseudo-distributed mode.turns out, , hbase thrift required use hcatalog pig.
Comments
Post a Comment