hadoop - pig + hbase + hadoop2 integration -


has had successful experience loading data hbase-0.98.0 pig-0.12.0 on hadoop-2.2.0 in environment of hadoop-2.20+hbase-0.98.0+pig-0.12.0 combination without encountering error:

error 2998: unhandled internal error. org/apache/hadoop/hbase/filter/writablebytearraycomparable

with line of log trace: 

java.lang.noclassdeffounderror: org/apache/hadoop/hbase/filter/writablebytearra

i searched web , found handful of problems , solutions of them refer pre-hadoop2 , base-0.94-x not applicable situation. have 5 node hadoop-2.2.0 cluster , 3 node hbase-0.98.0 cluster , client machine installed hadoop-2.2.0, base-0.98.0, pig-0.12.0. each of them functioned fine separately , got hdfs, map reduce, region servers , pig worked fine. complete "loading data base pig" example, have following export:

export pig_classpath=$hadoop_install/etc/hadoop:$hbase_prefix/lib/*.jar :$hbase_prefix/lib/protobuf-java-2.5.0.jar:$hbase_prefix/lib/zookeeper-3.4.5.jar

and when tried run : pig -x local -f loaddata.pig , boom, following error:error 2998: unhandled internal error. org/apache/hadoop/hbase/filter/writablebytearraycomparable (this should 100+ times got dying countless tries figure out working setting). trace log shows:lava.lang.noclassdeffounderror: org/apache/hadoop/hbase/filter/writablebytearraycomparable following pig script:

register /usr/local/hbase/lib/hbase-*.jar; register /usr/local/hbase/lib/hadoop-*.jar; register /usr/local/hbase/lib/protobuf-java-2.5.0.jar; register /usr/local/hbase/lib/zookeeper-3.4.5.jar; raw_data = load '/home/hdadmin/200408hourly.txt' using pigstorage(','); weather_data = foreach raw_data generate $1, $10; ranked_data = rank weather_data; final_data = filter ranked_data $0 not null; store final_data 'hbase://weather' using org.apache.pig.backend.hadoop.hbase.hbasestorage('info:date info:temp');

i have created base table 'weather'. has had successful experience , generous share us?

ant clean jar-withouthadoop -dhadoopversion=23 -dhbaseversion=95

by default builds against hbase 0.94. 94 , 95 options.


Comments

Post a Comment

Popular posts from this blog

Android layout hidden on keyboard show -

i have strange problem layout. when tap on edittext , keyboard shown edittext stay on bottom , when tap on to hide keyboard , keyboard hides , edittext go should when want input text. when tap again, keyboard shown , edittext goes down behind keyboard... <relativelayout android:layout_width="match_parent" android:layout_height="match_parent" > <scrollview android:layout_width="match_parent" android:layout_height="fill_parent" android:above="@+id/rl_commands"> <textview android:layout_width="match_parent" android:layout_height="wrap_content"/> </scrollview> <relativelayout android:layout_width="match_parent android:layout_height="24dp" android:id="@+id/rl_commands" android:alignparentbottom="true">
Read more

google app engine - 403 Forbidden POST - Flask WTForms -

i have flask application running on google app engine. trying submit form built using wtform , keep getting following error. 403 forbidden: don't have permission access requested resource. either read-protected or not readable server. location.html (part of code) <form method=post action="/home/location"> .... <button type="submit" class="btn btn-primary" value="submit"> directions </button> </form> main.py @app.route('/home/location', methods=['post', 'get']) def location(): form = cfcdirections.direction(request.form) print(request.method) if request.method == 'post' , form.validate(): print("after if") directions = cfcdirections() street_no = directions.no street = directions.street suburb = directions.suburb postcode = directions.postcode
Read more

c - Why would PK11_GenerateRandom() return an error -8023? -

i looking through internet trying find source of pk11_generaterandom() function see why function fail. have program uses function when moved new flavor of linux, fails after forking ( fork() ) since not believe there problem nss, suspect doing incorrectly disregarded in older versions of linux new 1 there issue. the openssl package same on 'good' , 'bad' server: openssl 0.9.8e-fips-rhel5 01 jul nss rpm differs though. 'good' has nss-3.12.2.0-2.el5 and bas has version nss-3.15.3-4.el5_10 the 'good' server uses quite obsolete linux: linux 2.6.18-128.el5 #1 smp wed jan 21 08:45:05 est 2009 x86_64 x86_64 x86_64 gnu/linux enterprise linux enterprise linux server release 5.3 (carthage) red hat enterprise linux server release 5.3 (tikanga) the 'bad' server newer: linux bad 2.6.18-371.4.1.el5 #1 smp wed jan 29 11:05:49 pst 2014 x86_64 x86_64 x86_64 gnu/linux oracle linux server release 5.10 red hat enterprise linux server release
Read more