hadoop - Compatibility issue between Hbase 0.94.2 and apache nutch dependency -


i trying install apache nutch 2.2.1 , have build after making required changes in configuration files following http://www.blogjava.net/paulwong/archive/2013/08/31/403513.html tutorial. after building not able crawl , after hours of inspection realized hbase version on company cluster hbase- 0.94.2 whereas installation dependency apache nutch 2.2.1 hbase 0.90.4. hbase-0.90.4.jar not compatible hbase- 0.94.2 getting following error when try inject url nutch. kindly me in changing dependency of apache nutch or fixing error.

i posting error below.

caused by: java.lang.runtimeexception: java.lang.illegalargumentexception: not host:port pair: �-11562@bt13acl1node26.comp.com�$3�¿½bt13acl1node26.comp.com,60000,1401268790838 @ org.apache.gora.hbase.store.hbasestore.initialize(hbasestore.java:127) @ org.apache.gora.store.datastorefactory.initializedatastore(datastorefactory.java:102) @ org.apache.gora.store.datastorefactory.createdatastore(datastorefactory.java:161) ... 12 more

caused by: java.lang.illegalargumentexception: not host:port pair: �-11562@bt13acl1node26.comp.com�$3�¿½bt13acl1node26.comp.com,60000,1401268790838 @ org.apache.hadoop.hbase.hserveraddress.(hserveraddress.java:60) @ org.apache.hadoop.hbase.masteraddresstracker.getmasteraddress(masteraddresstracker.java:63) @ org.apache.hadoop.hbase.client.hconnectionmanager$hconnectionimplementation.getmaster(hconnectionmanager.java:354) @ org.apache.hadoop.hbase.client.hbaseadmin.(hbaseadmin.java:94) @ org.apache.gora.hbase.store.hbasestore.initialize(hbasestore.java:109) ... 14 more

you installed apache nutch 2.2.1 uses apache gora 0.3 supports old apache hbase 0.90.x stated in official docs.

anyway still can use nutch 2.2.x using following workaround:

  1. clone, configure , build fresh nutch official git branch 2.x migrated gora 0.4 compatible apache hbase 0.94.x.

  2. clone , build my version of apache hbase 0.94.24-hadoop-2.5.0 use latest apache hadoop 2.5.0.

similar issue created apache gora 0.3 project. don't plan upgrade apache hbase dependency fresh 1 in nearest future.

you can read compatibility documentation apache hbase figure out how build own version hadoop release.

apache nutch tested , works following stack:

  • apache nutch 2.x git branch uses gora 0.4;
  • apache hbase 0.94.24-hadoop-2.5.0;
  • apache hadoop 2.5.0.

Comments

Popular posts from this blog

commonjs - How to write a typescript definition file for a node module that exports a function? -

openid - Okta: Failed to get authorization code through API call -

ios - Change Storyboard View using Seague -